Jul 08 01:34:34 devstack cinder-volume[76015]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 08 01:34:34 devstack cinder-volume[76015]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 01:34:34 devstack cinder-volume[76015]: we strongly recommend against using it for new projects. Jul 08 01:34:34 devstack cinder-volume[76015]: If you are already using Eventlet, we recommend migrating to a different Jul 08 01:34:34 devstack cinder-volume[76015]: framework. For more detail see Jul 08 01:34:34 devstack cinder-volume[76015]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 01:34:34 devstack cinder-volume[76015]: import eventlet # noqa Jul 08 01:34:37 devstack cinder-volume[76015]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76015) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 01:34:37 devstack cinder-volume[76015]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76015) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 01:34:37 devstack cinder-volume[76015]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76015) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 01:34:38 devstack cinder-volume[76015]: INFO dbcounter [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] Registered counter for database cinder Jul 08 01:34:38 devstack cinder-volume[76015]: DEBUG oslo_db.sqlalchemy.engines [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76015) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 01:34:39 devstack cinder-volume[76015]: DEBUG dbcounter [-] [76015] Writer thread running {{(pid=76015) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 01:34:39 devstack cinder-volume[76015]: INFO cinder.rpc [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 08 01:34:39 devstack cinder-volume[76015]: INFO cinder.rpc [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 08 01:34:39 devstack cinder-volume[76015]: DEBUG oslo_db.sqlalchemy.engines [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76015) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 01:34:39 devstack cinder-volume[76015]: INFO cinder.volume.manager [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] Determined volume DB was empty at startup. Jul 08 01:34:39 devstack cinder-volume[76015]: DEBUG cinder.volume.manager [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76015) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 08 01:34:39 devstack cinder-volume[76015]: INFO cinder.volume.manager [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 08 01:34:39 devstack cinder-volume[76015]: WARNING stevedore.named [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 08 01:34:39 devstack cinder-volume[76015]: WARNING castellan.key_manager [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 01:34:39 devstack cinder-volume[76015]: WARNING cinder.keymgr.conf_key_mgr [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 01:34:39 devstack cinder-volume[76015]: DEBUG cinder.volume.drivers.lvm [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76015) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jul 08 01:34:39 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:39 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] CMD "cinder-rtstool verify" returned: 0 in 0.619s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:39 devstack cinder-volume[76015]: DEBUG oslo_db.sqlalchemy.engines [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76015) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 01:34:39 devstack cinder-volume[76015]: INFO cinder.rpc [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 08 01:34:39 devstack cinder-volume[76015]: INFO cinder.rpc [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 08 01:34:39 devstack cinder-volume[76015]: WARNING stevedore.named [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 08 01:34:39 devstack cinder-volume[76015]: WARNING castellan.key_manager [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 01:34:39 devstack cinder-volume[76015]: INFO cinder.volume.manager [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_db.sqlalchemy.engines [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76015) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 01:34:40 devstack cinder-volume[76015]: INFO oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] Starting 1 workers Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] Started child 76193 {{(pid=76015) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] Full set of CONF: {{(pid=76015) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] ******************************************************************************** {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] Configuration options gathered from: {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] ================================================================================ {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] allow_availability_zone_fallback = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] allow_compression_on_image_upload = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] allowed_direct_url_schemes = [] {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] api_rate_limit = True {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] auth_strategy = keystone {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] az_cache_duration = 3600 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] backend_availability_zone = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] backend_host = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] backend_name = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] backend_stats_polling_interval = 60 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76193]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] backup_api_class = cinder.backup.api.API {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] backup_name_template = backup-%s {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] backup_use_same_host = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] backup_use_temp_snapshot = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] chap_password = **** {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] chap_username = {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] cinder_internal_tenant_project_id = 2bb3aed651824ff888b8ba942dc19cf3 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] cinder_internal_tenant_user_id = c31bcf0afa484bbab22023312d764f8d {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] cloned_volume_same_az = True {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] cluster = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] compression_format = gzip {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] compute_api_class = cinder.compute.nova.API {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] config_dir = [] {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] config_source = [] {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] control_exchange = openstack {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] debug = True {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] default_availability_zone = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] default_group_type = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] default_volume_type = lvmdriver-1 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] disk_geometry = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] driver_client_cert = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] driver_client_cert_key = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] driver_data_namespace = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] driver_ssl_cert_path = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] driver_ssl_cert_verify = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] driver_use_ssl = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] enable_force_upload = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] enable_new_services = True {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] enable_unsupported_driver = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] enabled_backends = ['lvmdriver-1'] {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] enforce_multipath_for_image_xfer = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] filter_function = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] glance_api_insecure = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] glance_api_servers = ['http://192.168.122.201/image'] {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] glance_api_ssl_compression = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] glance_ca_certificates_file = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] glance_catalog_info = image:glance:publicURL {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] glance_certfile = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] glance_keyfile = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] glance_num_retries = 3 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] glance_request_timeout = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] goodness_function = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] graceful_shutdown_timeout = 5 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] group_api_class = cinder.group.api.API {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] host = devstack {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] image_compress_on_upload = True {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] image_conversion_address_space_limit = 1 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] image_conversion_cpu_limit = 60 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] image_conversion_disable = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] image_upload_use_cinder_backend = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] image_upload_use_internal_tenant = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] image_volume_cache_enabled = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] image_volume_cache_max_count = 0 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] image_volume_cache_max_size_gb = 0 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] init_host_max_objects_retrieval = 0 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] instance_format = [instance: %(uuid)s] {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] iscsi_target_flags = {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] iscsi_write_cache = on {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] iser_helper = tgtadm {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] iser_ip_address = 192.168.122.201 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] iser_port = 3260 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] log_color = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] log_config_append = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] log_dir = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] log_file = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack sudo[76198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] log_options = True {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] log_rotate_interval = 1 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] log_rotate_interval_type = days {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] log_rotation_type = none {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack sudo[76198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] max_age = 0 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] max_logfile_count = 30 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] max_logfile_size_mb = 200 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] max_over_subscription_ratio = 20.0 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] message_reap_interval = 86400 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] message_ttl = 2592000 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] migration_create_volume_timeout_secs = 300 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] monkey_patch = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] monkey_patch_modules = [] {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] my_ip = 192.168.122.201 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] no_snapshot_gb_quota = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] num_iser_scan_tries = 3 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] num_shell_tries = 3 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] num_volume_device_scan_tries = 3 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] nvmeof_conn_info_version = 1 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] nvmet_ns_id = 10 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] nvmet_port_id = 1 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] osapi_max_limit = 1000 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] osapi_volume_ext_list = [] {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] osapi_volume_listen = 0.0.0.0 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] osapi_volume_listen_port = 8776 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] osapi_volume_use_ssl = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] osapi_volume_workers = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] per_volume_size_limit = -1 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] periodic_fuzzy_delay = 60 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] periodic_interval = 60 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] project_id_regex = [0-9a-f\-]+ {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] public_endpoint = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] publish_errors = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] quota_backup_gigabytes = 1000 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] quota_backups = 10 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] quota_gigabytes = 1000 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] quota_groups = 10 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] quota_snapshots = 10 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] quota_volumes = 10 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] rate_limit_burst = 0 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] rate_limit_except_level = CRITICAL {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] rate_limit_interval = 0 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] reinit_driver_count = 3 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] replication_device = **** {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] report_discard_supported = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] report_interval = 120 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] reservation_clean_interval = 86400 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] reservation_expire = 86400 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76193]: INFO cinder.volume.manager [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] reserved_image_namespaces = [] {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] reserved_percentage = 0 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] rpc_response_timeout = 120 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] run_external_periodic_tasks = True {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] scst_target_driver = iscsi {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] scst_target_iqn_name = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] service_down_time = 720 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] shell_completion = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] snapshot_name_template = snapshot-%s {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] snapshot_same_host = True {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] split_loggers = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] state_path = /opt/stack/data/cinder {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] storage_availability_zone = nova {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] storage_protocol = iSCSI {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] syslog_log_facility = LOG_USER {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] target_helper = lioadm {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] target_ip_address = 192.168.122.201 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] target_port = 3260 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] target_protocol = iscsi {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] target_secondary_ip_addresses = [] {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] trace_flags = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] transfer_api_class = cinder.transfer.api.API {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] transport_url = **** {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] until_refresh = 0 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] use_chap_auth = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] use_default_quota_class = True {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] use_journal = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] use_json = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] use_multipath_for_image_xfer = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] use_stderr = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] use_syslog = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] verify_glance_signatures = enabled {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] volume_api_class = cinder.volume.api.API {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] volume_backend_name = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] volume_clear = zero {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] volume_clear_ionice = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] volume_clear_size = 0 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] volume_copy_bps_limit = 0 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] volume_dd_blocksize = 1M {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] volume_name_template = volume-%s {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] volume_service_inithost_offload = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] volume_usage_audit_period = month {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] zoning_mode = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] oslo_concurrency.disable_process_locking = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.039s {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] keystone_authtoken.auth_section = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] keystone_authtoken.auth_type = password {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] keystone_authtoken.auth_version = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] keystone_authtoken.cache = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] keystone_authtoken.certfile = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] keystone_authtoken.delay_auth_decision = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] keystone_authtoken.http_connect_timeout = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] keystone_authtoken.include_service_catalog = True {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] keystone_authtoken.insecure = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] keystone_authtoken.interface = public {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] keystone_authtoken.keyfile = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] keystone_authtoken.memcache_password = {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] keystone_authtoken.memcache_username = {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] keystone_authtoken.region_name = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] keystone_authtoken.service_token_roles_required = True {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] keystone_authtoken.service_type = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] keystone_authtoken.token_cache_time = 300 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.201/identity {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] cache.backend = dogpile.cache.null {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] cache.backend_argument = **** {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] cache.backend_expiration_time = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] cache.config_prefix = cache.oslo {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] cache.debug_cache_backend = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] cache.enable_retry_client = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] cache.enable_socket_keepalive = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] cache.enabled = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] cache.expiration_time = 600 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] cache.hashclient_retry_attempts = 2 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] cache.memcache_dead_retry = 300 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] cache.memcache_pool_maxsize = 10 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] cache.memcache_sasl_enabled = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] cache.password = **** {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] cache.proxies = [] {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] cache.redis_db = 0 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] cache.redis_sentinel_service_name = mymaster {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] cache.redis_server = localhost:6379 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] cache.retry_attempts = 2 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] cache.retry_delay = 0.0 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] cache.socket_keepalive_count = 1 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] cache.socket_keepalive_idle = 1 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] cache.socket_keepalive_interval = 1 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] cache.socket_timeout = 1.0 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] cache.tls_allowed_ciphers = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] cache.tls_cafile = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] cache.tls_certfile = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] cache.tls_enabled = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] cache.tls_keyfile = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] cache.username = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] coordination.backend_url = **** {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] database.asyncio_connection = **** {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] database.asyncio_slave_connection = **** {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] database.backend = sqlalchemy {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] database.connection = **** {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] database.connection_debug = 0 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] database.connection_parameters = {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] database.connection_recycle_time = 3600 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] database.connection_trace = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] database.db_inc_retry_interval = True {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] database.db_max_retries = 20 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] database.db_max_retry_interval = 10 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] database.db_retry_interval = 1 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] database.max_overflow = 50 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] database.max_pool_size = 5 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] database.max_retries = 10 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] database.mysql_wsrep_sync_wait = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] database.pool_timeout = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] database.retry_interval = 10 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] database.slave_connection = **** {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] database.sqlite_synchronous = True {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] database.synchronous_reader = True {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] database.use_db_reconnect = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] profiler.connection_string = messaging:// {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] profiler.enabled = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] profiler.es_doc_type = notification {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] profiler.es_scroll_size = 10000 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] profiler.es_scroll_time = 2m {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] profiler.filter_error_trace = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] profiler.hmac_keys = **** {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] profiler.sentinel_service_name = mymaster {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] profiler.socket_timeout = 0.1 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] profiler.trace_requests = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] profiler.trace_sqlalchemy = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] profiler_jaeger.process_tags = {} {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] profiler_jaeger.service_name_prefix = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] profiler_otlp.service_name_prefix = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] oslo_policy.enforce_new_defaults = True {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] oslo_policy.enforce_scope = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] oslo_policy.policy_default_rule = default {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] oslo_policy.policy_file = policy.yaml {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] oslo_policy.remote_timeout = 60.0 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] privsep_osbrick.group = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] privsep_osbrick.helper_command = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] privsep_osbrick.user = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] cinder_sys_admin.group = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] cinder_sys_admin.helper_command = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] cinder_sys_admin.user = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] service_user.auth_section = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] service_user.auth_type = password {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] service_user.cafile = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] service_user.certfile = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] service_user.collect_timing = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] service_user.insecure = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] service_user.keyfile = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] service_user.send_service_user_token = True {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] service_user.split_loggers = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] service_user.timeout = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] glance.auth_section = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] glance.auth_type = password {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] glance.certfile = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] glance.collect_timing = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] glance.insecure = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] glance.keyfile = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] glance.region_name = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] glance.split_loggers = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] glance.timeout = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] backend_defaults.backend_availability_zone = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] backend_defaults.chap_password = **** {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] backend_defaults.chap_username = {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] backend_defaults.disk_geometry = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] backend_defaults.driver_client_cert = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] backend_defaults.driver_client_cert_key = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] backend_defaults.driver_data_namespace = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] backend_defaults.driver_use_ssl = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] backend_defaults.enable_unsupported_driver = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] backend_defaults.extra_capabilities = {} {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] backend_defaults.filter_function = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] backend_defaults.goodness_function = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] backend_defaults.iscsi_target_flags = {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] backend_defaults.iscsi_write_cache = on {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] backend_defaults.iser_helper = tgtadm {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] backend_defaults.iser_ip_address = 192.168.122.201 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] backend_defaults.iser_port = 3260 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] backend_defaults.lvm_mirrors = 0 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] backend_defaults.lvm_share_target = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] backend_defaults.lvm_type = auto {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] backend_defaults.num_shell_tries = 3 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] backend_defaults.nvmet_port_id = 1 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] backend_defaults.replication_device = **** {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] backend_defaults.report_discard_supported = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] backend_defaults.reserved_percentage = 0 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] backend_defaults.scst_target_driver = iscsi {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] backend_defaults.scst_target_iqn_name = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] backend_defaults.storage_protocol = iSCSI {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] backend_defaults.target_helper = tgtadm {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] backend_defaults.target_ip_address = 192.168.122.201 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] backend_defaults.target_port = 3260 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] backend_defaults.target_protocol = iscsi {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] backend_defaults.trace_flags = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] backend_defaults.unique_fqdn_network = True {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] backend_defaults.use_chap_auth = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] backend_defaults.volume_backend_name = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] backend_defaults.volume_clear = zero {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] backend_defaults.volume_clear_ionice = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] backend_defaults.volume_clear_size = 0 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] backend_defaults.volume_group = cinder-volumes {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] oslo_reports.file_event_handler = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] oslo_reports.log_dir = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] lvmdriver-1.backend_availability_zone = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] lvmdriver-1.backend_host = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] lvmdriver-1.chap_password = **** {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] lvmdriver-1.chap_username = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] lvmdriver-1.chiscsi_conf = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] lvmdriver-1.disk_geometry = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] lvmdriver-1.driver_client_cert = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] lvmdriver-1.driver_data_namespace = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] lvmdriver-1.driver_use_ssl = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] lvmdriver-1.extra_capabilities = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] lvmdriver-1.filter_function = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] lvmdriver-1.goodness_function = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] lvmdriver-1.iser_helper = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] lvmdriver-1.iser_ip_address = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] lvmdriver-1.iser_port = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] lvmdriver-1.iser_target_prefix = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] lvmdriver-1.lvm_conf_file = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] lvmdriver-1.lvm_mirrors = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] lvmdriver-1.lvm_share_target = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] lvmdriver-1.lvm_type = auto {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] lvmdriver-1.num_shell_tries = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] lvmdriver-1.nvmet_port_id = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] lvmdriver-1.replication_device = **** {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] lvmdriver-1.report_discard_supported = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] lvmdriver-1.reserved_percentage = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] lvmdriver-1.scst_target_driver = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] lvmdriver-1.storage_protocol = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] lvmdriver-1.target_helper = lioadm {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] lvmdriver-1.target_ip_address = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] lvmdriver-1.target_port = 3260 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] lvmdriver-1.target_protocol = iscsi {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] lvmdriver-1.trace_flags = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] lvmdriver-1.use_chap_auth = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] lvmdriver-1.volume_clear = zero {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] lvmdriver-1.volume_clear_size = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] lvmdriver-1.volumes_dir = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] oslo_messaging_rabbit.ssl = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] oslo_messaging_rabbit.ssl_version = {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] oslo_messaging_notifications.driver = [] {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] oslo_messaging_notifications.retry = -1 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] oslo_messaging_notifications.transport_url = **** {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] key_manager.fixed_key = **** {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] barbican.barbican_api_version = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] barbican.barbican_endpoint = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] barbican.barbican_endpoint_type = public {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] barbican.barbican_region_name = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] barbican.cafile = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] barbican.certfile = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] barbican.collect_timing = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] barbican.insecure = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] barbican.keyfile = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] barbican.number_of_retries = 60 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] barbican.retry_delay = 1 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] barbican.send_service_user_token = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] barbican.split_loggers = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] barbican.timeout = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] barbican.verify_ssl = True {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] barbican.verify_ssl_path = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] barbican_service_user.auth_section = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] barbican_service_user.auth_type = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] barbican_service_user.cafile = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] barbican_service_user.certfile = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] barbican_service_user.collect_timing = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] barbican_service_user.insecure = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] barbican_service_user.keyfile = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] barbican_service_user.split_loggers = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] barbican_service_user.timeout = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] vault.approle_role_id = **** {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] vault.approle_secret_id = **** {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] vault.kv_mountpoint = secret {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] vault.kv_path = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] vault.kv_version = 2 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] vault.namespace = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] vault.root_token_id = **** {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] vault.ssl_ca_crt_file = None {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] vault.timeout = 60.0 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] vault.use_ssl = False {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:34:40 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] ******************************************************************************** {{(pid=76015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 08 01:34:41 devstack sudo[76198]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:41 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.762s {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:41 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:41 devstack sudo[76203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 01:34:41 devstack sudo[76203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:41 devstack sudo[76203]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:41 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.746s {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:41 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:34:41 devstack cinder-volume[76193]: INFO cinder.brick.local_dev.lvm [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 08 01:34:41 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:41 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:41 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:41 devstack sudo[76499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 01:34:41 devstack sudo[76499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:42 devstack sudo[76499]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:42 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.752s {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:42 devstack cinder-volume[76193]: DEBUG cinder.brick.local_dev.lvm [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76193) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jul 08 01:34:42 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:42 devstack sudo[76762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 01:34:42 devstack sudo[76762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:43 devstack sudo[76762]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:43 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.307s {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:43 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:43 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:43 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:43 devstack sudo[76936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 01:34:43 devstack sudo[76936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:44 devstack sudo[76936]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:44 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.824s {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:44 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:44 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:44 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:44 devstack sudo[76978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 08 01:34:44 devstack sudo[76978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:45 devstack sudo[76978]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:45 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.764s {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:45 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:45 devstack sudo[76982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 01:34:45 devstack sudo[76982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:46 devstack sudo[76982]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:46 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.884s {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:46 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:46 devstack sudo[76987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 01:34:46 devstack sudo[76987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:47 devstack sudo[76987]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:47 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.835s {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:47 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:47 devstack sudo[76997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 01:34:47 devstack sudo[76997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:48 devstack sudo[76997]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:48 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.042s {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:48 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:48 devstack sudo[77005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 01:34:48 devstack sudo[77005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:49 devstack sudo[77005]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:49 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.770s {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:49 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:49 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:49 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:49 devstack sudo[77012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 01:34:49 devstack sudo[77012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:49 devstack sudo[77012]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:49 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.905s {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:49 devstack cinder-volume[76193]: INFO cinder.volume.drivers.lvm [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 08 01:34:49 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:49 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:49 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:49 devstack sudo[77046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 01:34:49 devstack sudo[77046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:50 devstack cinder-volume[76015]: DEBUG dbcounter [-] [76015] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76015) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:34:50 devstack sudo[77046]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:50 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.750s {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:50 devstack cinder-volume[76193]: DEBUG cinder.volume.drivers.lvm [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] Updating volume stats {{(pid=76193) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 01:34:50 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:50 devstack sudo[77137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 01:34:50 devstack sudo[77137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:51 devstack sudo[77137]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:51 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.764s {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:51 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:51 devstack sudo[77280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 01:34:51 devstack sudo[77280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:52 devstack sudo[77280]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:52 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.670s {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:52 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:52 devstack sudo[77284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 01:34:52 devstack sudo[77284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:52 devstack sudo[77284]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:52 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.706s {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:52 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:52 devstack sudo[77287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 01:34:52 devstack sudo[77287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:53 devstack sudo[77287]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:53 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.662s {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:53 devstack cinder-volume[76193]: INFO cinder.volume.driver [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] Driver hasn't implemented _init_vendor_properties() Jul 08 01:34:53 devstack cinder-volume[76193]: DEBUG cinder.volume.driver [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76193) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 08 01:34:53 devstack cinder-volume[76193]: DEBUG oslo_db.sqlalchemy.engines [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76193) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 01:34:53 devstack cinder-volume[76193]: DEBUG dbcounter [-] [76193] Writer thread running {{(pid=76193) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 01:34:53 devstack cinder-volume[76193]: DEBUG cinder.db.api [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] Building query based on filter {{(pid=76193) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 08 01:34:53 devstack cinder-volume[76193]: DEBUG cinder.image.image_utils [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76193) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 08 01:34:53 devstack cinder-volume[76193]: INFO cinder.keymgr.migration [None req-15b9f5f3-bbf1-4b4c-bae5-6376a7a9e443 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 08 01:34:53 devstack cinder-volume[76193]: DEBUG cinder.volume.drivers.lvm [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] Updating volume stats {{(pid=76193) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 01:34:53 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:53 devstack sudo[77292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 01:34:53 devstack sudo[77292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:54 devstack sudo[77292]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:54 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.725s {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:54 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:54 devstack sudo[77295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 01:34:54 devstack sudo[77295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:55 devstack sudo[77295]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:55 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.701s {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:55 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:55 devstack sudo[77301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 01:34:55 devstack sudo[77301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:55 devstack sudo[77301]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:55 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.700s {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:55 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:55 devstack sudo[77306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 01:34:55 devstack sudo[77306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:56 devstack sudo[77306]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:56 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.737s {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:56 devstack cinder-volume[76193]: DEBUG cinder.manager [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] Notifying Schedulers of capabilities ... {{(pid=76193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:34:56 devstack cinder-volume[76193]: INFO cinder.volume.manager [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] Driver initialization completed successfully. Jul 08 01:34:56 devstack cinder-volume[76193]: INFO cinder.manager [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] Initiating service 2 cleanup Jul 08 01:34:56 devstack cinder-volume[76193]: INFO cinder.manager [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] Service 2 cleanup completed. Jul 08 01:34:56 devstack cinder-volume[76193]: DEBUG cinder.service [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] Creating RPC server for service cinder-volume {{(pid=76193) start /opt/stack/cinder/cinder/service.py:231}} Jul 08 01:34:56 devstack cinder-volume[76193]: DEBUG cinder.service [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76193) start /opt/stack/cinder/cinder/service.py:237}} Jul 08 01:34:56 devstack cinder-volume[76193]: INFO cinder.volume.manager [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 08 01:34:56 devstack cinder-volume[76193]: DEBUG cinder.volume.drivers.lvm [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] Updating volume stats {{(pid=76193) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 01:34:56 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:56 devstack sudo[77309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 01:34:56 devstack sudo[77309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:57 devstack sudo[77309]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:57 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.746s {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:57 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:57 devstack sudo[77313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 01:34:57 devstack sudo[77313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:58 devstack sudo[77313]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:58 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.755s {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:58 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:58 devstack sudo[77316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 01:34:58 devstack sudo[77316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:58 devstack sudo[77316]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:58 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.642s {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:58 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:34:58 devstack sudo[77376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 01:34:58 devstack sudo[77376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:34:59 devstack sudo[77376]: pam_unix(sudo:session): session closed for user root Jul 08 01:34:59 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.645s {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:34:59 devstack cinder-volume[76193]: INFO cinder.volume.manager [None req-563de98f-a5c1-4108-9021-9761898c02d1 None None] Driver post RPC initialization completed successfully. Jul 08 01:35:09 devstack cinder-volume[76193]: DEBUG dbcounter [-] [76193] Writing DB stats cinder:SELECT=4 {{(pid=76193) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:35:09 devstack cinder-volume[76193]: DEBUG dbcounter [-] [76193] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76193) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:35:22 devstack cinder-volume[76193]: DEBUG oslo_service.periodic_task [None req-b5ac1825-79bf-43bc-8b2b-45b359c32bf8 None None] Running periodic task VolumeManager._thread_info {{(pid=76193) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:35:22 devstack cinder-volume[76193]: DEBUG cinder.volume.manager [None req-b5ac1825-79bf-43bc-8b2b-45b359c32bf8 None None] thread count: 6 {{(pid=76193) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:35:22 devstack cinder-volume[76193]: DEBUG cinder.volume.manager [None req-b5ac1825-79bf-43bc-8b2b-45b359c32bf8 None None] thread info: [<_MainThread(MainThread, started 134593891688576)>, , , , , ] {{(pid=76193) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:36:22 devstack cinder-volume[76193]: DEBUG oslo_service.periodic_task [None req-b5ac1825-79bf-43bc-8b2b-45b359c32bf8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76193) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:36:22 devstack cinder-volume[76193]: DEBUG cinder.volume.drivers.lvm [None req-b5ac1825-79bf-43bc-8b2b-45b359c32bf8 None None] Updating volume stats {{(pid=76193) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 01:36:22 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-b5ac1825-79bf-43bc-8b2b-45b359c32bf8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:22 devstack sudo[79733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 01:36:22 devstack sudo[79733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:23 devstack sudo[79733]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:23 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-b5ac1825-79bf-43bc-8b2b-45b359c32bf8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.666s {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:23 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-b5ac1825-79bf-43bc-8b2b-45b359c32bf8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:23 devstack sudo[79736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 01:36:23 devstack sudo[79736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:23 devstack sudo[79736]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:23 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-b5ac1825-79bf-43bc-8b2b-45b359c32bf8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.690s {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:23 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-b5ac1825-79bf-43bc-8b2b-45b359c32bf8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:23 devstack sudo[79739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 01:36:23 devstack sudo[79739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:24 devstack sudo[79739]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:24 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-b5ac1825-79bf-43bc-8b2b-45b359c32bf8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.655s {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:24 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-b5ac1825-79bf-43bc-8b2b-45b359c32bf8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:36:24 devstack sudo[79743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 01:36:24 devstack sudo[79743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:36:25 devstack sudo[79743]: pam_unix(sudo:session): session closed for user root Jul 08 01:36:25 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-b5ac1825-79bf-43bc-8b2b-45b359c32bf8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.697s {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:36:25 devstack cinder-volume[76193]: DEBUG cinder.manager [None req-b5ac1825-79bf-43bc-8b2b-45b359c32bf8 None None] Notifying Schedulers of capabilities ... {{(pid=76193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:36:25 devstack cinder-volume[76193]: DEBUG oslo_service.periodic_task [None req-b5ac1825-79bf-43bc-8b2b-45b359c32bf8 None None] Running periodic task VolumeManager._thread_info {{(pid=76193) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:36:25 devstack cinder-volume[76193]: DEBUG cinder.volume.manager [None req-b5ac1825-79bf-43bc-8b2b-45b359c32bf8 None None] thread count: 6 {{(pid=76193) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:36:25 devstack cinder-volume[76193]: DEBUG cinder.volume.manager [None req-b5ac1825-79bf-43bc-8b2b-45b359c32bf8 None None] thread info: [<_MainThread(MainThread, started 134593891688576)>, , , , , ] {{(pid=76193) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:37:09 devstack cinder-volume[76193]: DEBUG dbcounter [-] [76193] Writing DB stats cinder:SELECT=1 {{(pid=76193) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:37:09 devstack cinder-volume[76193]: DEBUG dbcounter [-] [76193] Writing DB stats cinder:UPDATE=1 {{(pid=76193) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:37:22 devstack cinder-volume[76193]: DEBUG oslo_service.periodic_task [None req-b5ac1825-79bf-43bc-8b2b-45b359c32bf8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76193) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:37:22 devstack cinder-volume[76193]: DEBUG cinder.volume.drivers.lvm [None req-b5ac1825-79bf-43bc-8b2b-45b359c32bf8 None None] Updating volume stats {{(pid=76193) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 01:37:22 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-b5ac1825-79bf-43bc-8b2b-45b359c32bf8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:22 devstack sudo[82715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 01:37:22 devstack sudo[82715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:23 devstack sudo[82715]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:23 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-b5ac1825-79bf-43bc-8b2b-45b359c32bf8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.812s {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:23 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-b5ac1825-79bf-43bc-8b2b-45b359c32bf8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:23 devstack sudo[82719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 01:37:23 devstack sudo[82719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:24 devstack sudo[82719]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:24 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-b5ac1825-79bf-43bc-8b2b-45b359c32bf8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.681s {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:24 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-b5ac1825-79bf-43bc-8b2b-45b359c32bf8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:24 devstack sudo[82727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 01:37:24 devstack sudo[82727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:24 devstack sudo[82727]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:24 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-b5ac1825-79bf-43bc-8b2b-45b359c32bf8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.705s {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:24 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-b5ac1825-79bf-43bc-8b2b-45b359c32bf8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:37:24 devstack sudo[82730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 01:37:24 devstack sudo[82730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:37:25 devstack sudo[82730]: pam_unix(sudo:session): session closed for user root Jul 08 01:37:25 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-b5ac1825-79bf-43bc-8b2b-45b359c32bf8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.716s {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:37:25 devstack cinder-volume[76193]: DEBUG cinder.manager [None req-b5ac1825-79bf-43bc-8b2b-45b359c32bf8 None None] Notifying Schedulers of capabilities ... {{(pid=76193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:37:25 devstack cinder-volume[76193]: DEBUG oslo_service.periodic_task [None req-b5ac1825-79bf-43bc-8b2b-45b359c32bf8 None None] Running periodic task VolumeManager._thread_info {{(pid=76193) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:37:25 devstack cinder-volume[76193]: DEBUG cinder.volume.manager [None req-b5ac1825-79bf-43bc-8b2b-45b359c32bf8 None None] thread count: 6 {{(pid=76193) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:37:25 devstack cinder-volume[76193]: DEBUG cinder.volume.manager [None req-b5ac1825-79bf-43bc-8b2b-45b359c32bf8 None None] thread info: [<_MainThread(MainThread, started 134593891688576)>, , , , , ] {{(pid=76193) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:38:22 devstack cinder-volume[76193]: DEBUG oslo_service.periodic_task [None req-b5ac1825-79bf-43bc-8b2b-45b359c32bf8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76193) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:38:22 devstack cinder-volume[76193]: DEBUG cinder.volume.drivers.lvm [None req-b5ac1825-79bf-43bc-8b2b-45b359c32bf8 None None] Updating volume stats {{(pid=76193) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 01:38:22 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-b5ac1825-79bf-43bc-8b2b-45b359c32bf8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:22 devstack sudo[84718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 01:38:22 devstack sudo[84718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:23 devstack sudo[84718]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:23 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-b5ac1825-79bf-43bc-8b2b-45b359c32bf8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.700s {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:23 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-b5ac1825-79bf-43bc-8b2b-45b359c32bf8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:23 devstack sudo[84745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 01:38:23 devstack sudo[84745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:24 devstack sudo[84745]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:24 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-b5ac1825-79bf-43bc-8b2b-45b359c32bf8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.711s {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:24 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-b5ac1825-79bf-43bc-8b2b-45b359c32bf8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:24 devstack sudo[84793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 01:38:24 devstack sudo[84793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:24 devstack sudo[84793]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:24 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-b5ac1825-79bf-43bc-8b2b-45b359c32bf8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.830s {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:24 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-b5ac1825-79bf-43bc-8b2b-45b359c32bf8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:38:24 devstack sudo[84864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 01:38:24 devstack sudo[84864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:38:25 devstack sudo[84864]: pam_unix(sudo:session): session closed for user root Jul 08 01:38:25 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-b5ac1825-79bf-43bc-8b2b-45b359c32bf8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.699s {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:38:25 devstack cinder-volume[76193]: DEBUG cinder.manager [None req-b5ac1825-79bf-43bc-8b2b-45b359c32bf8 None None] Notifying Schedulers of capabilities ... {{(pid=76193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:38:25 devstack cinder-volume[76193]: DEBUG oslo_service.periodic_task [None req-b5ac1825-79bf-43bc-8b2b-45b359c32bf8 None None] Running periodic task VolumeManager._thread_info {{(pid=76193) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:38:25 devstack cinder-volume[76193]: DEBUG cinder.volume.manager [None req-b5ac1825-79bf-43bc-8b2b-45b359c32bf8 None None] thread count: 6 {{(pid=76193) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:38:25 devstack cinder-volume[76193]: DEBUG cinder.volume.manager [None req-b5ac1825-79bf-43bc-8b2b-45b359c32bf8 None None] thread info: [<_MainThread(MainThread, started 134593891688576)>, , , , , ] {{(pid=76193) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:39:09 devstack cinder-volume[76193]: DEBUG dbcounter [-] [76193] Writing DB stats cinder:SELECT=1 {{(pid=76193) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:39:09 devstack cinder-volume[76193]: DEBUG dbcounter [-] [76193] Writing DB stats cinder:UPDATE=1 {{(pid=76193) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:39:22 devstack cinder-volume[76193]: DEBUG oslo_service.periodic_task [None req-b5ac1825-79bf-43bc-8b2b-45b359c32bf8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76193) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:39:22 devstack cinder-volume[76193]: DEBUG cinder.volume.drivers.lvm [None req-b5ac1825-79bf-43bc-8b2b-45b359c32bf8 None None] Updating volume stats {{(pid=76193) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 01:39:22 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-b5ac1825-79bf-43bc-8b2b-45b359c32bf8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:22 devstack sudo[85913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 01:39:22 devstack sudo[85913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:23 devstack sudo[85913]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:23 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-b5ac1825-79bf-43bc-8b2b-45b359c32bf8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.657s {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:23 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-b5ac1825-79bf-43bc-8b2b-45b359c32bf8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:23 devstack sudo[85920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 01:39:23 devstack sudo[85920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:23 devstack sudo[85920]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:23 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-b5ac1825-79bf-43bc-8b2b-45b359c32bf8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.679s {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:23 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-b5ac1825-79bf-43bc-8b2b-45b359c32bf8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:23 devstack sudo[85935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 01:39:23 devstack sudo[85935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:24 devstack sudo[85935]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:24 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-b5ac1825-79bf-43bc-8b2b-45b359c32bf8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.692s {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:24 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-b5ac1825-79bf-43bc-8b2b-45b359c32bf8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:24 devstack sudo[85953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 01:39:24 devstack sudo[85953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:25 devstack sudo[85953]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:25 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-b5ac1825-79bf-43bc-8b2b-45b359c32bf8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.659s {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:25 devstack cinder-volume[76193]: DEBUG cinder.manager [None req-b5ac1825-79bf-43bc-8b2b-45b359c32bf8 None None] Notifying Schedulers of capabilities ... {{(pid=76193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:39:35 devstack cinder-volume[76015]: INFO oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] Caught SIGTERM, stopping children Jul 08 01:39:35 devstack cinder-volume[76015]: DEBUG oslo_concurrency.lockutils [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] Acquiring lock "singleton_lock" {{(pid=76015) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 01:39:35 devstack cinder-volume[76015]: DEBUG oslo_concurrency.lockutils [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] Acquired lock "singleton_lock" {{(pid=76015) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 01:39:35 devstack cinder-volume[76015]: DEBUG oslo_concurrency.lockutils [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] Releasing lock "singleton_lock" {{(pid=76015) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 01:39:35 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] Stop services. {{(pid=76015) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 08 01:39:35 devstack cinder-volume[76015]: DEBUG oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] Killing children. {{(pid=76015) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 08 01:39:35 devstack cinder-volume[76015]: INFO oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] Waiting on 1 children to exit Jul 08 01:39:36 devstack cinder-volume[76193]: DEBUG oslo_concurrency.lockutils [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] Acquiring lock "singleton_lock" {{(pid=76193) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 01:39:36 devstack cinder-volume[76193]: DEBUG oslo_concurrency.lockutils [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] Acquired lock "singleton_lock" {{(pid=76193) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 01:39:36 devstack cinder-volume[76193]: DEBUG oslo_concurrency.lockutils [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] Releasing lock "singleton_lock" {{(pid=76193) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 01:39:36 devstack cinder-volume[76193]: WARNING amqp [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 08 01:39:36 devstack cinder-volume[76193]: WARNING amqp [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 08 01:39:36 devstack cinder-volume[76015]: INFO oslo_service.backend._eventlet.service [None req-99c261ea-1845-401a-8d97-a7571beb266f None None] Child 76193 exited with status 0 Jul 08 01:39:37 devstack cinder-volume[86339]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 08 01:39:37 devstack cinder-volume[86339]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 01:39:37 devstack cinder-volume[86339]: we strongly recommend against using it for new projects. Jul 08 01:39:37 devstack cinder-volume[86339]: If you are already using Eventlet, we recommend migrating to a different Jul 08 01:39:37 devstack cinder-volume[86339]: framework. For more detail see Jul 08 01:39:37 devstack cinder-volume[86339]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 01:39:37 devstack cinder-volume[86339]: import eventlet # noqa Jul 08 01:39:39 devstack cinder-volume[86339]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86339) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 01:39:39 devstack cinder-volume[86339]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86339) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 01:39:39 devstack cinder-volume[86339]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86339) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 01:39:40 devstack cinder-volume[86339]: INFO dbcounter [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] Registered counter for database cinder Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_db.sqlalchemy.engines [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86339) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG dbcounter [-] [86339] Writer thread running {{(pid=86339) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 01:39:40 devstack cinder-volume[86339]: INFO cinder.rpc [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 08 01:39:40 devstack cinder-volume[86339]: INFO cinder.rpc [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_db.sqlalchemy.engines [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86339) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 01:39:40 devstack cinder-volume[86339]: INFO cinder.volume.manager [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] Determined volume DB was empty at startup. Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG cinder.volume.manager [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86339) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 08 01:39:40 devstack cinder-volume[86339]: INFO cinder.volume.manager [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 08 01:39:40 devstack cinder-volume[86339]: WARNING stevedore.named [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 08 01:39:40 devstack cinder-volume[86339]: WARNING castellan.key_manager [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 01:39:40 devstack cinder-volume[86339]: WARNING cinder.keymgr.conf_key_mgr [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 01:39:40 devstack cinder-volume[86339]: INFO cinder.volume.manager [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_db.sqlalchemy.engines [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86339) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 01:39:40 devstack cinder-volume[86339]: INFO oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] Starting 1 workers Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] Started child 86552 {{(pid=86339) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] Full set of CONF: {{(pid=86339) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] ******************************************************************************** {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] Configuration options gathered from: {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] ================================================================================ {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 08 01:39:40 devstack cinder-volume[86552]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] allow_availability_zone_fallback = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] allow_compression_on_image_upload = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] allowed_direct_url_schemes = [] {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] api_rate_limit = True {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] auth_strategy = keystone {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_availability_zone = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_host = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_name = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_stats_polling_interval = 60 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backup_api_class = cinder.backup.api.API {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backup_name_template = backup-%s {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backup_use_same_host = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backup_use_temp_snapshot = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] chap_password = **** {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] chap_username = {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] cinder_internal_tenant_project_id = 2bb3aed651824ff888b8ba942dc19cf3 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] cinder_internal_tenant_user_id = c31bcf0afa484bbab22023312d764f8d {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] cluster = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] compression_format = gzip {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] compute_api_class = cinder.compute.nova.API {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] config_dir = [] {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] config_source = [] {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] control_exchange = openstack {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] debug = True {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] default_availability_zone = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] default_group_type = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] default_volume_type = QuobyteHD {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] disk_geometry = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] driver_client_cert = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] driver_client_cert_key = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] driver_data_namespace = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] driver_ssl_cert_path = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] driver_ssl_cert_verify = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] driver_use_ssl = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] enable_new_services = True {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] enable_unsupported_driver = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] enabled_backends = ['QuobyteHD'] {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] enforce_multipath_for_image_xfer = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] filter_function = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] glance_api_insecure = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] glance_api_servers = ['http://192.168.122.201/image'] {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] glance_api_ssl_compression = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] glance_ca_certificates_file = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] glance_catalog_info = image:glance:publicURL {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] glance_certfile = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] glance_keyfile = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] glance_num_retries = 3 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] glance_request_timeout = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] goodness_function = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] graceful_shutdown_timeout = 5 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] group_api_class = cinder.group.api.API {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] host = devstack {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] image_compress_on_upload = True {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] image_conversion_address_space_limit = 1 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] image_conversion_cpu_limit = 60 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] image_conversion_disable = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] image_upload_use_cinder_backend = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] image_upload_use_internal_tenant = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] image_volume_cache_enabled = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] image_volume_cache_max_count = 0 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] image_volume_cache_max_size_gb = 0 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] init_host_max_objects_retrieval = 0 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] instance_format = [instance: %(uuid)s] {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] iscsi_target_flags = {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] iscsi_write_cache = on {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] iser_helper = tgtadm {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] iser_ip_address = 192.168.122.201 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] iser_port = 3260 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] log_color = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] log_config_append = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] log_dir = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86552]: INFO cinder.volume.manager [None req-3042da3b-3dea-4616-8aa5-558cd62af8e6 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 08 01:39:40 devstack cinder-volume[86552]: DEBUG cinder.volume.drivers.remotefs [None req-3042da3b-3dea-4616-8aa5-558cd62af8e6 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86552) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] log_file = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] log_options = True {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] log_rotate_interval = 1 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] log_rotate_interval_type = days {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] log_rotation_type = none {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] max_age = 0 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] max_logfile_count = 30 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] max_logfile_size_mb = 200 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] max_over_subscription_ratio = 20.0 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] message_reap_interval = 86400 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] message_ttl = 2592000 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] migration_create_volume_timeout_secs = 300 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] monkey_patch = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] monkey_patch_modules = [] {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] my_ip = 192.168.122.201 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] no_snapshot_gb_quota = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] num_iser_scan_tries = 3 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] num_shell_tries = 3 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] num_volume_device_scan_tries = 3 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] nvmeof_conn_info_version = 1 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] nvmet_ns_id = 10 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] nvmet_port_id = 1 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] osapi_max_limit = 1000 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] osapi_volume_ext_list = [] {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] osapi_volume_listen = 0.0.0.0 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] osapi_volume_listen_port = 8776 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] osapi_volume_use_ssl = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] osapi_volume_workers = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] per_volume_size_limit = -1 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] periodic_fuzzy_delay = 60 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] periodic_interval = 60 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] project_id_regex = [0-9a-f\-]+ {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] public_endpoint = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] publish_errors = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] quota_backup_gigabytes = 1000 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] quota_backups = 10 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] quota_gigabytes = 1000 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] quota_groups = 10 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] quota_snapshots = 10 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] quota_volumes = 10 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] rate_limit_burst = 0 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] rate_limit_except_level = CRITICAL {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] rate_limit_interval = 0 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] reinit_driver_count = 3 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] replication_device = **** {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] report_discard_supported = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] report_interval = 120 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] reservation_clean_interval = 86400 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] reservation_expire = 86400 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] reserved_image_namespaces = [] {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] reserved_percentage = 0 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] rpc_response_timeout = 120 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] run_external_periodic_tasks = True {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] scst_target_driver = iscsi {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] scst_target_iqn_name = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] service_down_time = 720 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] shell_completion = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] snapshot_name_template = snapshot-%s {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] split_loggers = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] state_path = /opt/stack/data/cinder {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] storage_availability_zone = nova {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] storage_protocol = iSCSI {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] syslog_log_facility = LOG_USER {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] target_helper = lioadm {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] target_ip_address = 192.168.122.201 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] target_port = 3260 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] target_protocol = iscsi {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] target_secondary_ip_addresses = [] {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] trace_flags = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] transfer_api_class = cinder.transfer.api.API {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] transport_url = **** {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] until_refresh = 0 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] use_chap_auth = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] use_default_quota_class = True {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] use_journal = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] use_json = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] use_multipath_for_image_xfer = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] use_stderr = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] use_syslog = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] verify_glance_signatures = enabled {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] volume_api_class = cinder.volume.api.API {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] volume_backend_name = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] volume_clear = zero {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] volume_clear_ionice = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] volume_clear_size = 0 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] volume_copy_bps_limit = 0 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] volume_dd_blocksize = 1M {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] volume_name_template = volume-%s {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] volume_service_inithost_offload = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] volume_usage_audit_period = month {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] zoning_mode = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] oslo_concurrency.disable_process_locking = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] keystone_authtoken.auth_section = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] keystone_authtoken.auth_type = password {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] keystone_authtoken.auth_version = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] keystone_authtoken.cache = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] keystone_authtoken.certfile = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] keystone_authtoken.delay_auth_decision = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] keystone_authtoken.http_connect_timeout = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] keystone_authtoken.include_service_catalog = True {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] keystone_authtoken.insecure = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] keystone_authtoken.interface = public {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] keystone_authtoken.keyfile = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] keystone_authtoken.memcache_password = {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] keystone_authtoken.memcache_username = {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] keystone_authtoken.region_name = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] keystone_authtoken.service_token_roles_required = True {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] keystone_authtoken.service_type = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] keystone_authtoken.token_cache_time = 300 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.201/identity {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] cache.backend = dogpile.cache.null {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] cache.backend_argument = **** {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] cache.backend_expiration_time = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] cache.config_prefix = cache.oslo {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] cache.debug_cache_backend = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] cache.enable_retry_client = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] cache.enable_socket_keepalive = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] cache.enabled = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] cache.expiration_time = 600 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] cache.hashclient_retry_attempts = 2 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] cache.memcache_dead_retry = 300 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] cache.memcache_pool_maxsize = 10 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] cache.memcache_sasl_enabled = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] cache.password = **** {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] cache.proxies = [] {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] cache.redis_db = 0 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] cache.redis_sentinel_service_name = mymaster {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] cache.redis_server = localhost:6379 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] cache.retry_attempts = 2 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] cache.retry_delay = 0.0 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] cache.socket_keepalive_count = 1 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] cache.socket_keepalive_idle = 1 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] cache.socket_keepalive_interval = 1 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] cache.socket_timeout = 1.0 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] cache.tls_allowed_ciphers = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] cache.tls_cafile = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] cache.tls_certfile = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86552]: DEBUG cinder.volume.drivers.quobyte [None req-3042da3b-3dea-4616-8aa5-558cd62af8e6 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86552) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] cache.tls_enabled = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] cache.tls_keyfile = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86552]: WARNING cinder.volume.drivers.quobyte [None req-3042da3b-3dea-4616-8aa5-558cd62af8e6 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 08 01:39:40 devstack cinder-volume[86552]: WARNING cinder.volume.drivers.quobyte [None req-3042da3b-3dea-4616-8aa5-558cd62af8e6 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] cache.username = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86552]: DEBUG oslo_concurrency.processutils [None req-3042da3b-3dea-4616-8aa5-558cd62af8e6 None None] Running cmd (subprocess): mount.quobyte {{(pid=86552) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] coordination.backend_url = **** {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] database.asyncio_connection = **** {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] database.asyncio_slave_connection = **** {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] database.backend = sqlalchemy {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] database.connection = **** {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] database.connection_debug = 0 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] database.connection_parameters = {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] database.connection_recycle_time = 3600 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] database.connection_trace = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] database.db_inc_retry_interval = True {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] database.db_max_retries = 20 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] database.db_max_retry_interval = 10 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] database.db_retry_interval = 1 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] database.max_overflow = 50 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] database.max_pool_size = 5 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] database.max_retries = 10 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] database.mysql_wsrep_sync_wait = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] database.pool_timeout = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] database.retry_interval = 10 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] database.slave_connection = **** {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] database.sqlite_synchronous = True {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] database.synchronous_reader = True {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] database.use_db_reconnect = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] profiler.connection_string = messaging:// {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] profiler.enabled = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] profiler.es_doc_type = notification {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] profiler.es_scroll_size = 10000 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] profiler.es_scroll_time = 2m {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] profiler.filter_error_trace = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] profiler.hmac_keys = **** {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] profiler.sentinel_service_name = mymaster {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] profiler.socket_timeout = 0.1 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] profiler.trace_requests = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] profiler.trace_sqlalchemy = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] profiler_jaeger.process_tags = {} {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] profiler_jaeger.service_name_prefix = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] profiler_otlp.service_name_prefix = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] oslo_policy.enforce_new_defaults = True {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] oslo_policy.enforce_scope = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] oslo_policy.policy_default_rule = default {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] oslo_policy.policy_file = policy.yaml {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:40 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] oslo_policy.remote_timeout = 60.0 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] privsep_osbrick.group = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] privsep_osbrick.helper_command = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] privsep_osbrick.user = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] cinder_sys_admin.group = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] cinder_sys_admin.helper_command = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] cinder_sys_admin.user = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] service_user.auth_section = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] service_user.auth_type = password {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] service_user.cafile = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] service_user.certfile = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] service_user.collect_timing = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] service_user.insecure = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] service_user.keyfile = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] service_user.send_service_user_token = True {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] service_user.split_loggers = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] service_user.timeout = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] glance.auth_section = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] glance.auth_type = password {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] glance.certfile = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] glance.collect_timing = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] glance.insecure = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] glance.keyfile = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] glance.region_name = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] glance.split_loggers = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] glance.timeout = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.backend_availability_zone = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.chap_password = **** {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.chap_username = {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.disk_geometry = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.driver_client_cert = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.driver_client_cert_key = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.driver_data_namespace = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.driver_use_ssl = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.enable_unsupported_driver = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.extra_capabilities = {} {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.filter_function = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.goodness_function = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.iscsi_target_flags = {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.iscsi_write_cache = on {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.iser_helper = tgtadm {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.iser_ip_address = 192.168.122.201 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.iser_port = 3260 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.nas_host = {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.nas_login = admin {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.nas_mount_options = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.nas_password = **** {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.nas_private_key = {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.nas_share_path = {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.nas_ssh_port = 22 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.num_shell_tries = 3 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.nvmet_port_id = 1 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.quobyte_client_cfg = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.quobyte_volume_url = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.replication_device = **** {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.report_discard_supported = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.reserved_percentage = 0 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.scst_target_driver = iscsi {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.scst_target_iqn_name = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.storage_protocol = iSCSI {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.target_helper = tgtadm {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.target_ip_address = 192.168.122.201 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.target_port = 3260 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.target_protocol = iscsi {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.trace_flags = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.unique_fqdn_network = True {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.use_chap_auth = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.volume_backend_name = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.volume_clear = zero {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.volume_clear_ionice = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.volume_clear_size = 0 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] oslo_reports.file_event_handler = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] oslo_reports.log_dir = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.backend_availability_zone = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.backend_host = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.chap_password = **** {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.chap_username = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.chiscsi_conf = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.disk_geometry = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.driver_client_cert = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.driver_client_cert_key = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.driver_data_namespace = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.driver_use_ssl = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.extra_capabilities = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.filter_function = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.goodness_function = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.iscsi_target_flags = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.iscsi_write_cache = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.iser_helper = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.iser_ip_address = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.iser_port = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.iser_target_prefix = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.nas_host = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.nas_login = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.nas_mount_options = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.nas_password = **** {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.nas_private_key = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.nas_share_path = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.nas_ssh_port = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.num_shell_tries = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.nvmet_ns_id = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.nvmet_port_id = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.replication_device = **** {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.report_discard_supported = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.reserved_percentage = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.scst_target_driver = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.storage_protocol = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.target_helper = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.target_ip_address = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.target_port = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.target_prefix = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.target_protocol = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.trace_flags = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.unique_fqdn_network = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.use_chap_auth = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.volume_clear = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.volume_clear_ionice = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.volume_clear_size = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] QuobyteHD.volumes_dir = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] oslo_messaging_rabbit.ssl = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] oslo_messaging_rabbit.ssl_version = {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] oslo_messaging_notifications.driver = [] {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] oslo_messaging_notifications.retry = -1 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] oslo_messaging_notifications.transport_url = **** {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] key_manager.fixed_key = **** {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] barbican.barbican_api_version = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] barbican.barbican_endpoint = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] barbican.barbican_endpoint_type = public {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] barbican.barbican_region_name = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] barbican.cafile = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] barbican.certfile = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] barbican.collect_timing = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] barbican.insecure = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] barbican.keyfile = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] barbican.number_of_retries = 60 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] barbican.retry_delay = 1 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] barbican.send_service_user_token = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] barbican.split_loggers = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] barbican.timeout = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] barbican.verify_ssl = True {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] barbican.verify_ssl_path = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] barbican_service_user.auth_section = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] barbican_service_user.auth_type = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] barbican_service_user.cafile = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] barbican_service_user.certfile = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] barbican_service_user.collect_timing = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] barbican_service_user.insecure = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] barbican_service_user.keyfile = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] barbican_service_user.split_loggers = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] barbican_service_user.timeout = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] vault.approle_role_id = **** {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack quobyte-client[86557]: Reading configuration file: /etc/quobyte/client.cfg Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] vault.approle_secret_id = **** {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] vault.kv_mountpoint = secret {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] vault.kv_path = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] vault.kv_version = 2 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] vault.namespace = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] vault.root_token_id = **** {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack quobyte-client[86557]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] vault.ssl_ca_crt_file = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] vault.timeout = 60.0 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] vault.use_ssl = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:39:41 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] ******************************************************************************** {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 08 01:39:41 devstack cinder-volume[86552]: DEBUG oslo_concurrency.processutils [None req-3042da3b-3dea-4616-8aa5-558cd62af8e6 None None] CMD "mount.quobyte" returned: 1 in 0.116s {{(pid=86552) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:41 devstack cinder-volume[86552]: DEBUG oslo_concurrency.lockutils [None req-3042da3b-3dea-4616-8aa5-558cd62af8e6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86552) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:39:41 devstack cinder-volume[86552]: DEBUG oslo_concurrency.lockutils [None req-3042da3b-3dea-4616-8aa5-558cd62af8e6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86552) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:39:41 devstack cinder-volume[86552]: DEBUG cinder.volume.drivers.quobyte [None req-3042da3b-3dea-4616-8aa5-558cd62af8e6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=86552) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:39:41 devstack cinder-volume[86552]: INFO cinder.volume.drivers.quobyte [None req-3042da3b-3dea-4616-8aa5-558cd62af8e6 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 ... Jul 08 01:39:41 devstack cinder-volume[86552]: DEBUG oslo_concurrency.processutils [None req-3042da3b-3dea-4616-8aa5-558cd62af8e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 -c /etc/quobyte/client-cinder.cfg {{(pid=86552) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:41 devstack sudo[86558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 -c /etc/quobyte/client-cinder.cfg Jul 08 01:39:41 devstack sudo[86558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:41 devstack sudo[86558]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:41 devstack cinder-volume[86552]: DEBUG oslo_concurrency.processutils [None req-3042da3b-3dea-4616-8aa5-558cd62af8e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.805s {{(pid=86552) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:41 devstack cinder-volume[86552]: INFO cinder.volume.drivers.quobyte [None req-3042da3b-3dea-4616-8aa5-558cd62af8e6 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 succeeded Jul 08 01:39:41 devstack cinder-volume[86552]: DEBUG cinder.volume.drivers.quobyte [None req-3042da3b-3dea-4616-8aa5-558cd62af8e6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=86552) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:39:41 devstack cinder-volume[86552]: DEBUG oslo_concurrency.lockutils [None req-3042da3b-3dea-4616-8aa5-558cd62af8e6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.818s {{(pid=86552) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:39:41 devstack cinder-volume[86552]: DEBUG oslo_concurrency.processutils [None req-3042da3b-3dea-4616-8aa5-558cd62af8e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=86552) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:41 devstack sudo[86628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:39:41 devstack sudo[86628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:42 devstack sudo[86628]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:42 devstack cinder-volume[86552]: DEBUG oslo_concurrency.processutils [None req-3042da3b-3dea-4616-8aa5-558cd62af8e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.627s {{(pid=86552) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:42 devstack cinder-volume[86552]: INFO cinder.volume.driver [None req-3042da3b-3dea-4616-8aa5-558cd62af8e6 None None] Driver hasn't implemented _init_vendor_properties() Jul 08 01:39:42 devstack cinder-volume[86552]: DEBUG cinder.volume.driver [None req-3042da3b-3dea-4616-8aa5-558cd62af8e6 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6598472595215, 'free_capacity_gb': 1775.6598472595215, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86552) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 08 01:39:42 devstack cinder-volume[86552]: DEBUG oslo_db.sqlalchemy.engines [None req-3042da3b-3dea-4616-8aa5-558cd62af8e6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86552) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 01:39:42 devstack cinder-volume[86552]: DEBUG dbcounter [-] [86552] Writer thread running {{(pid=86552) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 01:39:42 devstack cinder-volume[86552]: DEBUG cinder.db.api [None req-3042da3b-3dea-4616-8aa5-558cd62af8e6 None None] Building query based on filter {{(pid=86552) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 08 01:39:42 devstack cinder-volume[86552]: DEBUG cinder.image.image_utils [None req-3042da3b-3dea-4616-8aa5-558cd62af8e6 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86552) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 08 01:39:42 devstack cinder-volume[86552]: INFO cinder.keymgr.migration [None req-cc84bb2a-9978-4f3c-99f3-1eb2591c90b7 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 08 01:39:42 devstack cinder-volume[86552]: DEBUG oslo_concurrency.lockutils [None req-3042da3b-3dea-4616-8aa5-558cd62af8e6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86552) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:39:42 devstack cinder-volume[86552]: DEBUG oslo_concurrency.lockutils [None req-3042da3b-3dea-4616-8aa5-558cd62af8e6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86552) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:39:42 devstack cinder-volume[86552]: DEBUG cinder.volume.drivers.quobyte [None req-3042da3b-3dea-4616-8aa5-558cd62af8e6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=86552) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:39:42 devstack cinder-volume[86552]: DEBUG cinder.volume.drivers.quobyte [None req-3042da3b-3dea-4616-8aa5-558cd62af8e6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=86552) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:39:42 devstack cinder-volume[86552]: DEBUG oslo_concurrency.lockutils [None req-3042da3b-3dea-4616-8aa5-558cd62af8e6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86552) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:39:42 devstack cinder-volume[86552]: DEBUG oslo_concurrency.processutils [None req-3042da3b-3dea-4616-8aa5-558cd62af8e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=86552) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:42 devstack sudo[86631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:39:42 devstack sudo[86631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:43 devstack sudo[86631]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:43 devstack cinder-volume[86552]: DEBUG oslo_concurrency.processutils [None req-3042da3b-3dea-4616-8aa5-558cd62af8e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.669s {{(pid=86552) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:43 devstack cinder-volume[86552]: DEBUG cinder.manager [None req-3042da3b-3dea-4616-8aa5-558cd62af8e6 None None] Notifying Schedulers of capabilities ... {{(pid=86552) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:39:43 devstack cinder-volume[86552]: INFO cinder.volume.manager [None req-3042da3b-3dea-4616-8aa5-558cd62af8e6 None None] Driver initialization completed successfully. Jul 08 01:39:43 devstack cinder-volume[86552]: INFO cinder.manager [None req-3042da3b-3dea-4616-8aa5-558cd62af8e6 None None] Initiating service 3 cleanup Jul 08 01:39:43 devstack cinder-volume[86552]: INFO cinder.manager [None req-3042da3b-3dea-4616-8aa5-558cd62af8e6 None None] Service 3 cleanup completed. Jul 08 01:39:43 devstack cinder-volume[86552]: DEBUG cinder.service [None req-3042da3b-3dea-4616-8aa5-558cd62af8e6 None None] Creating RPC server for service cinder-volume {{(pid=86552) start /opt/stack/cinder/cinder/service.py:231}} Jul 08 01:39:43 devstack cinder-volume[86552]: DEBUG cinder.service [None req-3042da3b-3dea-4616-8aa5-558cd62af8e6 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86552) start /opt/stack/cinder/cinder/service.py:237}} Jul 08 01:39:43 devstack cinder-volume[86552]: INFO cinder.volume.manager [None req-3042da3b-3dea-4616-8aa5-558cd62af8e6 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 08 01:39:43 devstack cinder-volume[86552]: DEBUG oslo_concurrency.lockutils [None req-3042da3b-3dea-4616-8aa5-558cd62af8e6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86552) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:39:43 devstack cinder-volume[86552]: DEBUG oslo_concurrency.lockutils [None req-3042da3b-3dea-4616-8aa5-558cd62af8e6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86552) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:39:43 devstack cinder-volume[86552]: DEBUG cinder.volume.drivers.quobyte [None req-3042da3b-3dea-4616-8aa5-558cd62af8e6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=86552) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:39:43 devstack cinder-volume[86552]: DEBUG cinder.volume.drivers.quobyte [None req-3042da3b-3dea-4616-8aa5-558cd62af8e6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=86552) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:39:43 devstack cinder-volume[86552]: DEBUG oslo_concurrency.lockutils [None req-3042da3b-3dea-4616-8aa5-558cd62af8e6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86552) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:39:43 devstack cinder-volume[86552]: DEBUG oslo_concurrency.processutils [None req-3042da3b-3dea-4616-8aa5-558cd62af8e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=86552) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:43 devstack sudo[86639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:39:43 devstack sudo[86639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:44 devstack sudo[86639]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:44 devstack cinder-volume[86552]: DEBUG oslo_concurrency.processutils [None req-3042da3b-3dea-4616-8aa5-558cd62af8e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.825s {{(pid=86552) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:44 devstack cinder-volume[86552]: INFO cinder.volume.manager [None req-3042da3b-3dea-4616-8aa5-558cd62af8e6 None None] Driver post RPC initialization completed successfully. Jul 08 01:39:48 devstack cinder-volume[86552]: DEBUG oslo_concurrency.lockutils [None req-57349cd0-f84b-4fda-a023-5f4cd12319ea None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86552) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:39:48 devstack cinder-volume[86552]: DEBUG oslo_concurrency.lockutils [None req-57349cd0-f84b-4fda-a023-5f4cd12319ea None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86552) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:39:48 devstack cinder-volume[86552]: DEBUG cinder.volume.drivers.quobyte [None req-57349cd0-f84b-4fda-a023-5f4cd12319ea None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=86552) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:39:48 devstack cinder-volume[86552]: DEBUG cinder.volume.drivers.quobyte [None req-57349cd0-f84b-4fda-a023-5f4cd12319ea None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=86552) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:39:48 devstack cinder-volume[86552]: DEBUG oslo_concurrency.lockutils [None req-57349cd0-f84b-4fda-a023-5f4cd12319ea None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86552) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:39:48 devstack cinder-volume[86552]: DEBUG oslo_concurrency.processutils [None req-57349cd0-f84b-4fda-a023-5f4cd12319ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=86552) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:39:48 devstack sudo[86752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:39:48 devstack sudo[86752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:39:48 devstack sudo[86752]: pam_unix(sudo:session): session closed for user root Jul 08 01:39:48 devstack cinder-volume[86552]: DEBUG oslo_concurrency.processutils [None req-57349cd0-f84b-4fda-a023-5f4cd12319ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.639s {{(pid=86552) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:39:48 devstack cinder-volume[86552]: DEBUG cinder.manager [None req-57349cd0-f84b-4fda-a023-5f4cd12319ea None None] Notifying Schedulers of capabilities ... {{(pid=86552) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:39:50 devstack cinder-volume[86339]: DEBUG dbcounter [-] [86339] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86339) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:39:51 devstack cinder-volume[86339]: INFO oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] Caught SIGTERM, stopping children Jul 08 01:39:51 devstack cinder-volume[86339]: DEBUG oslo_concurrency.lockutils [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] Acquiring lock "singleton_lock" {{(pid=86339) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 01:39:51 devstack cinder-volume[86339]: DEBUG oslo_concurrency.lockutils [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] Acquired lock "singleton_lock" {{(pid=86339) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 01:39:51 devstack cinder-volume[86339]: DEBUG oslo_concurrency.lockutils [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] Releasing lock "singleton_lock" {{(pid=86339) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 01:39:51 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] Stop services. {{(pid=86339) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 08 01:39:51 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] Killing children. {{(pid=86339) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 08 01:39:51 devstack cinder-volume[86339]: INFO oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] Waiting on 1 children to exit Jul 08 01:39:54 devstack cinder-volume[86552]: DEBUG dbcounter [-] [86552] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86552) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:39:54 devstack cinder-volume[86552]: DEBUG dbcounter [-] [86552] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=86552) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:39:56 devstack cinder-volume[86552]: DEBUG oslo_concurrency.lockutils [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] Acquiring lock "singleton_lock" {{(pid=86552) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 01:39:56 devstack cinder-volume[86552]: DEBUG oslo_concurrency.lockutils [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] Acquired lock "singleton_lock" {{(pid=86552) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 01:39:56 devstack cinder-volume[86552]: DEBUG oslo_concurrency.lockutils [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] Releasing lock "singleton_lock" {{(pid=86552) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 01:39:56 devstack cinder-volume[86552]: WARNING amqp [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 08 01:39:56 devstack cinder-volume[86552]: WARNING amqp [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 08 01:39:56 devstack cinder-volume[86339]: INFO oslo_service.backend._eventlet.service [None req-a6e9f9e1-8ab2-40c6-bc46-8164b772edfe None None] Child 86552 exited with status 0 Jul 08 01:39:57 devstack cinder-volume[86843]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 08 01:39:57 devstack cinder-volume[86843]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 01:39:57 devstack cinder-volume[86843]: we strongly recommend against using it for new projects. Jul 08 01:39:57 devstack cinder-volume[86843]: If you are already using Eventlet, we recommend migrating to a different Jul 08 01:39:57 devstack cinder-volume[86843]: framework. For more detail see Jul 08 01:39:57 devstack cinder-volume[86843]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 01:39:57 devstack cinder-volume[86843]: import eventlet # noqa Jul 08 01:39:59 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86843) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 01:39:59 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86843) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 01:39:59 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86843) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 01:40:00 devstack cinder-volume[86843]: INFO dbcounter [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] Registered counter for database cinder Jul 08 01:40:00 devstack cinder-volume[86843]: DEBUG oslo_db.sqlalchemy.engines [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86843) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG dbcounter [-] [86843] Writer thread running {{(pid=86843) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 01:40:01 devstack cinder-volume[86843]: INFO cinder.rpc [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 08 01:40:01 devstack cinder-volume[86843]: INFO cinder.rpc [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_db.sqlalchemy.engines [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86843) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 01:40:01 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] Determined volume DB was empty at startup. Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86843) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 08 01:40:01 devstack cinder-volume[86843]: WARNING stevedore.named [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 08 01:40:01 devstack cinder-volume[86843]: WARNING castellan.key_manager [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 01:40:01 devstack cinder-volume[86843]: WARNING cinder.keymgr.conf_key_mgr [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 01:40:01 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_db.sqlalchemy.engines [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86843) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 01:40:01 devstack cinder-volume[86843]: INFO oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] Starting 1 workers Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] Started child 87134 {{(pid=86843) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] Full set of CONF: {{(pid=86843) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] ******************************************************************************** {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] Configuration options gathered from: {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] ================================================================================ {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] allow_availability_zone_fallback = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] allow_compression_on_image_upload = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] allowed_direct_url_schemes = [] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] api_rate_limit = True {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] auth_strategy = keystone {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_availability_zone = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[87134]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_host = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_name = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_stats_polling_interval = 60 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backup_api_class = cinder.backup.api.API {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backup_name_template = backup-%s {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backup_use_same_host = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backup_use_temp_snapshot = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] chap_password = **** {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] chap_username = {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] cinder_internal_tenant_project_id = 2bb3aed651824ff888b8ba942dc19cf3 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] cinder_internal_tenant_user_id = c31bcf0afa484bbab22023312d764f8d {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] cluster = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] compression_format = gzip {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] compute_api_class = cinder.compute.nova.API {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] config_dir = [] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] config_source = [] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] control_exchange = openstack {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] debug = True {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] default_availability_zone = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] default_group_type = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] default_volume_type = QuobyteHD {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] disk_geometry = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] driver_client_cert = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] driver_client_cert_key = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] driver_data_namespace = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] driver_ssl_cert_path = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] driver_ssl_cert_verify = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] driver_use_ssl = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] enable_new_services = True {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] enable_unsupported_driver = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] enabled_backends = ['QuobyteHD'] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] enforce_multipath_for_image_xfer = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] filter_function = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] glance_api_insecure = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] glance_api_servers = ['http://192.168.122.201/image'] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] glance_api_ssl_compression = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] glance_ca_certificates_file = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] glance_catalog_info = image:glance:publicURL {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] glance_certfile = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] glance_keyfile = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] glance_num_retries = 3 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] glance_request_timeout = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] goodness_function = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] graceful_shutdown_timeout = 5 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] group_api_class = cinder.group.api.API {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] host = devstack {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] image_compress_on_upload = True {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] image_conversion_address_space_limit = 1 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] image_conversion_cpu_limit = 60 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] image_conversion_disable = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] image_upload_use_cinder_backend = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] image_upload_use_internal_tenant = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] image_volume_cache_enabled = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] image_volume_cache_max_count = 0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] image_volume_cache_max_size_gb = 0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] init_host_max_objects_retrieval = 0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] instance_format = [instance: %(uuid)s] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] iscsi_target_flags = {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] iscsi_write_cache = on {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] iser_helper = tgtadm {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] iser_ip_address = 192.168.122.201 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] iser_port = 3260 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] log_color = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] log_config_append = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] log_dir = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] log_file = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] log_options = True {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] log_rotate_interval = 1 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] log_rotate_interval_type = days {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] log_rotation_type = none {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] max_age = 0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] max_logfile_count = 30 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] max_logfile_size_mb = 200 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] max_over_subscription_ratio = 20.0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] message_reap_interval = 86400 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] message_ttl = 2592000 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] migration_create_volume_timeout_secs = 300 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] monkey_patch = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] monkey_patch_modules = [] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-7bc191e8-096c-48ee-9ecb-ee98a2b772a2 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] my_ip = 192.168.122.201 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] no_snapshot_gb_quota = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] num_iser_scan_tries = 3 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] num_shell_tries = 3 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] num_volume_device_scan_tries = 3 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] nvmeof_conn_info_version = 1 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] nvmet_ns_id = 10 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] nvmet_port_id = 1 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] osapi_max_limit = 1000 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] osapi_volume_ext_list = [] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] osapi_volume_listen_port = 8776 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-7bc191e8-096c-48ee-9ecb-ee98a2b772a2 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87134) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] osapi_volume_use_ssl = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] osapi_volume_workers = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] per_volume_size_limit = -1 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] periodic_fuzzy_delay = 60 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] periodic_interval = 60 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] public_endpoint = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] publish_errors = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] quota_backup_gigabytes = 1000 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] quota_backups = 10 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] quota_gigabytes = 1000 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] quota_groups = 10 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] quota_snapshots = 10 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] quota_volumes = 10 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] rate_limit_burst = 0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] rate_limit_except_level = CRITICAL {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] rate_limit_interval = 0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] reinit_driver_count = 3 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] replication_device = **** {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] report_discard_supported = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] report_interval = 120 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] reservation_clean_interval = 86400 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] reservation_expire = 86400 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] reserved_image_namespaces = [] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] reserved_percentage = 0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] rpc_response_timeout = 120 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] run_external_periodic_tasks = True {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] scst_target_driver = iscsi {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] scst_target_iqn_name = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] service_down_time = 720 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] shell_completion = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] snapshot_name_template = snapshot-%s {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] split_loggers = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] state_path = /opt/stack/data/cinder {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] storage_availability_zone = nova {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] storage_protocol = iSCSI {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] syslog_log_facility = LOG_USER {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] target_helper = lioadm {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] target_ip_address = 192.168.122.201 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] target_port = 3260 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] target_protocol = iscsi {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] target_secondary_ip_addresses = [] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] trace_flags = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] transport_url = **** {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] until_refresh = 0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] use_chap_auth = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] use_default_quota_class = True {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] use_journal = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] use_json = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] use_multipath_for_image_xfer = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] use_stderr = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] use_syslog = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] verify_glance_signatures = enabled {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] volume_api_class = cinder.volume.api.API {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] volume_backend_name = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] volume_clear = zero {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] volume_clear_ionice = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] volume_clear_size = 0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] volume_copy_bps_limit = 0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] volume_dd_blocksize = 1M {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] volume_name_template = volume-%s {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] volume_service_inithost_offload = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] volume_usage_audit_period = month {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] zoning_mode = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] oslo_concurrency.disable_process_locking = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] keystone_authtoken.auth_section = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] keystone_authtoken.auth_type = password {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] keystone_authtoken.auth_version = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] keystone_authtoken.cache = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] keystone_authtoken.certfile = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] keystone_authtoken.include_service_catalog = True {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] keystone_authtoken.insecure = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] keystone_authtoken.interface = public {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] keystone_authtoken.keyfile = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] keystone_authtoken.memcache_password = {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] keystone_authtoken.memcache_username = {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] keystone_authtoken.region_name = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] keystone_authtoken.service_type = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.201/identity {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] cache.backend = dogpile.cache.null {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] cache.backend_argument = **** {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] cache.backend_expiration_time = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] cache.config_prefix = cache.oslo {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] cache.debug_cache_backend = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] cache.enable_retry_client = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] cache.enable_socket_keepalive = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] cache.enabled = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] cache.expiration_time = 600 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] cache.hashclient_retry_attempts = 2 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] cache.memcache_dead_retry = 300 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] cache.memcache_pool_maxsize = 10 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] cache.memcache_sasl_enabled = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] cache.password = **** {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] cache.proxies = [] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] cache.redis_db = 0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] cache.redis_server = localhost:6379 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] cache.retry_attempts = 2 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] cache.retry_delay = 0.0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] cache.socket_keepalive_count = 1 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] cache.socket_keepalive_idle = 1 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] cache.socket_keepalive_interval = 1 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] cache.socket_timeout = 1.0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] cache.tls_allowed_ciphers = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] cache.tls_cafile = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] cache.tls_certfile = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] cache.tls_enabled = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] cache.tls_keyfile = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] cache.username = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] coordination.backend_url = **** {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] database.asyncio_connection = **** {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] database.asyncio_slave_connection = **** {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] database.backend = sqlalchemy {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] database.connection = **** {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] database.connection_debug = 0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] database.connection_parameters = {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] database.connection_recycle_time = 3600 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] database.connection_trace = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] database.db_inc_retry_interval = True {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] database.db_max_retries = 20 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] database.db_max_retry_interval = 10 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] database.db_retry_interval = 1 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-7bc191e8-096c-48ee-9ecb-ee98a2b772a2 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87134) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 08 01:40:01 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.quobyte [None req-7bc191e8-096c-48ee-9ecb-ee98a2b772a2 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 08 01:40:01 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.quobyte [None req-7bc191e8-096c-48ee-9ecb-ee98a2b772a2 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] database.max_overflow = 50 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] database.max_pool_size = 5 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] database.max_retries = 10 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7bc191e8-096c-48ee-9ecb-ee98a2b772a2 None None] Running cmd (subprocess): mount.quobyte {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] database.mysql_wsrep_sync_wait = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] database.pool_timeout = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] database.retry_interval = 10 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] database.slave_connection = **** {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] database.sqlite_synchronous = True {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] database.synchronous_reader = True {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] database.use_db_reconnect = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] profiler.connection_string = messaging:// {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] profiler.enabled = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] profiler.es_doc_type = notification {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] profiler.es_scroll_size = 10000 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] profiler.es_scroll_time = 2m {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] profiler.filter_error_trace = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] profiler.hmac_keys = **** {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] profiler.sentinel_service_name = mymaster {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] profiler.socket_timeout = 0.1 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] profiler.trace_requests = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] profiler.trace_sqlalchemy = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] profiler_jaeger.process_tags = {} {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] profiler_jaeger.service_name_prefix = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] profiler_otlp.service_name_prefix = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] oslo_policy.enforce_new_defaults = True {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] oslo_policy.enforce_scope = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] oslo_policy.policy_default_rule = default {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] oslo_policy.policy_file = policy.yaml {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] privsep_osbrick.group = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] privsep_osbrick.helper_command = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] privsep_osbrick.user = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] cinder_sys_admin.group = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] cinder_sys_admin.helper_command = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] cinder_sys_admin.user = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] service_user.auth_section = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] service_user.auth_type = password {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] service_user.cafile = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] service_user.certfile = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] service_user.collect_timing = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] service_user.insecure = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] service_user.keyfile = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] service_user.send_service_user_token = True {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] service_user.split_loggers = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] service_user.timeout = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] glance.auth_section = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] glance.auth_type = password {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] glance.certfile = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] glance.collect_timing = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] glance.insecure = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] glance.keyfile = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] glance.region_name = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] glance.split_loggers = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] glance.timeout = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.backend_availability_zone = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.chap_password = **** {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.chap_username = {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.disk_geometry = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.driver_client_cert = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.driver_client_cert_key = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.driver_data_namespace = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.driver_use_ssl = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.extra_capabilities = {} {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.filter_function = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.goodness_function = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.iscsi_target_flags = {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.iscsi_write_cache = on {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.iser_helper = tgtadm {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.iser_ip_address = 192.168.122.201 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.iser_port = 3260 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.nas_host = {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.nas_login = admin {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.nas_mount_options = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.nas_password = **** {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.nas_private_key = {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.nas_share_path = {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.num_shell_tries = 3 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.quobyte_volume_url = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.replication_device = **** {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.report_discard_supported = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.reserved_percentage = 0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.target_helper = tgtadm {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.target_ip_address = 192.168.122.201 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack quobyte-client[87146]: Reading configuration file: /etc/quobyte/client.cfg Jul 08 01:40:01 devstack quobyte-client[87146]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.target_port = 3260 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.target_protocol = iscsi {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7bc191e8-096c-48ee-9ecb-ee98a2b772a2 None None] CMD "mount.quobyte" returned: 1 in 0.087s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7bc191e8-096c-48ee-9ecb-ee98a2b772a2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.trace_flags = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7bc191e8-096c-48ee-9ecb-ee98a2b772a2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.unique_fqdn_network = True {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-7bc191e8-096c-48ee-9ecb-ee98a2b772a2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.use_chap_auth = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.volume_backend_name = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.volume_clear = zero {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.volume_clear_ionice = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.volume_clear_size = 0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] oslo_reports.file_event_handler = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] oslo_reports.log_dir = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.backend_availability_zone = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.backend_host = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.chap_password = **** {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-7bc191e8-096c-48ee-9ecb-ee98a2b772a2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:40:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7bc191e8-096c-48ee-9ecb-ee98a2b772a2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:40:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7bc191e8-096c-48ee-9ecb-ee98a2b772a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.chap_username = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.chiscsi_conf = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.disk_geometry = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.driver_client_cert = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.driver_data_namespace = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.driver_use_ssl = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.extra_capabilities = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.filter_function = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.goodness_function = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.iser_helper = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.iser_ip_address = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.iser_port = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.iser_target_prefix = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.nas_host = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.nas_login = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.nas_mount_options = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.nas_password = **** {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.nas_private_key = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack sudo[87147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.nas_share_path = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.nas_ssh_port = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack sudo[87147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.num_shell_tries = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.nvmet_port_id = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.replication_device = **** {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.report_discard_supported = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.reserved_percentage = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.scst_target_driver = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.storage_protocol = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.target_helper = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.target_ip_address = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.target_port = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.target_prefix = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.target_protocol = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.trace_flags = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.use_chap_auth = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.volume_clear = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.volume_clear_size = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] QuobyteHD.volumes_dir = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] oslo_messaging_rabbit.ssl = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] oslo_messaging_notifications.driver = [] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] oslo_messaging_notifications.retry = -1 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] key_manager.fixed_key = **** {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] barbican.barbican_api_version = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] barbican.barbican_endpoint = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] barbican.barbican_endpoint_type = public {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] barbican.barbican_region_name = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] barbican.cafile = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] barbican.certfile = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] barbican.collect_timing = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] barbican.insecure = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] barbican.keyfile = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] barbican.number_of_retries = 60 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] barbican.retry_delay = 1 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] barbican.send_service_user_token = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] barbican.split_loggers = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] barbican.timeout = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] barbican.verify_ssl = True {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] barbican.verify_ssl_path = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] barbican_service_user.auth_section = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] barbican_service_user.auth_type = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] barbican_service_user.cafile = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] barbican_service_user.certfile = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] barbican_service_user.collect_timing = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] barbican_service_user.insecure = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] barbican_service_user.keyfile = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] barbican_service_user.split_loggers = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] barbican_service_user.timeout = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] vault.approle_role_id = **** {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] vault.approle_secret_id = **** {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] vault.kv_mountpoint = secret {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] vault.kv_path = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] vault.kv_version = 2 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] vault.namespace = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] vault.root_token_id = **** {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] vault.ssl_ca_crt_file = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] vault.timeout = 60.0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] vault.use_ssl = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 01:40:01 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-a472a4e5-5ceb-46ef-8aa2-f3168b6bcdc2 None None] ******************************************************************************** {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 08 01:40:02 devstack sudo[87147]: pam_unix(sudo:session): session closed for user root Jul 08 01:40:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7bc191e8-096c-48ee-9ecb-ee98a2b772a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.683s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:40:02 devstack cinder-volume[87134]: INFO cinder.volume.driver [None req-7bc191e8-096c-48ee-9ecb-ee98a2b772a2 None None] Driver hasn't implemented _init_vendor_properties() Jul 08 01:40:02 devstack cinder-volume[87134]: DEBUG cinder.volume.driver [None req-7bc191e8-096c-48ee-9ecb-ee98a2b772a2 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6598472595215, 'free_capacity_gb': 1775.6598472595215, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87134) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 08 01:40:02 devstack cinder-volume[87134]: DEBUG oslo_db.sqlalchemy.engines [None req-7bc191e8-096c-48ee-9ecb-ee98a2b772a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87134) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 01:40:02 devstack cinder-volume[87134]: DEBUG dbcounter [-] [87134] Writer thread running {{(pid=87134) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 01:40:02 devstack cinder-volume[87134]: DEBUG cinder.db.api [None req-7bc191e8-096c-48ee-9ecb-ee98a2b772a2 None None] Building query based on filter {{(pid=87134) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 08 01:40:02 devstack cinder-volume[87134]: DEBUG cinder.image.image_utils [None req-7bc191e8-096c-48ee-9ecb-ee98a2b772a2 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87134) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 08 01:40:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7bc191e8-096c-48ee-9ecb-ee98a2b772a2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:40:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7bc191e8-096c-48ee-9ecb-ee98a2b772a2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:40:02 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-7bc191e8-096c-48ee-9ecb-ee98a2b772a2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:40:02 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-7bc191e8-096c-48ee-9ecb-ee98a2b772a2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:40:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7bc191e8-096c-48ee-9ecb-ee98a2b772a2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:40:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7bc191e8-096c-48ee-9ecb-ee98a2b772a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:40:02 devstack cinder-volume[87134]: INFO cinder.keymgr.migration [None req-5b03bac4-7bd4-4fef-b000-53ea4e0eb18a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 08 01:40:02 devstack sudo[87193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:40:02 devstack sudo[87193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:40:03 devstack sudo[87193]: pam_unix(sudo:session): session closed for user root Jul 08 01:40:03 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7bc191e8-096c-48ee-9ecb-ee98a2b772a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.641s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:40:03 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-7bc191e8-096c-48ee-9ecb-ee98a2b772a2 None None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:40:03 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-7bc191e8-096c-48ee-9ecb-ee98a2b772a2 None None] Driver initialization completed successfully. Jul 08 01:40:03 devstack cinder-volume[87134]: INFO cinder.manager [None req-7bc191e8-096c-48ee-9ecb-ee98a2b772a2 None None] Initiating service 3 cleanup Jul 08 01:40:03 devstack cinder-volume[87134]: INFO cinder.manager [None req-7bc191e8-096c-48ee-9ecb-ee98a2b772a2 None None] Service 3 cleanup completed. Jul 08 01:40:03 devstack cinder-volume[87134]: DEBUG cinder.service [None req-7bc191e8-096c-48ee-9ecb-ee98a2b772a2 None None] Creating RPC server for service cinder-volume {{(pid=87134) start /opt/stack/cinder/cinder/service.py:231}} Jul 08 01:40:03 devstack cinder-volume[87134]: DEBUG cinder.service [None req-7bc191e8-096c-48ee-9ecb-ee98a2b772a2 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87134) start /opt/stack/cinder/cinder/service.py:237}} Jul 08 01:40:03 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-7bc191e8-096c-48ee-9ecb-ee98a2b772a2 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 08 01:40:03 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7bc191e8-096c-48ee-9ecb-ee98a2b772a2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:40:03 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7bc191e8-096c-48ee-9ecb-ee98a2b772a2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:40:03 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-7bc191e8-096c-48ee-9ecb-ee98a2b772a2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:40:03 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-7bc191e8-096c-48ee-9ecb-ee98a2b772a2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:40:03 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7bc191e8-096c-48ee-9ecb-ee98a2b772a2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:40:03 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7bc191e8-096c-48ee-9ecb-ee98a2b772a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:40:03 devstack sudo[87214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:40:03 devstack sudo[87214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:40:03 devstack sudo[87214]: pam_unix(sudo:session): session closed for user root Jul 08 01:40:03 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7bc191e8-096c-48ee-9ecb-ee98a2b772a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.612s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:40:03 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-7bc191e8-096c-48ee-9ecb-ee98a2b772a2 None None] Driver post RPC initialization completed successfully. Jul 08 01:40:11 devstack cinder-volume[86843]: DEBUG dbcounter [-] [86843] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86843) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:40:13 devstack cinder-volume[87134]: DEBUG dbcounter [-] [87134] Writing DB stats cinder:SELECT=2 {{(pid=87134) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:40:13 devstack cinder-volume[87134]: DEBUG dbcounter [-] [87134] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87134) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:40:20 devstack cinder-volume[87134]: DEBUG oslo_service.periodic_task [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running periodic task VolumeManager._thread_info {{(pid=87134) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:40:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] thread count: 6 {{(pid=87134) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:40:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] thread info: [<_MainThread(MainThread, started 129378964615296)>, , , , , ] {{(pid=87134) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:41:14 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea927952-5cb6-44d7-a93d-c6e014f7c4ad tempest-DeleteServersTestJSON-686517226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:41:14 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ea927952-5cb6-44d7-a93d-c6e014f7c4ad tempest-DeleteServersTestJSON-686517226 None] Flow 'volume_create_manager' (601dd114-e428-4fdc-9d95-001bb18c5dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:41:14 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ea927952-5cb6-44d7-a93d-c6e014f7c4ad tempest-DeleteServersTestJSON-686517226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b57099f-0a12-4905-b041-99d6fa5e4db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:41:14 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ea927952-5cb6-44d7-a93d-c6e014f7c4ad tempest-DeleteServersTestJSON-686517226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b57099f-0a12-4905-b041-99d6fa5e4db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:41:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-972785313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f90bf96e-f08d-48fb-b28c-6c62e7ae0a8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d507353794c74d1692c29ac6102e1369',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:41:14Z,use_quota=True,user_id='ff972b3985d4410db2680ebf9740e910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:41:14 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ea927952-5cb6-44d7-a93d-c6e014f7c4ad tempest-DeleteServersTestJSON-686517226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3278c560-b25c-41f8-ab81-27f49b7756a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:41:14 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ea927952-5cb6-44d7-a93d-c6e014f7c4ad tempest-DeleteServersTestJSON-686517226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3278c560-b25c-41f8-ab81-27f49b7756a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:41:14 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ea927952-5cb6-44d7-a93d-c6e014f7c4ad tempest-DeleteServersTestJSON-686517226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d640410b-cc12-4f3b-9c6c-efa8f739c2d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:41:14 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ea927952-5cb6-44d7-a93d-c6e014f7c4ad tempest-DeleteServersTestJSON-686517226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d640410b-cc12-4f3b-9c6c-efa8f739c2d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f90bf96e-f08d-48fb-b28c-6c62e7ae0a8f', 'volume_name': 'volume-f90bf96e-f08d-48fb-b28c-6c62e7ae0a8f', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:41:14 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ea927952-5cb6-44d7-a93d-c6e014f7c4ad tempest-DeleteServersTestJSON-686517226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (073e4adc-f2cb-4960-b691-7389c5c7ce82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:41:14 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ea927952-5cb6-44d7-a93d-c6e014f7c4ad tempest-DeleteServersTestJSON-686517226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (073e4adc-f2cb-4960-b691-7389c5c7ce82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:41:14 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ea927952-5cb6-44d7-a93d-c6e014f7c4ad tempest-DeleteServersTestJSON-686517226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9b88392-8540-44dc-9b7c-6e821c9d29d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:41:14 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-ea927952-5cb6-44d7-a93d-c6e014f7c4ad tempest-DeleteServersTestJSON-686517226 None] Volume f90bf96e-f08d-48fb-b28c-6c62e7ae0a8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f90bf96e-f08d-48fb-b28c-6c62e7ae0a8f', 'volume_size': 1} Jul 08 01:41:14 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-ea927952-5cb6-44d7-a93d-c6e014f7c4ad tempest-DeleteServersTestJSON-686517226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:41:14 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-ea927952-5cb6-44d7-a93d-c6e014f7c4ad tempest-DeleteServersTestJSON-686517226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:41:14 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-ea927952-5cb6-44d7-a93d-c6e014f7c4ad tempest-DeleteServersTestJSON-686517226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:41:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-972785313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f90bf96e-f08d-48fb-b28c-6c62e7ae0a8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d507353794c74d1692c29ac6102e1369',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:41:14Z,use_quota=True,user_id='ff972b3985d4410db2680ebf9740e910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:41:14 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-ea927952-5cb6-44d7-a93d-c6e014f7c4ad tempest-DeleteServersTestJSON-686517226 None] Creating volume f90bf96e-f08d-48fb-b28c-6c62e7ae0a8f {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:41:14 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-ea927952-5cb6-44d7-a93d-c6e014f7c4ad tempest-DeleteServersTestJSON-686517226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:41:14 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-ea927952-5cb6-44d7-a93d-c6e014f7c4ad tempest-DeleteServersTestJSON-686517226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:41:14 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-ea927952-5cb6-44d7-a93d-c6e014f7c4ad tempest-DeleteServersTestJSON-686517226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:41:14 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-ea927952-5cb6-44d7-a93d-c6e014f7c4ad tempest-DeleteServersTestJSON-686517226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:41:14 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-ea927952-5cb6-44d7-a93d-c6e014f7c4ad tempest-DeleteServersTestJSON-686517226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:41:14 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-ea927952-5cb6-44d7-a93d-c6e014f7c4ad tempest-DeleteServersTestJSON-686517226 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:41:14 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-ea927952-5cb6-44d7-a93d-c6e014f7c4ad tempest-DeleteServersTestJSON-686517226 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:41:14 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ea927952-5cb6-44d7-a93d-c6e014f7c4ad tempest-DeleteServersTestJSON-686517226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f90bf96e-f08d-48fb-b28c-6c62e7ae0a8f 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:14 devstack sudo[87970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f90bf96e-f08d-48fb-b28c-6c62e7ae0a8f 1073741824 Jul 08 01:41:14 devstack sudo[87970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:16 devstack sudo[87970]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ea927952-5cb6-44d7-a93d-c6e014f7c4ad tempest-DeleteServersTestJSON-686517226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f90bf96e-f08d-48fb-b28c-6c62e7ae0a8f 1073741824" returned: 0 in 2.171s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ea927952-5cb6-44d7-a93d-c6e014f7c4ad tempest-DeleteServersTestJSON-686517226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f90bf96e-f08d-48fb-b28c-6c62e7ae0a8f {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:17 devstack sudo[88328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f90bf96e-f08d-48fb-b28c-6c62e7ae0a8f Jul 08 01:41:17 devstack sudo[88328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:18 devstack sudo[88328]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ea927952-5cb6-44d7-a93d-c6e014f7c4ad tempest-DeleteServersTestJSON-686517226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f90bf96e-f08d-48fb-b28c-6c62e7ae0a8f" returned: 0 in 1.357s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:18 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-ea927952-5cb6-44d7-a93d-c6e014f7c4ad tempest-DeleteServersTestJSON-686517226 None] <== create_volume: return (3640ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:41:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-ea927952-5cb6-44d7-a93d-c6e014f7c4ad tempest-DeleteServersTestJSON-686517226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.643s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:41:18 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ea927952-5cb6-44d7-a93d-c6e014f7c4ad tempest-DeleteServersTestJSON-686517226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9b88392-8540-44dc-9b7c-6e821c9d29d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f90bf96e-f08d-48fb-b28c-6c62e7ae0a8f', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:41:18 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ea927952-5cb6-44d7-a93d-c6e014f7c4ad tempest-DeleteServersTestJSON-686517226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54c1d19e-81f2-4f06-a518-ac653b345cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:41:18 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-ea927952-5cb6-44d7-a93d-c6e014f7c4ad tempest-DeleteServersTestJSON-686517226 None] Volume volume-f90bf96e-f08d-48fb-b28c-6c62e7ae0a8f (f90bf96e-f08d-48fb-b28c-6c62e7ae0a8f): created successfully Jul 08 01:41:18 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ea927952-5cb6-44d7-a93d-c6e014f7c4ad tempest-DeleteServersTestJSON-686517226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54c1d19e-81f2-4f06-a518-ac653b345cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:41:18 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ea927952-5cb6-44d7-a93d-c6e014f7c4ad tempest-DeleteServersTestJSON-686517226 None] Flow 'volume_create_manager' (601dd114-e428-4fdc-9d95-001bb18c5dfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:41:18 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-ea927952-5cb6-44d7-a93d-c6e014f7c4ad tempest-DeleteServersTestJSON-686517226 None] Created volume successfully. Jul 08 01:41:20 devstack cinder-volume[87134]: DEBUG oslo_service.periodic_task [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87134) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:41:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:41:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:41:20 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:41:20 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:41:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:41:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:20 devstack sudo[88402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:41:20 devstack sudo[88402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:21 devstack sudo[88402]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.717s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:21 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:41:21 devstack cinder-volume[87134]: DEBUG oslo_service.periodic_task [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running periodic task VolumeManager._thread_info {{(pid=87134) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:41:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] thread count: 6 {{(pid=87134) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:41:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] thread info: [<_MainThread(MainThread, started 129378964615296)>, , , , , ] {{(pid=87134) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:41:28 devstack cinder-volume[87134]: WARNING py.warnings [req-28db6aeb-94d5-4605-9b10-610df5319d8f req-98d367a8-8376-4ff8-9229-007b70720ade tempest-DeleteServersTestJSON-686517226 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Jul 08 01:41:28 devstack cinder-volume[87134]: .first() Jul 08 01:41:28 devstack cinder-volume[87134]: Jul 08 01:41:28 devstack cinder-volume[87134]: DEBUG dbcounter [-] [87134] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3 {{(pid=87134) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:41:28 devstack cinder-volume[87134]: DEBUG dbcounter [-] [87134] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87134) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:41:28 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-28db6aeb-94d5-4605-9b10-610df5319d8f req-98d367a8-8376-4ff8-9229-007b70720ade tempest-DeleteServersTestJSON-686517226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:41:28 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-28db6aeb-94d5-4605-9b10-610df5319d8f req-98d367a8-8376-4ff8-9229-007b70720ade tempest-DeleteServersTestJSON-686517226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:41:28 devstack cinder-volume[87134]: INFO oslo.privsep.daemon [req-28db6aeb-94d5-4605-9b10-610df5319d8f req-98d367a8-8376-4ff8-9229-007b70720ade tempest-DeleteServersTestJSON-686517226 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp5lludbey/privsep.sock'] Jul 08 01:41:28 devstack sudo[88443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp5lludbey/privsep.sock Jul 08 01:41:28 devstack sudo[88443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:29 devstack cinder-volume[87134]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 08 01:41:29 devstack cinder-volume[87134]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 01:41:29 devstack cinder-volume[87134]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 08 01:41:29 devstack cinder-volume[87134]: WARNING oslo.privsep.daemon [-] privsep log: Jul 08 01:41:29 devstack cinder-volume[87134]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 08 01:41:29 devstack cinder-volume[87134]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 08 01:41:29 devstack cinder-volume[87134]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 01:41:29 devstack cinder-volume[87134]: WARNING oslo.privsep.daemon [-] privsep log: Jul 08 01:41:29 devstack cinder-volume[87134]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 08 01:41:31 devstack cinder-volume[87134]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 08 01:41:31 devstack cinder-volume[87134]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 01:41:31 devstack cinder-volume[87134]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 08 01:41:31 devstack cinder-volume[87134]: WARNING oslo.privsep.daemon [-] privsep log: Jul 08 01:41:31 devstack cinder-volume[87134]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 08 01:41:31 devstack cinder-volume[87134]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 08 01:41:31 devstack cinder-volume[87134]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 01:41:31 devstack cinder-volume[87134]: WARNING oslo.privsep.daemon [-] privsep log: Jul 08 01:41:31 devstack cinder-volume[87134]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 08 01:41:32 devstack sudo[88443]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:32 devstack cinder-volume[87134]: INFO oslo.privsep.daemon [req-28db6aeb-94d5-4605-9b10-610df5319d8f req-98d367a8-8376-4ff8-9229-007b70720ade tempest-DeleteServersTestJSON-686517226 None] Spawned new privsep daemon via rootwrap Jul 08 01:41:32 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [req-28db6aeb-94d5-4605-9b10-610df5319d8f req-98d367a8-8376-4ff8-9229-007b70720ade tempest-DeleteServersTestJSON-686517226 None] Accepted privsep connection to /tmp/tmp5lludbey/privsep.sock {{(pid=87134) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 08 01:41:32 devstack cinder-volume[87134]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 08 01:41:32 devstack cinder-volume[87134]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 08 01:41:32 devstack cinder-volume[87134]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 08 01:41:32 devstack cinder-volume[87134]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88454 Jul 08 01:41:32 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc3a390d-ea60-412c-8b95-0688c6547f42]: (2,) {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:41:32 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc67f6b-7a72-4222-8c00-02e68ec09460]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:41:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-28db6aeb-94d5-4605-9b10-610df5319d8f req-98d367a8-8376-4ff8-9229-007b70720ade tempest-DeleteServersTestJSON-686517226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f90bf96e-f08d-48fb-b28c-6c62e7ae0a8f {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:32 devstack sudo[88456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f90bf96e-f08d-48fb-b28c-6c62e7ae0a8f Jul 08 01:41:32 devstack sudo[88456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:34 devstack sudo[88456]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-28db6aeb-94d5-4605-9b10-610df5319d8f req-98d367a8-8376-4ff8-9229-007b70720ade tempest-DeleteServersTestJSON-686517226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f90bf96e-f08d-48fb-b28c-6c62e7ae0a8f" returned: 0 in 1.442s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-28db6aeb-94d5-4605-9b10-610df5319d8f req-98d367a8-8376-4ff8-9229-007b70720ade tempest-DeleteServersTestJSON-686517226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 5.360s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:41:34 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [req-28db6aeb-94d5-4605-9b10-610df5319d8f req-98d367a8-8376-4ff8-9229-007b70720ade tempest-DeleteServersTestJSON-686517226 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17', 'name': 'volume-f90bf96e-f08d-48fb-b28c-6c62e7ae0a8f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2110f14f-4463-4a30-9820-b4acea111d8c', 'enforce_multipath': True} {{(pid=87134) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:41:34 devstack cinder-volume[87134]: INFO cinder.volume.manager [req-28db6aeb-94d5-4605-9b10-610df5319d8f req-98d367a8-8376-4ff8-9229-007b70720ade tempest-DeleteServersTestJSON-686517226 None] attachment_update completed successfully. Jul 08 01:41:44 devstack cinder-volume[87134]: DEBUG dbcounter [-] [87134] Writing DB stats cinder:SELECT=4 {{(pid=87134) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:41:44 devstack cinder-volume[87134]: DEBUG dbcounter [-] [87134] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=87134) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:41:44 devstack cinder-volume[87134]: INFO cinder.volume.manager [req-8114761a-8b7e-46ce-b808-a636f53dad10 req-ee7a7019-bc5c-4adc-93b6-0a76120adb6b tempest-DeleteServersTestJSON-686517226 None] Terminate volume connection completed successfully. Jul 08 01:41:44 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [req-8114761a-8b7e-46ce-b808-a636f53dad10 req-ee7a7019-bc5c-4adc-93b6-0a76120adb6b tempest-DeleteServersTestJSON-686517226 None] Deleting attachment 2110f14f-4463-4a30-9820-b4acea111d8c. {{(pid=87134) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:41:45 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-09af797b-74e7-4f46-8c15-624faa2a696c tempest-ServerRescueNegativeTestJSON-576927092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:41:45 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-09af797b-74e7-4f46-8c15-624faa2a696c tempest-ServerRescueNegativeTestJSON-576927092 None] Flow 'volume_create_manager' (3a8f7148-4289-424e-96c8-ae14137b2b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:41:45 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-09af797b-74e7-4f46-8c15-624faa2a696c tempest-ServerRescueNegativeTestJSON-576927092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50aed019-324d-488d-a5dc-2b853e133ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:41:45 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-09af797b-74e7-4f46-8c15-624faa2a696c tempest-ServerRescueNegativeTestJSON-576927092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50aed019-324d-488d-a5dc-2b853e133ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:41:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1301079633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bbba16c-7467-497c-a3db-831063566a4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='185845b4ea274725a06b88b7555a0351',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:41:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:41:46Z,use_quota=True,user_id='2355befb1b8e4085b229da6c82d428a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:41:45 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-09af797b-74e7-4f46-8c15-624faa2a696c tempest-ServerRescueNegativeTestJSON-576927092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9ba8371-af4c-435a-aad7-d64bb87e2fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:41:45 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-09af797b-74e7-4f46-8c15-624faa2a696c tempest-ServerRescueNegativeTestJSON-576927092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9ba8371-af4c-435a-aad7-d64bb87e2fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:41:45 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-09af797b-74e7-4f46-8c15-624faa2a696c tempest-ServerRescueNegativeTestJSON-576927092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6acbc4d9-9147-408c-b6a8-b461a0428e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:41:45 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-09af797b-74e7-4f46-8c15-624faa2a696c tempest-ServerRescueNegativeTestJSON-576927092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6acbc4d9-9147-408c-b6a8-b461a0428e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bbba16c-7467-497c-a3db-831063566a4b', 'volume_name': 'volume-0bbba16c-7467-497c-a3db-831063566a4b', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:41:45 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-09af797b-74e7-4f46-8c15-624faa2a696c tempest-ServerRescueNegativeTestJSON-576927092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9929523-6031-4bc1-9c1d-157a21bcaf90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:41:45 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-09af797b-74e7-4f46-8c15-624faa2a696c tempest-ServerRescueNegativeTestJSON-576927092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9929523-6031-4bc1-9c1d-157a21bcaf90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:41:45 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-09af797b-74e7-4f46-8c15-624faa2a696c tempest-ServerRescueNegativeTestJSON-576927092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fa10099-f6f7-4f60-a2ea-79b271cf9895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:41:45 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-09af797b-74e7-4f46-8c15-624faa2a696c tempest-ServerRescueNegativeTestJSON-576927092 None] Volume 0bbba16c-7467-497c-a3db-831063566a4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bbba16c-7467-497c-a3db-831063566a4b', 'volume_size': 1} Jul 08 01:41:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-09af797b-74e7-4f46-8c15-624faa2a696c tempest-ServerRescueNegativeTestJSON-576927092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:41:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-09af797b-74e7-4f46-8c15-624faa2a696c tempest-ServerRescueNegativeTestJSON-576927092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:41:45 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-09af797b-74e7-4f46-8c15-624faa2a696c tempest-ServerRescueNegativeTestJSON-576927092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:41:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1301079633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bbba16c-7467-497c-a3db-831063566a4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='185845b4ea274725a06b88b7555a0351',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:41:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:41:46Z,use_quota=True,user_id='2355befb1b8e4085b229da6c82d428a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:41:45 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-09af797b-74e7-4f46-8c15-624faa2a696c tempest-ServerRescueNegativeTestJSON-576927092 None] Creating volume 0bbba16c-7467-497c-a3db-831063566a4b {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:41:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-09af797b-74e7-4f46-8c15-624faa2a696c tempest-ServerRescueNegativeTestJSON-576927092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:41:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-09af797b-74e7-4f46-8c15-624faa2a696c tempest-ServerRescueNegativeTestJSON-576927092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:41:45 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-09af797b-74e7-4f46-8c15-624faa2a696c tempest-ServerRescueNegativeTestJSON-576927092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:41:45 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-09af797b-74e7-4f46-8c15-624faa2a696c tempest-ServerRescueNegativeTestJSON-576927092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:41:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-09af797b-74e7-4f46-8c15-624faa2a696c tempest-ServerRescueNegativeTestJSON-576927092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:41:45 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-09af797b-74e7-4f46-8c15-624faa2a696c tempest-ServerRescueNegativeTestJSON-576927092 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:41:45 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-09af797b-74e7-4f46-8c15-624faa2a696c tempest-ServerRescueNegativeTestJSON-576927092 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:41:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-09af797b-74e7-4f46-8c15-624faa2a696c tempest-ServerRescueNegativeTestJSON-576927092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0bbba16c-7467-497c-a3db-831063566a4b 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:45 devstack sudo[88969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0bbba16c-7467-497c-a3db-831063566a4b 1073741824 Jul 08 01:41:45 devstack sudo[88969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:47 devstack sudo[88969]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-09af797b-74e7-4f46-8c15-624faa2a696c tempest-ServerRescueNegativeTestJSON-576927092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0bbba16c-7467-497c-a3db-831063566a4b 1073741824" returned: 0 in 1.271s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-09af797b-74e7-4f46-8c15-624faa2a696c tempest-ServerRescueNegativeTestJSON-576927092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0bbba16c-7467-497c-a3db-831063566a4b {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:47 devstack sudo[88975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0bbba16c-7467-497c-a3db-831063566a4b Jul 08 01:41:47 devstack sudo[88975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:48 devstack sudo[88975]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-09af797b-74e7-4f46-8c15-624faa2a696c tempest-ServerRescueNegativeTestJSON-576927092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0bbba16c-7467-497c-a3db-831063566a4b" returned: 0 in 1.417s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:48 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-09af797b-74e7-4f46-8c15-624faa2a696c tempest-ServerRescueNegativeTestJSON-576927092 None] <== create_volume: return (2773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:41:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-09af797b-74e7-4f46-8c15-624faa2a696c tempest-ServerRescueNegativeTestJSON-576927092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.776s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:41:48 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-09af797b-74e7-4f46-8c15-624faa2a696c tempest-ServerRescueNegativeTestJSON-576927092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fa10099-f6f7-4f60-a2ea-79b271cf9895) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bbba16c-7467-497c-a3db-831063566a4b', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:41:48 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-09af797b-74e7-4f46-8c15-624faa2a696c tempest-ServerRescueNegativeTestJSON-576927092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33794d38-6059-4140-bd29-84296cc2985c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:41:48 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-09af797b-74e7-4f46-8c15-624faa2a696c tempest-ServerRescueNegativeTestJSON-576927092 None] Volume volume-0bbba16c-7467-497c-a3db-831063566a4b (0bbba16c-7467-497c-a3db-831063566a4b): created successfully Jul 08 01:41:48 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-09af797b-74e7-4f46-8c15-624faa2a696c tempest-ServerRescueNegativeTestJSON-576927092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33794d38-6059-4140-bd29-84296cc2985c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:41:48 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-09af797b-74e7-4f46-8c15-624faa2a696c tempest-ServerRescueNegativeTestJSON-576927092 None] Flow 'volume_create_manager' (3a8f7148-4289-424e-96c8-ae14137b2b65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:41:48 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-09af797b-74e7-4f46-8c15-624faa2a696c tempest-ServerRescueNegativeTestJSON-576927092 None] Created volume successfully. Jul 08 01:41:49 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-746d758e-3f74-4e1f-af7b-15d88f3885ce tempest-DeleteServersTestJSON-686517226 None] Acquiring lock "cinder-f90bf96e-f08d-48fb-b28c-6c62e7ae0a8f-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:41:49 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-746d758e-3f74-4e1f-af7b-15d88f3885ce tempest-DeleteServersTestJSON-686517226 None] Lock "cinder-f90bf96e-f08d-48fb-b28c-6c62e7ae0a8f-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:41:50 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-746d758e-3f74-4e1f-af7b-15d88f3885ce tempest-DeleteServersTestJSON-686517226 None] Acquiring lock "cinder-quobyte-f90bf96e-f08d-48fb-b28c-6c62e7ae0a8f" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:41:50 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-746d758e-3f74-4e1f-af7b-15d88f3885ce tempest-DeleteServersTestJSON-686517226 None] Lock "cinder-quobyte-f90bf96e-f08d-48fb-b28c-6c62e7ae0a8f" acquired by "delete_volume" :: waited 0.019s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:41:50 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d865b79-9881-450f-8a8e-eb1ecabf1396]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:41:50 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-746d758e-3f74-4e1f-af7b-15d88f3885ce tempest-DeleteServersTestJSON-686517226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f90bf96e-f08d-48fb-b28c-6c62e7ae0a8f {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:50 devstack sudo[88981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f90bf96e-f08d-48fb-b28c-6c62e7ae0a8f Jul 08 01:41:50 devstack sudo[88981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:51 devstack sudo[88981]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-746d758e-3f74-4e1f-af7b-15d88f3885ce tempest-DeleteServersTestJSON-686517226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f90bf96e-f08d-48fb-b28c-6c62e7ae0a8f" returned: 0 in 1.179s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-746d758e-3f74-4e1f-af7b-15d88f3885ce tempest-DeleteServersTestJSON-686517226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f90bf96e-f08d-48fb-b28c-6c62e7ae0a8f {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:51 devstack sudo[88986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f90bf96e-f08d-48fb-b28c-6c62e7ae0a8f Jul 08 01:41:51 devstack sudo[88986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:52 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-73c47d68-ac9e-4b0f-87af-662b2ae8e5cf tempest-ServerActionsTestOtherA-759876420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:41:52 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-73c47d68-ac9e-4b0f-87af-662b2ae8e5cf tempest-ServerActionsTestOtherA-759876420 None] Flow 'volume_create_manager' (a7d1152a-b472-493f-bcfa-db5d2b08493c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:41:52 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-73c47d68-ac9e-4b0f-87af-662b2ae8e5cf tempest-ServerActionsTestOtherA-759876420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aadf304-66a3-4ce3-a4bc-4e98586003a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:41:52 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-73c47d68-ac9e-4b0f-87af-662b2ae8e5cf tempest-ServerActionsTestOtherA-759876420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aadf304-66a3-4ce3-a4bc-4e98586003a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:41:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1612584805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e6b5138-cde7-42f8-8d8f-08b242f3e9cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b7e22d903674fc69ed612f258990e59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:41:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:41:52Z,use_quota=True,user_id='f32ade0571c44121894f4b6ea7c7f9fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:41:52 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-73c47d68-ac9e-4b0f-87af-662b2ae8e5cf tempest-ServerActionsTestOtherA-759876420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c4a096d-58f5-4216-86ef-ee609c5c14de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:41:52 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-73c47d68-ac9e-4b0f-87af-662b2ae8e5cf tempest-ServerActionsTestOtherA-759876420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c4a096d-58f5-4216-86ef-ee609c5c14de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:41:52 devstack sudo[88986]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:52 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-73c47d68-ac9e-4b0f-87af-662b2ae8e5cf tempest-ServerActionsTestOtherA-759876420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce31aecd-20b8-4501-9172-7907cc28a645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:41:52 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-73c47d68-ac9e-4b0f-87af-662b2ae8e5cf tempest-ServerActionsTestOtherA-759876420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce31aecd-20b8-4501-9172-7907cc28a645) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e6b5138-cde7-42f8-8d8f-08b242f3e9cf', 'volume_name': 'volume-7e6b5138-cde7-42f8-8d8f-08b242f3e9cf', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:41:52 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-73c47d68-ac9e-4b0f-87af-662b2ae8e5cf tempest-ServerActionsTestOtherA-759876420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb8b672d-00ef-43b6-bddb-1cd9faf59ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:41:52 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-73c47d68-ac9e-4b0f-87af-662b2ae8e5cf tempest-ServerActionsTestOtherA-759876420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb8b672d-00ef-43b6-bddb-1cd9faf59ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:41:52 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-73c47d68-ac9e-4b0f-87af-662b2ae8e5cf tempest-ServerActionsTestOtherA-759876420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acb1cbfc-8cce-4b5f-9b8d-356a997e2559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:41:52 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-73c47d68-ac9e-4b0f-87af-662b2ae8e5cf tempest-ServerActionsTestOtherA-759876420 None] Volume 7e6b5138-cde7-42f8-8d8f-08b242f3e9cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e6b5138-cde7-42f8-8d8f-08b242f3e9cf', 'volume_size': 1} Jul 08 01:41:52 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-73c47d68-ac9e-4b0f-87af-662b2ae8e5cf tempest-ServerActionsTestOtherA-759876420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:41:52 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-73c47d68-ac9e-4b0f-87af-662b2ae8e5cf tempest-ServerActionsTestOtherA-759876420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:41:52 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-73c47d68-ac9e-4b0f-87af-662b2ae8e5cf tempest-ServerActionsTestOtherA-759876420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:41:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1612584805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e6b5138-cde7-42f8-8d8f-08b242f3e9cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b7e22d903674fc69ed612f258990e59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:41:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:41:52Z,use_quota=True,user_id='f32ade0571c44121894f4b6ea7c7f9fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:41:52 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-73c47d68-ac9e-4b0f-87af-662b2ae8e5cf tempest-ServerActionsTestOtherA-759876420 None] Creating volume 7e6b5138-cde7-42f8-8d8f-08b242f3e9cf {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:41:52 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-73c47d68-ac9e-4b0f-87af-662b2ae8e5cf tempest-ServerActionsTestOtherA-759876420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:41:52 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-73c47d68-ac9e-4b0f-87af-662b2ae8e5cf tempest-ServerActionsTestOtherA-759876420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:41:52 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-73c47d68-ac9e-4b0f-87af-662b2ae8e5cf tempest-ServerActionsTestOtherA-759876420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:41:52 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-73c47d68-ac9e-4b0f-87af-662b2ae8e5cf tempest-ServerActionsTestOtherA-759876420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:41:52 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-73c47d68-ac9e-4b0f-87af-662b2ae8e5cf tempest-ServerActionsTestOtherA-759876420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:41:52 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-73c47d68-ac9e-4b0f-87af-662b2ae8e5cf tempest-ServerActionsTestOtherA-759876420 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:41:52 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-73c47d68-ac9e-4b0f-87af-662b2ae8e5cf tempest-ServerActionsTestOtherA-759876420 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:41:52 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-73c47d68-ac9e-4b0f-87af-662b2ae8e5cf tempest-ServerActionsTestOtherA-759876420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7e6b5138-cde7-42f8-8d8f-08b242f3e9cf 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:52 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-746d758e-3f74-4e1f-af7b-15d88f3885ce tempest-DeleteServersTestJSON-686517226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f90bf96e-f08d-48fb-b28c-6c62e7ae0a8f" returned: 0 in 1.460s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:52 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-746d758e-3f74-4e1f-af7b-15d88f3885ce tempest-DeleteServersTestJSON-686517226 None] Lock "cinder-quobyte-f90bf96e-f08d-48fb-b28c-6c62e7ae0a8f" released by "delete_volume" :: held 2.704s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:41:52 devstack sudo[88990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7e6b5138-cde7-42f8-8d8f-08b242f3e9cf 1073741824 Jul 08 01:41:52 devstack sudo[88990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:52 devstack cinder-volume[87134]: WARNING cinder.quota [None req-746d758e-3f74-4e1f-af7b-15d88f3885ce tempest-DeleteServersTestJSON-686517226 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:41:52 devstack cinder-volume[87134]: WARNING cinder.quota [None req-746d758e-3f74-4e1f-af7b-15d88f3885ce tempest-DeleteServersTestJSON-686517226 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:41:52 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-746d758e-3f74-4e1f-af7b-15d88f3885ce tempest-DeleteServersTestJSON-686517226 None] Created reservations ['64c1abbb-5748-4140-813d-966ab7ba2586', '92cdc6fc-e0e6-417b-b67c-1a303b5274bc', '7ca374ad-e1f2-44c3-a4db-470bb9cbeea5', '74081893-f1e3-446f-85cf-323a0795546d'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:41:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-746d758e-3f74-4e1f-af7b-15d88f3885ce tempest-DeleteServersTestJSON-686517226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:41:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-746d758e-3f74-4e1f-af7b-15d88f3885ce tempest-DeleteServersTestJSON-686517226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:41:53 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-746d758e-3f74-4e1f-af7b-15d88f3885ce tempest-DeleteServersTestJSON-686517226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:41:53 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-746d758e-3f74-4e1f-af7b-15d88f3885ce tempest-DeleteServersTestJSON-686517226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:41:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-746d758e-3f74-4e1f-af7b-15d88f3885ce tempest-DeleteServersTestJSON-686517226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:41:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-746d758e-3f74-4e1f-af7b-15d88f3885ce tempest-DeleteServersTestJSON-686517226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:53 devstack sudo[88992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:41:53 devstack sudo[88992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:54 devstack sudo[88992]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-746d758e-3f74-4e1f-af7b-15d88f3885ce tempest-DeleteServersTestJSON-686517226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 1.279s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:54 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-746d758e-3f74-4e1f-af7b-15d88f3885ce tempest-DeleteServersTestJSON-686517226 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:41:54 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-746d758e-3f74-4e1f-af7b-15d88f3885ce tempest-DeleteServersTestJSON-686517226 None] Deleted volume successfully. Jul 08 01:41:54 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-746d758e-3f74-4e1f-af7b-15d88f3885ce tempest-DeleteServersTestJSON-686517226 None] Lock "cinder-f90bf96e-f08d-48fb-b28c-6c62e7ae0a8f-delete_volume" released by "delete_volume" :: held 4.655s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:41:54 devstack sudo[88990]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-73c47d68-ac9e-4b0f-87af-662b2ae8e5cf tempest-ServerActionsTestOtherA-759876420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7e6b5138-cde7-42f8-8d8f-08b242f3e9cf 1073741824" returned: 0 in 1.940s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-73c47d68-ac9e-4b0f-87af-662b2ae8e5cf tempest-ServerActionsTestOtherA-759876420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7e6b5138-cde7-42f8-8d8f-08b242f3e9cf {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:41:54 devstack sudo[88998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7e6b5138-cde7-42f8-8d8f-08b242f3e9cf Jul 08 01:41:54 devstack sudo[88998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:41:55 devstack sudo[88998]: pam_unix(sudo:session): session closed for user root Jul 08 01:41:55 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-73c47d68-ac9e-4b0f-87af-662b2ae8e5cf tempest-ServerActionsTestOtherA-759876420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7e6b5138-cde7-42f8-8d8f-08b242f3e9cf" returned: 0 in 0.947s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:41:55 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-73c47d68-ac9e-4b0f-87af-662b2ae8e5cf tempest-ServerActionsTestOtherA-759876420 None] <== create_volume: return (2992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:41:55 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-73c47d68-ac9e-4b0f-87af-662b2ae8e5cf tempest-ServerActionsTestOtherA-759876420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.997s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:41:55 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-73c47d68-ac9e-4b0f-87af-662b2ae8e5cf tempest-ServerActionsTestOtherA-759876420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acb1cbfc-8cce-4b5f-9b8d-356a997e2559) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e6b5138-cde7-42f8-8d8f-08b242f3e9cf', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:41:55 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-73c47d68-ac9e-4b0f-87af-662b2ae8e5cf tempest-ServerActionsTestOtherA-759876420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (feef778f-9833-4ef6-a477-28405a6d82dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:41:55 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-73c47d68-ac9e-4b0f-87af-662b2ae8e5cf tempest-ServerActionsTestOtherA-759876420 None] Volume volume-7e6b5138-cde7-42f8-8d8f-08b242f3e9cf (7e6b5138-cde7-42f8-8d8f-08b242f3e9cf): created successfully Jul 08 01:41:55 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-73c47d68-ac9e-4b0f-87af-662b2ae8e5cf tempest-ServerActionsTestOtherA-759876420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (feef778f-9833-4ef6-a477-28405a6d82dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:41:55 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-73c47d68-ac9e-4b0f-87af-662b2ae8e5cf tempest-ServerActionsTestOtherA-759876420 None] Flow 'volume_create_manager' (a7d1152a-b472-493f-bcfa-db5d2b08493c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:41:55 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-73c47d68-ac9e-4b0f-87af-662b2ae8e5cf tempest-ServerActionsTestOtherA-759876420 None] Created volume successfully. Jul 08 01:42:13 devstack cinder-volume[87134]: DEBUG dbcounter [-] [87134] Writing DB stats cinder:SELECT=10,cinder:UPDATE=13,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87134) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:42:13 devstack cinder-volume[87134]: DEBUG dbcounter [-] [87134] Writing DB stats cinder:SELECT=11,cinder:INSERT=3,cinder:UPDATE=16,cinder:DELETE=2 {{(pid=87134) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:42:20 devstack cinder-volume[87134]: DEBUG oslo_service.periodic_task [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87134) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:42:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:42:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:42:20 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:42:20 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:42:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:42:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:42:20 devstack sudo[89202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:42:20 devstack sudo[89202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:42:21 devstack sudo[89202]: pam_unix(sudo:session): session closed for user root Jul 08 01:42:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 1.136s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:42:21 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:42:22 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-2b0dc1d7-4bd2-4406-b5ed-36c8e2a0340f tempest-ServerRescueNegativeTestJSON-576927092 None] Acquiring lock "cinder-0bbba16c-7467-497c-a3db-831063566a4b-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:42:22 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-2b0dc1d7-4bd2-4406-b5ed-36c8e2a0340f tempest-ServerRescueNegativeTestJSON-576927092 None] Lock "cinder-0bbba16c-7467-497c-a3db-831063566a4b-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:42:22 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-2b0dc1d7-4bd2-4406-b5ed-36c8e2a0340f tempest-ServerRescueNegativeTestJSON-576927092 None] Acquiring lock "cinder-quobyte-0bbba16c-7467-497c-a3db-831063566a4b" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:42:22 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-2b0dc1d7-4bd2-4406-b5ed-36c8e2a0340f tempest-ServerRescueNegativeTestJSON-576927092 None] Lock "cinder-quobyte-0bbba16c-7467-497c-a3db-831063566a4b" acquired by "delete_volume" :: waited 0.022s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:42:22 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[224c103e-4ad2-4b2f-aa86-1641e5eb421f]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:42:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2b0dc1d7-4bd2-4406-b5ed-36c8e2a0340f tempest-ServerRescueNegativeTestJSON-576927092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0bbba16c-7467-497c-a3db-831063566a4b {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:42:23 devstack sudo[89206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0bbba16c-7467-497c-a3db-831063566a4b Jul 08 01:42:23 devstack sudo[89206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:42:24 devstack sudo[89206]: pam_unix(sudo:session): session closed for user root Jul 08 01:42:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2b0dc1d7-4bd2-4406-b5ed-36c8e2a0340f tempest-ServerRescueNegativeTestJSON-576927092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0bbba16c-7467-497c-a3db-831063566a4b" returned: 0 in 1.641s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:42:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2b0dc1d7-4bd2-4406-b5ed-36c8e2a0340f tempest-ServerRescueNegativeTestJSON-576927092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0bbba16c-7467-497c-a3db-831063566a4b {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:42:24 devstack sudo[89227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0bbba16c-7467-497c-a3db-831063566a4b Jul 08 01:42:24 devstack sudo[89227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:42:25 devstack sudo[89227]: pam_unix(sudo:session): session closed for user root Jul 08 01:42:25 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2b0dc1d7-4bd2-4406-b5ed-36c8e2a0340f tempest-ServerRescueNegativeTestJSON-576927092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0bbba16c-7467-497c-a3db-831063566a4b" returned: 0 in 1.302s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:42:25 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-2b0dc1d7-4bd2-4406-b5ed-36c8e2a0340f tempest-ServerRescueNegativeTestJSON-576927092 None] Lock "cinder-quobyte-0bbba16c-7467-497c-a3db-831063566a4b" released by "delete_volume" :: held 3.027s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:42:26 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-2b0dc1d7-4bd2-4406-b5ed-36c8e2a0340f tempest-ServerRescueNegativeTestJSON-576927092 None] Created reservations ['e5a58ad0-20ac-44e0-b30f-41ebd9a77fbe', '2e51f6bc-a5a7-433b-b712-e39271d406d1', '689437ac-d52d-4933-a47b-65b4ff1881d6', '72bdec18-7d8c-4bea-93cb-7e1f86e5c7e4'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:42:26 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-2b0dc1d7-4bd2-4406-b5ed-36c8e2a0340f tempest-ServerRescueNegativeTestJSON-576927092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:42:26 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-2b0dc1d7-4bd2-4406-b5ed-36c8e2a0340f tempest-ServerRescueNegativeTestJSON-576927092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:42:26 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-2b0dc1d7-4bd2-4406-b5ed-36c8e2a0340f tempest-ServerRescueNegativeTestJSON-576927092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:42:26 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-2b0dc1d7-4bd2-4406-b5ed-36c8e2a0340f tempest-ServerRescueNegativeTestJSON-576927092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:42:26 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-2b0dc1d7-4bd2-4406-b5ed-36c8e2a0340f tempest-ServerRescueNegativeTestJSON-576927092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:42:26 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2b0dc1d7-4bd2-4406-b5ed-36c8e2a0340f tempest-ServerRescueNegativeTestJSON-576927092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:42:26 devstack sudo[89255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:42:26 devstack sudo[89255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:42:28 devstack sudo[89255]: pam_unix(sudo:session): session closed for user root Jul 08 01:42:28 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2b0dc1d7-4bd2-4406-b5ed-36c8e2a0340f tempest-ServerRescueNegativeTestJSON-576927092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 1.964s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:42:28 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-2b0dc1d7-4bd2-4406-b5ed-36c8e2a0340f tempest-ServerRescueNegativeTestJSON-576927092 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:42:28 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-2b0dc1d7-4bd2-4406-b5ed-36c8e2a0340f tempest-ServerRescueNegativeTestJSON-576927092 None] Deleted volume successfully. Jul 08 01:42:28 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-2b0dc1d7-4bd2-4406-b5ed-36c8e2a0340f tempest-ServerRescueNegativeTestJSON-576927092 None] Lock "cinder-0bbba16c-7467-497c-a3db-831063566a4b-delete_volume" released by "delete_volume" :: held 5.527s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:42:36 devstack cinder-volume[87134]: DEBUG dbcounter [-] [87134] Writing DB stats cinder:SELECT=5,cinder:INSERT=1,cinder:UPDATE=9 {{(pid=87134) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:42:38 devstack cinder-volume[87134]: DEBUG dbcounter [-] [87134] Writing DB stats cinder:UPDATE=7,cinder:SELECT=5,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87134) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:43:00 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d21360f-8027-4c07-9101-3ec9b95b99e1 tempest-VolumesAdminNegativeTest-1460669947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:43:00 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5d21360f-8027-4c07-9101-3ec9b95b99e1 tempest-VolumesAdminNegativeTest-1460669947 None] Flow 'volume_create_manager' (547a87f4-cda3-4e9a-a567-0626d6b5ca6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:43:00 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5d21360f-8027-4c07-9101-3ec9b95b99e1 tempest-VolumesAdminNegativeTest-1460669947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5425ac27-c445-44cb-aadd-cb9bd39f54f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:43:00 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5d21360f-8027-4c07-9101-3ec9b95b99e1 tempest-VolumesAdminNegativeTest-1460669947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5425ac27-c445-44cb-aadd-cb9bd39f54f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:43:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-70343231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=468b4f57-3301-48ca-8d90-8553f54966e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5933dcbc9fe84e07a80ed15efe9c0ca5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:43:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:43:00Z,use_quota=True,user_id='60715b72c67b4cc6a4580e1e02104985',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:43:00 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5d21360f-8027-4c07-9101-3ec9b95b99e1 tempest-VolumesAdminNegativeTest-1460669947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca37caed-ba73-4402-a533-16ecdc74d424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:43:00 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5d21360f-8027-4c07-9101-3ec9b95b99e1 tempest-VolumesAdminNegativeTest-1460669947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca37caed-ba73-4402-a533-16ecdc74d424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:43:00 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5d21360f-8027-4c07-9101-3ec9b95b99e1 tempest-VolumesAdminNegativeTest-1460669947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d362811-286c-4769-909b-ab1f9dd69672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:43:00 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5d21360f-8027-4c07-9101-3ec9b95b99e1 tempest-VolumesAdminNegativeTest-1460669947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d362811-286c-4769-909b-ab1f9dd69672) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '468b4f57-3301-48ca-8d90-8553f54966e7', 'volume_name': 'volume-468b4f57-3301-48ca-8d90-8553f54966e7', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:43:00 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5d21360f-8027-4c07-9101-3ec9b95b99e1 tempest-VolumesAdminNegativeTest-1460669947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f007d3ef-4e4e-4d83-8431-ee66977802e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:43:00 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5d21360f-8027-4c07-9101-3ec9b95b99e1 tempest-VolumesAdminNegativeTest-1460669947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f007d3ef-4e4e-4d83-8431-ee66977802e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:43:00 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5d21360f-8027-4c07-9101-3ec9b95b99e1 tempest-VolumesAdminNegativeTest-1460669947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb9fa7e7-0fe1-4d7f-bb91-440da762bb1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:43:00 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-5d21360f-8027-4c07-9101-3ec9b95b99e1 tempest-VolumesAdminNegativeTest-1460669947 None] Volume 468b4f57-3301-48ca-8d90-8553f54966e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-468b4f57-3301-48ca-8d90-8553f54966e7', 'volume_size': 1} Jul 08 01:43:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5d21360f-8027-4c07-9101-3ec9b95b99e1 tempest-VolumesAdminNegativeTest-1460669947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:43:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5d21360f-8027-4c07-9101-3ec9b95b99e1 tempest-VolumesAdminNegativeTest-1460669947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:43:00 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-5d21360f-8027-4c07-9101-3ec9b95b99e1 tempest-VolumesAdminNegativeTest-1460669947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:43:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-70343231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=468b4f57-3301-48ca-8d90-8553f54966e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5933dcbc9fe84e07a80ed15efe9c0ca5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:43:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:43:00Z,use_quota=True,user_id='60715b72c67b4cc6a4580e1e02104985',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:43:00 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-5d21360f-8027-4c07-9101-3ec9b95b99e1 tempest-VolumesAdminNegativeTest-1460669947 None] Creating volume 468b4f57-3301-48ca-8d90-8553f54966e7 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:43:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5d21360f-8027-4c07-9101-3ec9b95b99e1 tempest-VolumesAdminNegativeTest-1460669947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:43:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5d21360f-8027-4c07-9101-3ec9b95b99e1 tempest-VolumesAdminNegativeTest-1460669947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:43:00 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-5d21360f-8027-4c07-9101-3ec9b95b99e1 tempest-VolumesAdminNegativeTest-1460669947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:43:00 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-5d21360f-8027-4c07-9101-3ec9b95b99e1 tempest-VolumesAdminNegativeTest-1460669947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:43:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5d21360f-8027-4c07-9101-3ec9b95b99e1 tempest-VolumesAdminNegativeTest-1460669947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:43:00 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-5d21360f-8027-4c07-9101-3ec9b95b99e1 tempest-VolumesAdminNegativeTest-1460669947 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:43:00 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-5d21360f-8027-4c07-9101-3ec9b95b99e1 tempest-VolumesAdminNegativeTest-1460669947 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:43:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5d21360f-8027-4c07-9101-3ec9b95b99e1 tempest-VolumesAdminNegativeTest-1460669947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-468b4f57-3301-48ca-8d90-8553f54966e7 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:43:00 devstack sudo[89563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-468b4f57-3301-48ca-8d90-8553f54966e7 1073741824 Jul 08 01:43:00 devstack sudo[89563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:43:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-fc8e0ecc-a20c-4a24-9b30-bb81de2b24b2 req-3f12b782-12d9-4ce7-91db-0feb99613519 tempest-ServerActionsTestOtherA-759876420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:43:01 devstack sudo[89563]: pam_unix(sudo:session): session closed for user root Jul 08 01:43:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5d21360f-8027-4c07-9101-3ec9b95b99e1 tempest-VolumesAdminNegativeTest-1460669947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-468b4f57-3301-48ca-8d90-8553f54966e7 1073741824" returned: 0 in 1.594s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:43:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5d21360f-8027-4c07-9101-3ec9b95b99e1 tempest-VolumesAdminNegativeTest-1460669947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-468b4f57-3301-48ca-8d90-8553f54966e7 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:43:01 devstack sudo[89579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-468b4f57-3301-48ca-8d90-8553f54966e7 Jul 08 01:43:01 devstack sudo[89579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:43:02 devstack sudo[89579]: pam_unix(sudo:session): session closed for user root Jul 08 01:43:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5d21360f-8027-4c07-9101-3ec9b95b99e1 tempest-VolumesAdminNegativeTest-1460669947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-468b4f57-3301-48ca-8d90-8553f54966e7" returned: 0 in 0.931s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:43:02 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-5d21360f-8027-4c07-9101-3ec9b95b99e1 tempest-VolumesAdminNegativeTest-1460669947 None] <== create_volume: return (2573ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:43:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5d21360f-8027-4c07-9101-3ec9b95b99e1 tempest-VolumesAdminNegativeTest-1460669947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.579s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:43:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-fc8e0ecc-a20c-4a24-9b30-bb81de2b24b2 req-3f12b782-12d9-4ce7-91db-0feb99613519 tempest-ServerActionsTestOtherA-759876420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.406s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:43:02 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5d21360f-8027-4c07-9101-3ec9b95b99e1 tempest-VolumesAdminNegativeTest-1460669947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb9fa7e7-0fe1-4d7f-bb91-440da762bb1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-468b4f57-3301-48ca-8d90-8553f54966e7', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:43:02 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5d21360f-8027-4c07-9101-3ec9b95b99e1 tempest-VolumesAdminNegativeTest-1460669947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a10e031c-f37f-4e53-a711-7b431d1354ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:43:02 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[d84ea466-d92a-4446-8c49-06489a686c15]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:43:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-fc8e0ecc-a20c-4a24-9b30-bb81de2b24b2 req-3f12b782-12d9-4ce7-91db-0feb99613519 tempest-ServerActionsTestOtherA-759876420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7e6b5138-cde7-42f8-8d8f-08b242f3e9cf {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:43:02 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-5d21360f-8027-4c07-9101-3ec9b95b99e1 tempest-VolumesAdminNegativeTest-1460669947 None] Volume volume-468b4f57-3301-48ca-8d90-8553f54966e7 (468b4f57-3301-48ca-8d90-8553f54966e7): created successfully Jul 08 01:43:03 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5d21360f-8027-4c07-9101-3ec9b95b99e1 tempest-VolumesAdminNegativeTest-1460669947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a10e031c-f37f-4e53-a711-7b431d1354ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:43:03 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5d21360f-8027-4c07-9101-3ec9b95b99e1 tempest-VolumesAdminNegativeTest-1460669947 None] Flow 'volume_create_manager' (547a87f4-cda3-4e9a-a567-0626d6b5ca6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:43:03 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-5d21360f-8027-4c07-9101-3ec9b95b99e1 tempest-VolumesAdminNegativeTest-1460669947 None] Created volume successfully. Jul 08 01:43:03 devstack sudo[89583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7e6b5138-cde7-42f8-8d8f-08b242f3e9cf Jul 08 01:43:03 devstack sudo[89583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:43:04 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-1ee1627a-2d30-4fbc-ad76-0089e6ca6604 tempest-VolumesAdminNegativeTest-1460669947 None] Acquiring lock "cinder-468b4f57-3301-48ca-8d90-8553f54966e7-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:43:04 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-1ee1627a-2d30-4fbc-ad76-0089e6ca6604 tempest-VolumesAdminNegativeTest-1460669947 None] Lock "cinder-468b4f57-3301-48ca-8d90-8553f54966e7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:43:04 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-1ee1627a-2d30-4fbc-ad76-0089e6ca6604 tempest-VolumesAdminNegativeTest-1460669947 None] Acquiring lock "cinder-quobyte-468b4f57-3301-48ca-8d90-8553f54966e7" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:43:04 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-1ee1627a-2d30-4fbc-ad76-0089e6ca6604 tempest-VolumesAdminNegativeTest-1460669947 None] Lock "cinder-quobyte-468b4f57-3301-48ca-8d90-8553f54966e7" acquired by "delete_volume" :: waited 0.020s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:43:04 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f907d56-7c48-48f0-b7b9-04db66372250]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:43:04 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1ee1627a-2d30-4fbc-ad76-0089e6ca6604 tempest-VolumesAdminNegativeTest-1460669947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-468b4f57-3301-48ca-8d90-8553f54966e7 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:43:04 devstack sudo[89585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-468b4f57-3301-48ca-8d90-8553f54966e7 Jul 08 01:43:04 devstack sudo[89585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:43:05 devstack sudo[89583]: pam_unix(sudo:session): session closed for user root Jul 08 01:43:05 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-fc8e0ecc-a20c-4a24-9b30-bb81de2b24b2 req-3f12b782-12d9-4ce7-91db-0feb99613519 tempest-ServerActionsTestOtherA-759876420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7e6b5138-cde7-42f8-8d8f-08b242f3e9cf" returned: 0 in 2.190s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:43:05 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-fc8e0ecc-a20c-4a24-9b30-bb81de2b24b2 req-3f12b782-12d9-4ce7-91db-0feb99613519 tempest-ServerActionsTestOtherA-759876420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.264s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:43:05 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [req-fc8e0ecc-a20c-4a24-9b30-bb81de2b24b2 req-3f12b782-12d9-4ce7-91db-0feb99613519 tempest-ServerActionsTestOtherA-759876420 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17', 'name': 'volume-7e6b5138-cde7-42f8-8d8f-08b242f3e9cf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '07a5d59b-9415-46d6-bfd7-e56f072fb450', 'enforce_multipath': True} {{(pid=87134) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:43:05 devstack cinder-volume[87134]: INFO cinder.volume.manager [req-fc8e0ecc-a20c-4a24-9b30-bb81de2b24b2 req-3f12b782-12d9-4ce7-91db-0feb99613519 tempest-ServerActionsTestOtherA-759876420 None] attachment_update completed successfully. Jul 08 01:43:06 devstack sudo[89585]: pam_unix(sudo:session): session closed for user root Jul 08 01:43:06 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1ee1627a-2d30-4fbc-ad76-0089e6ca6604 tempest-VolumesAdminNegativeTest-1460669947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-468b4f57-3301-48ca-8d90-8553f54966e7" returned: 0 in 1.391s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:43:06 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1ee1627a-2d30-4fbc-ad76-0089e6ca6604 tempest-VolumesAdminNegativeTest-1460669947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-468b4f57-3301-48ca-8d90-8553f54966e7 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:43:06 devstack sudo[89635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-468b4f57-3301-48ca-8d90-8553f54966e7 Jul 08 01:43:06 devstack sudo[89635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:43:06 devstack sudo[89635]: pam_unix(sudo:session): session closed for user root Jul 08 01:43:06 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1ee1627a-2d30-4fbc-ad76-0089e6ca6604 tempest-VolumesAdminNegativeTest-1460669947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-468b4f57-3301-48ca-8d90-8553f54966e7" returned: 0 in 0.966s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:43:07 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-1ee1627a-2d30-4fbc-ad76-0089e6ca6604 tempest-VolumesAdminNegativeTest-1460669947 None] Lock "cinder-quobyte-468b4f57-3301-48ca-8d90-8553f54966e7" released by "delete_volume" :: held 2.422s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:43:07 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-1ee1627a-2d30-4fbc-ad76-0089e6ca6604 tempest-VolumesAdminNegativeTest-1460669947 None] Created reservations ['7ee095e8-dd1e-40ff-a6e4-f29c6bd3606c', 'c58fa91b-536a-4f11-bcc6-ea91492a9575', '9c7d04b0-c283-4959-8326-27bfbb605f56', '32bed3a3-aba1-4ad0-a405-8b8914a49a7e'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:43:07 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-1ee1627a-2d30-4fbc-ad76-0089e6ca6604 tempest-VolumesAdminNegativeTest-1460669947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:43:07 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-1ee1627a-2d30-4fbc-ad76-0089e6ca6604 tempest-VolumesAdminNegativeTest-1460669947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:43:07 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-1ee1627a-2d30-4fbc-ad76-0089e6ca6604 tempest-VolumesAdminNegativeTest-1460669947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:43:07 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-1ee1627a-2d30-4fbc-ad76-0089e6ca6604 tempest-VolumesAdminNegativeTest-1460669947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:43:07 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-1ee1627a-2d30-4fbc-ad76-0089e6ca6604 tempest-VolumesAdminNegativeTest-1460669947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:43:07 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1ee1627a-2d30-4fbc-ad76-0089e6ca6604 tempest-VolumesAdminNegativeTest-1460669947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:43:07 devstack sudo[89998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:43:07 devstack sudo[89998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:43:07 devstack sudo[89998]: pam_unix(sudo:session): session closed for user root Jul 08 01:43:07 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1ee1627a-2d30-4fbc-ad76-0089e6ca6604 tempest-VolumesAdminNegativeTest-1460669947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.753s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:43:07 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-1ee1627a-2d30-4fbc-ad76-0089e6ca6604 tempest-VolumesAdminNegativeTest-1460669947 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:43:08 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-1ee1627a-2d30-4fbc-ad76-0089e6ca6604 tempest-VolumesAdminNegativeTest-1460669947 None] Deleted volume successfully. Jul 08 01:43:08 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-1ee1627a-2d30-4fbc-ad76-0089e6ca6604 tempest-VolumesAdminNegativeTest-1460669947 None] Lock "cinder-468b4f57-3301-48ca-8d90-8553f54966e7-delete_volume" released by "delete_volume" :: held 3.503s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:43:14 devstack cinder-volume[87134]: INFO cinder.volume.manager [req-ffa5f799-7937-4d0c-929d-2c56dd66d6c6 req-58aefb62-6313-478e-b1f9-74f2008309bd tempest-ServerActionsTestOtherA-759876420 None] Terminate volume connection completed successfully. Jul 08 01:43:14 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [req-ffa5f799-7937-4d0c-929d-2c56dd66d6c6 req-58aefb62-6313-478e-b1f9-74f2008309bd tempest-ServerActionsTestOtherA-759876420 None] Deleting attachment 07a5d59b-9415-46d6-bfd7-e56f072fb450. {{(pid=87134) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:43:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-ffa5f799-7937-4d0c-929d-2c56dd66d6c6 req-fa89e870-f44a-43a7-9adf-a34e72a29a99 tempest-ServerActionsTestOtherA-759876420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:43:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-ffa5f799-7937-4d0c-929d-2c56dd66d6c6 req-fa89e870-f44a-43a7-9adf-a34e72a29a99 tempest-ServerActionsTestOtherA-759876420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:43:16 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc1b94a-a44a-4f31-acd3-91c99863b879]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:43:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-ffa5f799-7937-4d0c-929d-2c56dd66d6c6 req-fa89e870-f44a-43a7-9adf-a34e72a29a99 tempest-ServerActionsTestOtherA-759876420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7e6b5138-cde7-42f8-8d8f-08b242f3e9cf {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:43:17 devstack sudo[90156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7e6b5138-cde7-42f8-8d8f-08b242f3e9cf Jul 08 01:43:17 devstack sudo[90156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:43:17 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-708d0485-da25-46ce-860d-084fefa5979a tempest-AttachVolumeTestJSON-1797241320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:43:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-708d0485-da25-46ce-860d-084fefa5979a tempest-AttachVolumeTestJSON-1797241320 None] Flow 'volume_create_manager' (22879b0b-a2c5-452a-a35e-e3110e62ccdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:43:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-708d0485-da25-46ce-860d-084fefa5979a tempest-AttachVolumeTestJSON-1797241320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9753d7a5-c519-413b-ba9d-e9f39c4dd787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:43:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-708d0485-da25-46ce-860d-084fefa5979a tempest-AttachVolumeTestJSON-1797241320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9753d7a5-c519-413b-ba9d-e9f39c4dd787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:43:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1726050044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=369c1741-6616-4dd7-a99f-c342446dec3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='140660a969d943bb9e00ad55f0d190e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:43:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:43:18Z,use_quota=True,user_id='c5c6b353c9bc4b8887e7113f648b541b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:43:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-708d0485-da25-46ce-860d-084fefa5979a tempest-AttachVolumeTestJSON-1797241320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2a052de-c328-4edf-8829-f8c5470be741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:43:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-708d0485-da25-46ce-860d-084fefa5979a tempest-AttachVolumeTestJSON-1797241320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2a052de-c328-4edf-8829-f8c5470be741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:43:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-708d0485-da25-46ce-860d-084fefa5979a tempest-AttachVolumeTestJSON-1797241320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94654938-ba2f-4e29-bac4-37ce82d11ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:43:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-708d0485-da25-46ce-860d-084fefa5979a tempest-AttachVolumeTestJSON-1797241320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94654938-ba2f-4e29-bac4-37ce82d11ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '369c1741-6616-4dd7-a99f-c342446dec3c', 'volume_name': 'volume-369c1741-6616-4dd7-a99f-c342446dec3c', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:43:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-708d0485-da25-46ce-860d-084fefa5979a tempest-AttachVolumeTestJSON-1797241320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40644651-fc8f-4203-903f-66c6b022e6a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:43:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-708d0485-da25-46ce-860d-084fefa5979a tempest-AttachVolumeTestJSON-1797241320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40644651-fc8f-4203-903f-66c6b022e6a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:43:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-708d0485-da25-46ce-860d-084fefa5979a tempest-AttachVolumeTestJSON-1797241320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2101e498-77fb-4f60-9704-451ef25213e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:43:17 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-708d0485-da25-46ce-860d-084fefa5979a tempest-AttachVolumeTestJSON-1797241320 None] Volume 369c1741-6616-4dd7-a99f-c342446dec3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-369c1741-6616-4dd7-a99f-c342446dec3c', 'volume_size': 1} Jul 08 01:43:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-708d0485-da25-46ce-860d-084fefa5979a tempest-AttachVolumeTestJSON-1797241320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:43:18 devstack sudo[90156]: pam_unix(sudo:session): session closed for user root Jul 08 01:43:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-ffa5f799-7937-4d0c-929d-2c56dd66d6c6 req-fa89e870-f44a-43a7-9adf-a34e72a29a99 tempest-ServerActionsTestOtherA-759876420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7e6b5138-cde7-42f8-8d8f-08b242f3e9cf" returned: 0 in 1.147s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:43:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-ffa5f799-7937-4d0c-929d-2c56dd66d6c6 req-fa89e870-f44a-43a7-9adf-a34e72a29a99 tempest-ServerActionsTestOtherA-759876420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.168s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:43:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-708d0485-da25-46ce-860d-084fefa5979a tempest-AttachVolumeTestJSON-1797241320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.286s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:43:18 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-708d0485-da25-46ce-860d-084fefa5979a tempest-AttachVolumeTestJSON-1797241320 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:43:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1726050044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=369c1741-6616-4dd7-a99f-c342446dec3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='140660a969d943bb9e00ad55f0d190e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:43:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:43:18Z,use_quota=True,user_id='c5c6b353c9bc4b8887e7113f648b541b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:43:18 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-708d0485-da25-46ce-860d-084fefa5979a tempest-AttachVolumeTestJSON-1797241320 None] Creating volume 369c1741-6616-4dd7-a99f-c342446dec3c {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:43:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-708d0485-da25-46ce-860d-084fefa5979a tempest-AttachVolumeTestJSON-1797241320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:43:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-708d0485-da25-46ce-860d-084fefa5979a tempest-AttachVolumeTestJSON-1797241320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:43:18 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-708d0485-da25-46ce-860d-084fefa5979a tempest-AttachVolumeTestJSON-1797241320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:43:18 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-708d0485-da25-46ce-860d-084fefa5979a tempest-AttachVolumeTestJSON-1797241320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:43:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-708d0485-da25-46ce-860d-084fefa5979a tempest-AttachVolumeTestJSON-1797241320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:43:18 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-708d0485-da25-46ce-860d-084fefa5979a tempest-AttachVolumeTestJSON-1797241320 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:43:18 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-708d0485-da25-46ce-860d-084fefa5979a tempest-AttachVolumeTestJSON-1797241320 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:43:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-708d0485-da25-46ce-860d-084fefa5979a tempest-AttachVolumeTestJSON-1797241320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-369c1741-6616-4dd7-a99f-c342446dec3c 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:43:18 devstack sudo[90167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-369c1741-6616-4dd7-a99f-c342446dec3c 1073741824 Jul 08 01:43:18 devstack sudo[90167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:43:18 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [req-ffa5f799-7937-4d0c-929d-2c56dd66d6c6 req-fa89e870-f44a-43a7-9adf-a34e72a29a99 tempest-ServerActionsTestOtherA-759876420 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17', 'name': 'volume-7e6b5138-cde7-42f8-8d8f-08b242f3e9cf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e98614cb-d207-401c-8f7a-becb13b7a33a', 'enforce_multipath': True} {{(pid=87134) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:43:18 devstack cinder-volume[87134]: INFO cinder.volume.manager [req-ffa5f799-7937-4d0c-929d-2c56dd66d6c6 req-fa89e870-f44a-43a7-9adf-a34e72a29a99 tempest-ServerActionsTestOtherA-759876420 None] attachment_update completed successfully. Jul 08 01:43:19 devstack sudo[90167]: pam_unix(sudo:session): session closed for user root Jul 08 01:43:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-708d0485-da25-46ce-860d-084fefa5979a tempest-AttachVolumeTestJSON-1797241320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-369c1741-6616-4dd7-a99f-c342446dec3c 1073741824" returned: 0 in 0.962s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:43:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-708d0485-da25-46ce-860d-084fefa5979a tempest-AttachVolumeTestJSON-1797241320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-369c1741-6616-4dd7-a99f-c342446dec3c {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:43:19 devstack sudo[90172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-369c1741-6616-4dd7-a99f-c342446dec3c Jul 08 01:43:19 devstack sudo[90172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:43:19 devstack sudo[90172]: pam_unix(sudo:session): session closed for user root Jul 08 01:43:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-708d0485-da25-46ce-860d-084fefa5979a tempest-AttachVolumeTestJSON-1797241320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-369c1741-6616-4dd7-a99f-c342446dec3c" returned: 0 in 0.796s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:43:19 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-708d0485-da25-46ce-860d-084fefa5979a tempest-AttachVolumeTestJSON-1797241320 None] <== create_volume: return (1824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:43:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-708d0485-da25-46ce-860d-084fefa5979a tempest-AttachVolumeTestJSON-1797241320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.828s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:43:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-708d0485-da25-46ce-860d-084fefa5979a tempest-AttachVolumeTestJSON-1797241320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2101e498-77fb-4f60-9704-451ef25213e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-369c1741-6616-4dd7-a99f-c342446dec3c', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:43:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-708d0485-da25-46ce-860d-084fefa5979a tempest-AttachVolumeTestJSON-1797241320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38c60363-29e0-4b43-b0f8-e84c47f156d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:43:20 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-708d0485-da25-46ce-860d-084fefa5979a tempest-AttachVolumeTestJSON-1797241320 None] Volume volume-369c1741-6616-4dd7-a99f-c342446dec3c (369c1741-6616-4dd7-a99f-c342446dec3c): created successfully Jul 08 01:43:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-708d0485-da25-46ce-860d-084fefa5979a tempest-AttachVolumeTestJSON-1797241320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38c60363-29e0-4b43-b0f8-e84c47f156d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:43:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-708d0485-da25-46ce-860d-084fefa5979a tempest-AttachVolumeTestJSON-1797241320 None] Flow 'volume_create_manager' (22879b0b-a2c5-452a-a35e-e3110e62ccdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:43:20 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-708d0485-da25-46ce-860d-084fefa5979a tempest-AttachVolumeTestJSON-1797241320 None] Created volume successfully. Jul 08 01:43:20 devstack cinder-volume[87134]: DEBUG oslo_service.periodic_task [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87134) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:43:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:43:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:43:20 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:43:20 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:43:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:43:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:43:20 devstack sudo[90193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:43:20 devstack sudo[90193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:43:21 devstack sudo[90193]: pam_unix(sudo:session): session closed for user root Jul 08 01:43:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.833s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:43:21 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:43:21 devstack cinder-volume[87134]: DEBUG oslo_service.periodic_task [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running periodic task VolumeManager._thread_info {{(pid=87134) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:43:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] thread count: 8 {{(pid=87134) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:43:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] thread info: [<_MainThread(MainThread, started 129378964615296)>, , , , , , , ] {{(pid=87134) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:43:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-e62c9ffd-7044-4956-9312-bbd67d368a7e req-b33b7570-137c-4a71-a2ec-9300c1299aa8 tempest-AttachVolumeTestJSON-1797241320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:43:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-e62c9ffd-7044-4956-9312-bbd67d368a7e req-b33b7570-137c-4a71-a2ec-9300c1299aa8 tempest-AttachVolumeTestJSON-1797241320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:43:24 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe0311e-c177-48f8-8ae1-5ed033def0b2]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:43:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-e62c9ffd-7044-4956-9312-bbd67d368a7e req-b33b7570-137c-4a71-a2ec-9300c1299aa8 tempest-AttachVolumeTestJSON-1797241320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-369c1741-6616-4dd7-a99f-c342446dec3c {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:43:24 devstack sudo[90644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-369c1741-6616-4dd7-a99f-c342446dec3c Jul 08 01:43:24 devstack sudo[90644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:43:25 devstack sudo[90644]: pam_unix(sudo:session): session closed for user root Jul 08 01:43:25 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-e62c9ffd-7044-4956-9312-bbd67d368a7e req-b33b7570-137c-4a71-a2ec-9300c1299aa8 tempest-AttachVolumeTestJSON-1797241320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-369c1741-6616-4dd7-a99f-c342446dec3c" returned: 0 in 1.112s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:43:25 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-e62c9ffd-7044-4956-9312-bbd67d368a7e req-b33b7570-137c-4a71-a2ec-9300c1299aa8 tempest-AttachVolumeTestJSON-1797241320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.139s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:43:25 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [req-e62c9ffd-7044-4956-9312-bbd67d368a7e req-b33b7570-137c-4a71-a2ec-9300c1299aa8 tempest-AttachVolumeTestJSON-1797241320 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17', 'name': 'volume-369c1741-6616-4dd7-a99f-c342446dec3c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b3b9ab84-1af7-49d3-9c62-c13c5125a090', 'enforce_multipath': True} {{(pid=87134) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:43:25 devstack cinder-volume[87134]: INFO cinder.volume.manager [req-e62c9ffd-7044-4956-9312-bbd67d368a7e req-b33b7570-137c-4a71-a2ec-9300c1299aa8 tempest-AttachVolumeTestJSON-1797241320 None] attachment_update completed successfully. Jul 08 01:43:35 devstack cinder-volume[87134]: DEBUG dbcounter [-] [87134] Writing DB stats cinder:UPDATE=18,cinder:SELECT=29,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87134) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:43:35 devstack cinder-volume[87134]: DEBUG dbcounter [-] [87134] Writing DB stats cinder:SELECT=24,cinder:UPDATE=19,cinder:DELETE=2,cinder:INSERT=3 {{(pid=87134) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:43:52 devstack cinder-volume[87134]: INFO cinder.volume.manager [req-b3ba4b80-7b45-449c-b822-bef409e96b93 req-62b82caa-49bb-48a5-9336-3ea543756672 tempest-ServerActionsTestOtherA-759876420 None] Terminate volume connection completed successfully. Jul 08 01:43:52 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [req-b3ba4b80-7b45-449c-b822-bef409e96b93 req-62b82caa-49bb-48a5-9336-3ea543756672 tempest-ServerActionsTestOtherA-759876420 None] Deleting attachment e98614cb-d207-401c-8f7a-becb13b7a33a. {{(pid=87134) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:43:58 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5bed484-82ec-459b-84fb-a64e5427b59a tempest-AttachVolumeShelveTestJSON-1516805121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:43:58 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b5bed484-82ec-459b-84fb-a64e5427b59a tempest-AttachVolumeShelveTestJSON-1516805121 None] Flow 'volume_create_manager' (7f5c949f-4d91-49b8-9714-f47637d9ef54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:43:58 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b5bed484-82ec-459b-84fb-a64e5427b59a tempest-AttachVolumeShelveTestJSON-1516805121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f9ce955-1fb3-4e33-bc22-7fb3603d516e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:43:58 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b5bed484-82ec-459b-84fb-a64e5427b59a tempest-AttachVolumeShelveTestJSON-1516805121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f9ce955-1fb3-4e33-bc22-7fb3603d516e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:43:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1746538293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=960a8999-476b-4d3a-82a2-c5749411a4d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c93e2e04cf34c818891d7dcb48dae92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:43:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:43:59Z,use_quota=True,user_id='6f400b33cbb743ba99912642c6734664',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:43:58 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b5bed484-82ec-459b-84fb-a64e5427b59a tempest-AttachVolumeShelveTestJSON-1516805121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3cc2b99-bd9f-4da0-94a5-47071863d7cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:43:58 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b5bed484-82ec-459b-84fb-a64e5427b59a tempest-AttachVolumeShelveTestJSON-1516805121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3cc2b99-bd9f-4da0-94a5-47071863d7cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:43:58 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b5bed484-82ec-459b-84fb-a64e5427b59a tempest-AttachVolumeShelveTestJSON-1516805121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a895d7a7-d09e-48aa-9163-69fe236a565c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:43:58 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b5bed484-82ec-459b-84fb-a64e5427b59a tempest-AttachVolumeShelveTestJSON-1516805121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a895d7a7-d09e-48aa-9163-69fe236a565c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '960a8999-476b-4d3a-82a2-c5749411a4d5', 'volume_name': 'volume-960a8999-476b-4d3a-82a2-c5749411a4d5', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:43:58 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b5bed484-82ec-459b-84fb-a64e5427b59a tempest-AttachVolumeShelveTestJSON-1516805121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d377dcdf-6bf4-4d4f-8bcf-461010e0f928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:43:59 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b5bed484-82ec-459b-84fb-a64e5427b59a tempest-AttachVolumeShelveTestJSON-1516805121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d377dcdf-6bf4-4d4f-8bcf-461010e0f928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:43:59 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b5bed484-82ec-459b-84fb-a64e5427b59a tempest-AttachVolumeShelveTestJSON-1516805121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98c38f4d-87f5-4923-888d-6b8419c61e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:43:59 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-b5bed484-82ec-459b-84fb-a64e5427b59a tempest-AttachVolumeShelveTestJSON-1516805121 None] Volume 960a8999-476b-4d3a-82a2-c5749411a4d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-960a8999-476b-4d3a-82a2-c5749411a4d5', 'volume_size': 1} Jul 08 01:43:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b5bed484-82ec-459b-84fb-a64e5427b59a tempest-AttachVolumeShelveTestJSON-1516805121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:43:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b5bed484-82ec-459b-84fb-a64e5427b59a tempest-AttachVolumeShelveTestJSON-1516805121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:43:59 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-b5bed484-82ec-459b-84fb-a64e5427b59a tempest-AttachVolumeShelveTestJSON-1516805121 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:43:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1746538293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=960a8999-476b-4d3a-82a2-c5749411a4d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c93e2e04cf34c818891d7dcb48dae92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:43:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:43:59Z,use_quota=True,user_id='6f400b33cbb743ba99912642c6734664',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:43:59 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-b5bed484-82ec-459b-84fb-a64e5427b59a tempest-AttachVolumeShelveTestJSON-1516805121 None] Creating volume 960a8999-476b-4d3a-82a2-c5749411a4d5 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:43:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b5bed484-82ec-459b-84fb-a64e5427b59a tempest-AttachVolumeShelveTestJSON-1516805121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:43:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b5bed484-82ec-459b-84fb-a64e5427b59a tempest-AttachVolumeShelveTestJSON-1516805121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:43:59 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-b5bed484-82ec-459b-84fb-a64e5427b59a tempest-AttachVolumeShelveTestJSON-1516805121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:43:59 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-b5bed484-82ec-459b-84fb-a64e5427b59a tempest-AttachVolumeShelveTestJSON-1516805121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:43:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b5bed484-82ec-459b-84fb-a64e5427b59a tempest-AttachVolumeShelveTestJSON-1516805121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:43:59 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-b5bed484-82ec-459b-84fb-a64e5427b59a tempest-AttachVolumeShelveTestJSON-1516805121 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:43:59 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-b5bed484-82ec-459b-84fb-a64e5427b59a tempest-AttachVolumeShelveTestJSON-1516805121 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:43:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b5bed484-82ec-459b-84fb-a64e5427b59a tempest-AttachVolumeShelveTestJSON-1516805121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-960a8999-476b-4d3a-82a2-c5749411a4d5 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:43:59 devstack sudo[90991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-960a8999-476b-4d3a-82a2-c5749411a4d5 1073741824 Jul 08 01:43:59 devstack sudo[90991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:00 devstack sudo[90991]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b5bed484-82ec-459b-84fb-a64e5427b59a tempest-AttachVolumeShelveTestJSON-1516805121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-960a8999-476b-4d3a-82a2-c5749411a4d5 1073741824" returned: 0 in 1.355s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b5bed484-82ec-459b-84fb-a64e5427b59a tempest-AttachVolumeShelveTestJSON-1516805121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-960a8999-476b-4d3a-82a2-c5749411a4d5 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:00 devstack sudo[90998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-960a8999-476b-4d3a-82a2-c5749411a4d5 Jul 08 01:44:00 devstack sudo[90998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:01 devstack sudo[90998]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b5bed484-82ec-459b-84fb-a64e5427b59a tempest-AttachVolumeShelveTestJSON-1516805121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-960a8999-476b-4d3a-82a2-c5749411a4d5" returned: 0 in 1.207s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:01 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-b5bed484-82ec-459b-84fb-a64e5427b59a tempest-AttachVolumeShelveTestJSON-1516805121 None] <== create_volume: return (2714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:44:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b5bed484-82ec-459b-84fb-a64e5427b59a tempest-AttachVolumeShelveTestJSON-1516805121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.717s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:44:01 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b5bed484-82ec-459b-84fb-a64e5427b59a tempest-AttachVolumeShelveTestJSON-1516805121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98c38f4d-87f5-4923-888d-6b8419c61e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-960a8999-476b-4d3a-82a2-c5749411a4d5', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:01 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b5bed484-82ec-459b-84fb-a64e5427b59a tempest-AttachVolumeShelveTestJSON-1516805121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b619368-70e0-47cd-8bf8-581553259deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:01 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-b5bed484-82ec-459b-84fb-a64e5427b59a tempest-AttachVolumeShelveTestJSON-1516805121 None] Volume volume-960a8999-476b-4d3a-82a2-c5749411a4d5 (960a8999-476b-4d3a-82a2-c5749411a4d5): created successfully Jul 08 01:44:01 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b5bed484-82ec-459b-84fb-a64e5427b59a tempest-AttachVolumeShelveTestJSON-1516805121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b619368-70e0-47cd-8bf8-581553259deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:01 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b5bed484-82ec-459b-84fb-a64e5427b59a tempest-AttachVolumeShelveTestJSON-1516805121 None] Flow 'volume_create_manager' (7f5c949f-4d91-49b8-9714-f47637d9ef54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:44:01 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-b5bed484-82ec-459b-84fb-a64e5427b59a tempest-AttachVolumeShelveTestJSON-1516805121 None] Created volume successfully. Jul 08 01:44:04 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-c8ae853a-385b-4e48-8a35-bb4083f3e9fc tempest-ServerActionsTestOtherA-759876420 None] Acquiring lock "cinder-7e6b5138-cde7-42f8-8d8f-08b242f3e9cf-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:44:04 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-c8ae853a-385b-4e48-8a35-bb4083f3e9fc tempest-ServerActionsTestOtherA-759876420 None] Lock "cinder-7e6b5138-cde7-42f8-8d8f-08b242f3e9cf-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:44:04 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-c8ae853a-385b-4e48-8a35-bb4083f3e9fc tempest-ServerActionsTestOtherA-759876420 None] Acquiring lock "cinder-quobyte-7e6b5138-cde7-42f8-8d8f-08b242f3e9cf" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:44:04 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-c8ae853a-385b-4e48-8a35-bb4083f3e9fc tempest-ServerActionsTestOtherA-759876420 None] Lock "cinder-quobyte-7e6b5138-cde7-42f8-8d8f-08b242f3e9cf" acquired by "delete_volume" :: waited 0.026s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:44:04 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3573b30-9d71-406b-ad0c-54d50d14c292]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:44:04 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c8ae853a-385b-4e48-8a35-bb4083f3e9fc tempest-ServerActionsTestOtherA-759876420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7e6b5138-cde7-42f8-8d8f-08b242f3e9cf {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:04 devstack sudo[91011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7e6b5138-cde7-42f8-8d8f-08b242f3e9cf Jul 08 01:44:04 devstack sudo[91011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:05 devstack sudo[91011]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:05 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c8ae853a-385b-4e48-8a35-bb4083f3e9fc tempest-ServerActionsTestOtherA-759876420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7e6b5138-cde7-42f8-8d8f-08b242f3e9cf" returned: 0 in 0.927s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:05 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c8ae853a-385b-4e48-8a35-bb4083f3e9fc tempest-ServerActionsTestOtherA-759876420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7e6b5138-cde7-42f8-8d8f-08b242f3e9cf {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:05 devstack sudo[91034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7e6b5138-cde7-42f8-8d8f-08b242f3e9cf Jul 08 01:44:05 devstack sudo[91034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:06 devstack sudo[91034]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:06 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c8ae853a-385b-4e48-8a35-bb4083f3e9fc tempest-ServerActionsTestOtherA-759876420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7e6b5138-cde7-42f8-8d8f-08b242f3e9cf" returned: 0 in 0.858s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:06 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-c8ae853a-385b-4e48-8a35-bb4083f3e9fc tempest-ServerActionsTestOtherA-759876420 None] Lock "cinder-quobyte-7e6b5138-cde7-42f8-8d8f-08b242f3e9cf" released by "delete_volume" :: held 1.848s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:44:06 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-c8ae853a-385b-4e48-8a35-bb4083f3e9fc tempest-ServerActionsTestOtherA-759876420 None] Created reservations ['0ec7e2d7-0e8a-463e-a2e5-eef25af71260', 'd31ab0a9-3c89-4f63-9755-ecbb19ec98b0', '7b77d5f6-4bd1-4777-8245-2bba5afcf78a', '70933e50-b667-45b9-96d7-d51b390987cc'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:44:06 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c8ae853a-385b-4e48-8a35-bb4083f3e9fc tempest-ServerActionsTestOtherA-759876420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:44:06 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c8ae853a-385b-4e48-8a35-bb4083f3e9fc tempest-ServerActionsTestOtherA-759876420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:44:06 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-c8ae853a-385b-4e48-8a35-bb4083f3e9fc tempest-ServerActionsTestOtherA-759876420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:44:06 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-c8ae853a-385b-4e48-8a35-bb4083f3e9fc tempest-ServerActionsTestOtherA-759876420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:44:06 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c8ae853a-385b-4e48-8a35-bb4083f3e9fc tempest-ServerActionsTestOtherA-759876420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:44:06 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c8ae853a-385b-4e48-8a35-bb4083f3e9fc tempest-ServerActionsTestOtherA-759876420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:06 devstack sudo[91047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:44:06 devstack sudo[91047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:07 devstack sudo[91047]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:07 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c8ae853a-385b-4e48-8a35-bb4083f3e9fc tempest-ServerActionsTestOtherA-759876420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.762s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:07 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-c8ae853a-385b-4e48-8a35-bb4083f3e9fc tempest-ServerActionsTestOtherA-759876420 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:44:07 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-c8ae853a-385b-4e48-8a35-bb4083f3e9fc tempest-ServerActionsTestOtherA-759876420 None] Deleted volume successfully. Jul 08 01:44:07 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-c8ae853a-385b-4e48-8a35-bb4083f3e9fc tempest-ServerActionsTestOtherA-759876420 None] Lock "cinder-7e6b5138-cde7-42f8-8d8f-08b242f3e9cf-delete_volume" released by "delete_volume" :: held 2.929s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:44:08 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-e36ddc50-27e2-4185-b513-688fe2782521 tempest-TaggedAttachmentsTest-481431770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:44:08 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e36ddc50-27e2-4185-b513-688fe2782521 tempest-TaggedAttachmentsTest-481431770 None] Flow 'volume_create_manager' (691c159a-a741-4fbc-b22e-feabd8bf0f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:44:08 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e36ddc50-27e2-4185-b513-688fe2782521 tempest-TaggedAttachmentsTest-481431770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dcfc34b-137a-4094-a3cc-5dccccd7de55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:08 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e36ddc50-27e2-4185-b513-688fe2782521 tempest-TaggedAttachmentsTest-481431770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dcfc34b-137a-4094-a3cc-5dccccd7de55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:44:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-305541956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2d414b7-8eb3-4ac3-969e-828a3f899be8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddcb44dd7538445e8cdadc3708a73168',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:44:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:44:08Z,use_quota=True,user_id='e48b95151f844bfc9959722c1bcb1973',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:08 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e36ddc50-27e2-4185-b513-688fe2782521 tempest-TaggedAttachmentsTest-481431770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95d21f93-c984-4a66-a7cc-9dd14ab717ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:08 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e36ddc50-27e2-4185-b513-688fe2782521 tempest-TaggedAttachmentsTest-481431770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95d21f93-c984-4a66-a7cc-9dd14ab717ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:08 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e36ddc50-27e2-4185-b513-688fe2782521 tempest-TaggedAttachmentsTest-481431770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1366942-1292-45fd-b2d0-0cf0333a8fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:08 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e36ddc50-27e2-4185-b513-688fe2782521 tempest-TaggedAttachmentsTest-481431770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1366942-1292-45fd-b2d0-0cf0333a8fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2d414b7-8eb3-4ac3-969e-828a3f899be8', 'volume_name': 'volume-e2d414b7-8eb3-4ac3-969e-828a3f899be8', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:08 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e36ddc50-27e2-4185-b513-688fe2782521 tempest-TaggedAttachmentsTest-481431770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fd92682-1203-48ec-8561-3eec682f4cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:08 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e36ddc50-27e2-4185-b513-688fe2782521 tempest-TaggedAttachmentsTest-481431770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fd92682-1203-48ec-8561-3eec682f4cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:08 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e36ddc50-27e2-4185-b513-688fe2782521 tempest-TaggedAttachmentsTest-481431770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f3b061f-bcad-4351-9ea2-9b7cc3b87656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:08 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-e36ddc50-27e2-4185-b513-688fe2782521 tempest-TaggedAttachmentsTest-481431770 None] Volume e2d414b7-8eb3-4ac3-969e-828a3f899be8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2d414b7-8eb3-4ac3-969e-828a3f899be8', 'volume_size': 1} Jul 08 01:44:08 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e36ddc50-27e2-4185-b513-688fe2782521 tempest-TaggedAttachmentsTest-481431770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:44:08 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e36ddc50-27e2-4185-b513-688fe2782521 tempest-TaggedAttachmentsTest-481431770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:44:08 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-e36ddc50-27e2-4185-b513-688fe2782521 tempest-TaggedAttachmentsTest-481431770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:44:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-305541956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2d414b7-8eb3-4ac3-969e-828a3f899be8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddcb44dd7538445e8cdadc3708a73168',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:44:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:44:08Z,use_quota=True,user_id='e48b95151f844bfc9959722c1bcb1973',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:44:08 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-e36ddc50-27e2-4185-b513-688fe2782521 tempest-TaggedAttachmentsTest-481431770 None] Creating volume e2d414b7-8eb3-4ac3-969e-828a3f899be8 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:44:08 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e36ddc50-27e2-4185-b513-688fe2782521 tempest-TaggedAttachmentsTest-481431770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:44:08 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e36ddc50-27e2-4185-b513-688fe2782521 tempest-TaggedAttachmentsTest-481431770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:44:08 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-e36ddc50-27e2-4185-b513-688fe2782521 tempest-TaggedAttachmentsTest-481431770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:44:08 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-e36ddc50-27e2-4185-b513-688fe2782521 tempest-TaggedAttachmentsTest-481431770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:44:08 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e36ddc50-27e2-4185-b513-688fe2782521 tempest-TaggedAttachmentsTest-481431770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:44:08 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-e36ddc50-27e2-4185-b513-688fe2782521 tempest-TaggedAttachmentsTest-481431770 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:44:08 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-e36ddc50-27e2-4185-b513-688fe2782521 tempest-TaggedAttachmentsTest-481431770 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:44:08 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e36ddc50-27e2-4185-b513-688fe2782521 tempest-TaggedAttachmentsTest-481431770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e2d414b7-8eb3-4ac3-969e-828a3f899be8 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:08 devstack sudo[91062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e2d414b7-8eb3-4ac3-969e-828a3f899be8 1073741824 Jul 08 01:44:08 devstack sudo[91062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:09 devstack sudo[91062]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:09 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e36ddc50-27e2-4185-b513-688fe2782521 tempest-TaggedAttachmentsTest-481431770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e2d414b7-8eb3-4ac3-969e-828a3f899be8 1073741824" returned: 0 in 1.301s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:09 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e36ddc50-27e2-4185-b513-688fe2782521 tempest-TaggedAttachmentsTest-481431770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e2d414b7-8eb3-4ac3-969e-828a3f899be8 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:09 devstack sudo[91085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e2d414b7-8eb3-4ac3-969e-828a3f899be8 Jul 08 01:44:09 devstack sudo[91085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:10 devstack sudo[91085]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:10 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e36ddc50-27e2-4185-b513-688fe2782521 tempest-TaggedAttachmentsTest-481431770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e2d414b7-8eb3-4ac3-969e-828a3f899be8" returned: 0 in 1.097s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:10 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-e36ddc50-27e2-4185-b513-688fe2782521 tempest-TaggedAttachmentsTest-481431770 None] <== create_volume: return (2471ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:44:10 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e36ddc50-27e2-4185-b513-688fe2782521 tempest-TaggedAttachmentsTest-481431770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.475s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:44:10 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e36ddc50-27e2-4185-b513-688fe2782521 tempest-TaggedAttachmentsTest-481431770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f3b061f-bcad-4351-9ea2-9b7cc3b87656) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2d414b7-8eb3-4ac3-969e-828a3f899be8', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:10 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e36ddc50-27e2-4185-b513-688fe2782521 tempest-TaggedAttachmentsTest-481431770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f1218d3-cc32-4d13-8eaa-e643dbe9dd8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:44:10 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-e36ddc50-27e2-4185-b513-688fe2782521 tempest-TaggedAttachmentsTest-481431770 None] Volume volume-e2d414b7-8eb3-4ac3-969e-828a3f899be8 (e2d414b7-8eb3-4ac3-969e-828a3f899be8): created successfully Jul 08 01:44:10 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e36ddc50-27e2-4185-b513-688fe2782521 tempest-TaggedAttachmentsTest-481431770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f1218d3-cc32-4d13-8eaa-e643dbe9dd8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:44:10 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e36ddc50-27e2-4185-b513-688fe2782521 tempest-TaggedAttachmentsTest-481431770 None] Flow 'volume_create_manager' (691c159a-a741-4fbc-b22e-feabd8bf0f03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:44:10 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-e36ddc50-27e2-4185-b513-688fe2782521 tempest-TaggedAttachmentsTest-481431770 None] Created volume successfully. Jul 08 01:44:12 devstack cinder-volume[87134]: INFO cinder.volume.manager [req-9fb9bf4d-335f-45cf-8fa2-5c6ef792d274 req-1d9eb91b-1b3e-4597-81f8-158365ceca51 tempest-AttachVolumeTestJSON-1797241320 None] Terminate volume connection completed successfully. Jul 08 01:44:12 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [req-9fb9bf4d-335f-45cf-8fa2-5c6ef792d274 req-1d9eb91b-1b3e-4597-81f8-158365ceca51 tempest-AttachVolumeTestJSON-1797241320 None] Deleting attachment b3b9ab84-1af7-49d3-9c62-c13c5125a090. {{(pid=87134) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:44:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [req-b8949ea5-2fb6-475f-a58f-230f2670f7c6 req-877de96f-7b0a-49ca-b8eb-e0eb6e63f933 tempest-AttachVolumeShelveTestJSON-1516805121 None] No connector for attachment cf4d2b7a-fee8-415c-a3f0-5d156aec5885; skipping storage backend terminate_connection call. {{(pid=87134) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 08 01:44:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [req-b8949ea5-2fb6-475f-a58f-230f2670f7c6 req-877de96f-7b0a-49ca-b8eb-e0eb6e63f933 tempest-AttachVolumeShelveTestJSON-1516805121 None] Deleting attachment cf4d2b7a-fee8-415c-a3f0-5d156aec5885. {{(pid=87134) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:44:20 devstack cinder-volume[87134]: DEBUG oslo_service.periodic_task [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87134) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:44:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:44:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:44:20 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:44:20 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:44:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:44:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:44:20 devstack sudo[91174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:44:20 devstack sudo[91174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:44:22 devstack sudo[91174]: pam_unix(sudo:session): session closed for user root Jul 08 01:44:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 1.297s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:44:22 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:44:22 devstack cinder-volume[87134]: DEBUG oslo_service.periodic_task [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running periodic task VolumeManager._thread_info {{(pid=87134) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:44:22 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] thread count: 8 {{(pid=87134) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:44:22 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] thread info: [<_MainThread(MainThread, started 129378964615296)>, , , , , , , ] {{(pid=87134) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:44:22 devstack cinder-volume[87134]: DEBUG dbcounter [-] [87134] Writing DB stats cinder:SELECT=14,cinder:UPDATE=15,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87134) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:44:30 devstack cinder-volume[87134]: DEBUG dbcounter [-] [87134] Writing DB stats cinder:SELECT=11,cinder:UPDATE=14,cinder:INSERT=2,cinder:DELETE=2 {{(pid=87134) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:45:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-c856c1a2-457c-435c-8a69-bb0bf2c02eb3 req-d97525f8-348c-4c03-9fb0-fd630a0859f6 tempest-TaggedAttachmentsTest-481431770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:45:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-c856c1a2-457c-435c-8a69-bb0bf2c02eb3 req-d97525f8-348c-4c03-9fb0-fd630a0859f6 tempest-TaggedAttachmentsTest-481431770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:45:13 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a62fe57-f32d-4ebd-bf30-97c20de54222]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:45:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-c856c1a2-457c-435c-8a69-bb0bf2c02eb3 req-d97525f8-348c-4c03-9fb0-fd630a0859f6 tempest-TaggedAttachmentsTest-481431770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e2d414b7-8eb3-4ac3-969e-828a3f899be8 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:13 devstack sudo[91805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e2d414b7-8eb3-4ac3-969e-828a3f899be8 Jul 08 01:45:13 devstack sudo[91805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:14 devstack sudo[91805]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:14 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-c856c1a2-457c-435c-8a69-bb0bf2c02eb3 req-d97525f8-348c-4c03-9fb0-fd630a0859f6 tempest-TaggedAttachmentsTest-481431770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e2d414b7-8eb3-4ac3-969e-828a3f899be8" returned: 0 in 1.101s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:14 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-c856c1a2-457c-435c-8a69-bb0bf2c02eb3 req-d97525f8-348c-4c03-9fb0-fd630a0859f6 tempest-TaggedAttachmentsTest-481431770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.146s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:45:14 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [req-c856c1a2-457c-435c-8a69-bb0bf2c02eb3 req-d97525f8-348c-4c03-9fb0-fd630a0859f6 tempest-TaggedAttachmentsTest-481431770 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17', 'name': 'volume-e2d414b7-8eb3-4ac3-969e-828a3f899be8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '14db4c35-d1c2-4a0a-9c85-5a8b6fed61ad', 'enforce_multipath': True} {{(pid=87134) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:45:14 devstack cinder-volume[87134]: INFO cinder.volume.manager [req-c856c1a2-457c-435c-8a69-bb0bf2c02eb3 req-d97525f8-348c-4c03-9fb0-fd630a0859f6 tempest-TaggedAttachmentsTest-481431770 None] attachment_update completed successfully. Jul 08 01:45:18 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-38f7a286-cc4f-482c-b3ad-2a50a536d50e tempest-AttachVolumeShelveTestJSON-1516805121 None] Acquiring lock "cinder-960a8999-476b-4d3a-82a2-c5749411a4d5-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:45:18 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-38f7a286-cc4f-482c-b3ad-2a50a536d50e tempest-AttachVolumeShelveTestJSON-1516805121 None] Lock "cinder-960a8999-476b-4d3a-82a2-c5749411a4d5-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:45:18 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-38f7a286-cc4f-482c-b3ad-2a50a536d50e tempest-AttachVolumeShelveTestJSON-1516805121 None] Acquiring lock "cinder-quobyte-960a8999-476b-4d3a-82a2-c5749411a4d5" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:45:18 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-38f7a286-cc4f-482c-b3ad-2a50a536d50e tempest-AttachVolumeShelveTestJSON-1516805121 None] Lock "cinder-quobyte-960a8999-476b-4d3a-82a2-c5749411a4d5" acquired by "delete_volume" :: waited 0.061s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:45:18 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb86a10-a420-4a89-9361-38f26db4485d]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:45:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-38f7a286-cc4f-482c-b3ad-2a50a536d50e tempest-AttachVolumeShelveTestJSON-1516805121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-960a8999-476b-4d3a-82a2-c5749411a4d5 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:19 devstack sudo[92296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-960a8999-476b-4d3a-82a2-c5749411a4d5 Jul 08 01:45:19 devstack sudo[92296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:20 devstack sudo[92296]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-38f7a286-cc4f-482c-b3ad-2a50a536d50e tempest-AttachVolumeShelveTestJSON-1516805121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-960a8999-476b-4d3a-82a2-c5749411a4d5" returned: 0 in 1.837s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-38f7a286-cc4f-482c-b3ad-2a50a536d50e tempest-AttachVolumeShelveTestJSON-1516805121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-960a8999-476b-4d3a-82a2-c5749411a4d5 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:20 devstack sudo[92360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-960a8999-476b-4d3a-82a2-c5749411a4d5 Jul 08 01:45:20 devstack sudo[92360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:20 devstack cinder-volume[87134]: DEBUG oslo_service.periodic_task [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87134) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:45:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:45:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:45:20 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:45:20 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:45:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:45:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:20 devstack sudo[92363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:45:20 devstack sudo[92363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:22 devstack sudo[92360]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-38f7a286-cc4f-482c-b3ad-2a50a536d50e tempest-AttachVolumeShelveTestJSON-1516805121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-960a8999-476b-4d3a-82a2-c5749411a4d5" returned: 0 in 1.425s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:22 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-38f7a286-cc4f-482c-b3ad-2a50a536d50e tempest-AttachVolumeShelveTestJSON-1516805121 None] Lock "cinder-quobyte-960a8999-476b-4d3a-82a2-c5749411a4d5" released by "delete_volume" :: held 3.379s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:45:22 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-38f7a286-cc4f-482c-b3ad-2a50a536d50e tempest-AttachVolumeShelveTestJSON-1516805121 None] Created reservations ['99de76ef-208b-4669-8589-c6b9f885ff8f', 'bec169bd-f634-422c-9572-2c0aadc59b79', '48ce7236-bb25-43b7-9445-877c81720e91', '751d3192-d4e8-461b-a4d6-49d8389d35f2'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:45:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-38f7a286-cc4f-482c-b3ad-2a50a536d50e tempest-AttachVolumeShelveTestJSON-1516805121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:45:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-38f7a286-cc4f-482c-b3ad-2a50a536d50e tempest-AttachVolumeShelveTestJSON-1516805121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:45:22 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-38f7a286-cc4f-482c-b3ad-2a50a536d50e tempest-AttachVolumeShelveTestJSON-1516805121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:45:22 devstack sudo[92363]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:22 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-38f7a286-cc4f-482c-b3ad-2a50a536d50e tempest-AttachVolumeShelveTestJSON-1516805121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:45:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-38f7a286-cc4f-482c-b3ad-2a50a536d50e tempest-AttachVolumeShelveTestJSON-1516805121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:45:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-38f7a286-cc4f-482c-b3ad-2a50a536d50e tempest-AttachVolumeShelveTestJSON-1516805121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 1.703s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:22 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:45:22 devstack cinder-volume[87134]: DEBUG oslo_service.periodic_task [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running periodic task VolumeManager._thread_info {{(pid=87134) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:45:22 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] thread count: 8 {{(pid=87134) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:45:22 devstack sudo[92372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:45:22 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] thread info: [<_MainThread(MainThread, started 129378964615296)>, , , , , , , ] {{(pid=87134) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:45:22 devstack sudo[92372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:23 devstack sudo[92372]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:23 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-38f7a286-cc4f-482c-b3ad-2a50a536d50e tempest-AttachVolumeShelveTestJSON-1516805121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 1.048s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:23 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-38f7a286-cc4f-482c-b3ad-2a50a536d50e tempest-AttachVolumeShelveTestJSON-1516805121 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:45:23 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-38f7a286-cc4f-482c-b3ad-2a50a536d50e tempest-AttachVolumeShelveTestJSON-1516805121 None] Deleted volume successfully. Jul 08 01:45:23 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-38f7a286-cc4f-482c-b3ad-2a50a536d50e tempest-AttachVolumeShelveTestJSON-1516805121 None] Lock "cinder-960a8999-476b-4d3a-82a2-c5749411a4d5-delete_volume" released by "delete_volume" :: held 5.081s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:45:25 devstack cinder-volume[87134]: INFO cinder.volume.manager [req-b0fcd9c2-9245-475a-8348-679ca77cb998 req-6bcffad4-6278-45c5-b7e1-f97b1b0d6628 tempest-TaggedAttachmentsTest-481431770 None] Terminate volume connection completed successfully. Jul 08 01:45:25 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [req-b0fcd9c2-9245-475a-8348-679ca77cb998 req-6bcffad4-6278-45c5-b7e1-f97b1b0d6628 tempest-TaggedAttachmentsTest-481431770 None] Deleting attachment 14db4c35-d1c2-4a0a-9c85-5a8b6fed61ad. {{(pid=87134) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:45:34 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b41c5da-793a-4969-8f4a-f78545786458 tempest-ServersNegativeTestJSON-797912140 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:45:34 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-9b41c5da-793a-4969-8f4a-f78545786458 tempest-ServersNegativeTestJSON-797912140 None] Flow 'volume_create_manager' (d26e5df9-30d3-40cb-9f07-61990b6a8bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:45:34 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-9b41c5da-793a-4969-8f4a-f78545786458 tempest-ServersNegativeTestJSON-797912140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23a0bf1f-2f12-4912-a25d-f1da364b375f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:34 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-9b41c5da-793a-4969-8f4a-f78545786458 tempest-ServersNegativeTestJSON-797912140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23a0bf1f-2f12-4912-a25d-f1da364b375f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:45:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1439780531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d76cbc25-41ce-4c5e-a4b4-57c7db7610b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17f12c8061c4417ab02030f7b17e9852',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:45:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:45:34Z,use_quota=True,user_id='0b8a152bf5ad4229a75a25f6eae8d82b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:34 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-9b41c5da-793a-4969-8f4a-f78545786458 tempest-ServersNegativeTestJSON-797912140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (488a12cf-5bda-4b74-82e9-2f1255fa92dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:34 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-9b41c5da-793a-4969-8f4a-f78545786458 tempest-ServersNegativeTestJSON-797912140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (488a12cf-5bda-4b74-82e9-2f1255fa92dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:34 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-9b41c5da-793a-4969-8f4a-f78545786458 tempest-ServersNegativeTestJSON-797912140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ea5dba4-2ce9-4adb-9ca3-312250d95f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:34 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-9b41c5da-793a-4969-8f4a-f78545786458 tempest-ServersNegativeTestJSON-797912140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ea5dba4-2ce9-4adb-9ca3-312250d95f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd76cbc25-41ce-4c5e-a4b4-57c7db7610b4', 'volume_name': 'volume-d76cbc25-41ce-4c5e-a4b4-57c7db7610b4', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:34 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-9b41c5da-793a-4969-8f4a-f78545786458 tempest-ServersNegativeTestJSON-797912140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6b85c70-e09b-410c-8f0a-ec921a4b331b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:34 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-9b41c5da-793a-4969-8f4a-f78545786458 tempest-ServersNegativeTestJSON-797912140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6b85c70-e09b-410c-8f0a-ec921a4b331b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:34 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-9b41c5da-793a-4969-8f4a-f78545786458 tempest-ServersNegativeTestJSON-797912140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83f1a77b-382c-45c6-a418-2e4ee58daea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:34 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-9b41c5da-793a-4969-8f4a-f78545786458 tempest-ServersNegativeTestJSON-797912140 None] Volume d76cbc25-41ce-4c5e-a4b4-57c7db7610b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d76cbc25-41ce-4c5e-a4b4-57c7db7610b4', 'volume_size': 1} Jul 08 01:45:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-9b41c5da-793a-4969-8f4a-f78545786458 tempest-ServersNegativeTestJSON-797912140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:45:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-9b41c5da-793a-4969-8f4a-f78545786458 tempest-ServersNegativeTestJSON-797912140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:45:34 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-9b41c5da-793a-4969-8f4a-f78545786458 tempest-ServersNegativeTestJSON-797912140 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:45:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1439780531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d76cbc25-41ce-4c5e-a4b4-57c7db7610b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17f12c8061c4417ab02030f7b17e9852',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:45:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:45:34Z,use_quota=True,user_id='0b8a152bf5ad4229a75a25f6eae8d82b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:45:34 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-9b41c5da-793a-4969-8f4a-f78545786458 tempest-ServersNegativeTestJSON-797912140 None] Creating volume d76cbc25-41ce-4c5e-a4b4-57c7db7610b4 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:45:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-9b41c5da-793a-4969-8f4a-f78545786458 tempest-ServersNegativeTestJSON-797912140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:45:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-9b41c5da-793a-4969-8f4a-f78545786458 tempest-ServersNegativeTestJSON-797912140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:45:34 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-9b41c5da-793a-4969-8f4a-f78545786458 tempest-ServersNegativeTestJSON-797912140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:45:34 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-9b41c5da-793a-4969-8f4a-f78545786458 tempest-ServersNegativeTestJSON-797912140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:45:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-9b41c5da-793a-4969-8f4a-f78545786458 tempest-ServersNegativeTestJSON-797912140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:45:34 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-9b41c5da-793a-4969-8f4a-f78545786458 tempest-ServersNegativeTestJSON-797912140 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:45:34 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-9b41c5da-793a-4969-8f4a-f78545786458 tempest-ServersNegativeTestJSON-797912140 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:45:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9b41c5da-793a-4969-8f4a-f78545786458 tempest-ServersNegativeTestJSON-797912140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d76cbc25-41ce-4c5e-a4b4-57c7db7610b4 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:34 devstack sudo[92458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d76cbc25-41ce-4c5e-a4b4-57c7db7610b4 1073741824 Jul 08 01:45:34 devstack sudo[92458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:35 devstack sudo[92458]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9b41c5da-793a-4969-8f4a-f78545786458 tempest-ServersNegativeTestJSON-797912140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d76cbc25-41ce-4c5e-a4b4-57c7db7610b4 1073741824" returned: 0 in 1.433s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9b41c5da-793a-4969-8f4a-f78545786458 tempest-ServersNegativeTestJSON-797912140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d76cbc25-41ce-4c5e-a4b4-57c7db7610b4 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:36 devstack sudo[92464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d76cbc25-41ce-4c5e-a4b4-57c7db7610b4 Jul 08 01:45:36 devstack sudo[92464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:36 devstack sudo[92464]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9b41c5da-793a-4969-8f4a-f78545786458 tempest-ServersNegativeTestJSON-797912140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d76cbc25-41ce-4c5e-a4b4-57c7db7610b4" returned: 0 in 0.849s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:36 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-9b41c5da-793a-4969-8f4a-f78545786458 tempest-ServersNegativeTestJSON-797912140 None] <== create_volume: return (2341ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:45:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-9b41c5da-793a-4969-8f4a-f78545786458 tempest-ServersNegativeTestJSON-797912140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.347s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:45:36 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-9b41c5da-793a-4969-8f4a-f78545786458 tempest-ServersNegativeTestJSON-797912140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83f1a77b-382c-45c6-a418-2e4ee58daea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d76cbc25-41ce-4c5e-a4b4-57c7db7610b4', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:36 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-9b41c5da-793a-4969-8f4a-f78545786458 tempest-ServersNegativeTestJSON-797912140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74924881-45bf-4e77-9ad6-09a437f8f69e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:36 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-9b41c5da-793a-4969-8f4a-f78545786458 tempest-ServersNegativeTestJSON-797912140 None] Volume volume-d76cbc25-41ce-4c5e-a4b4-57c7db7610b4 (d76cbc25-41ce-4c5e-a4b4-57c7db7610b4): created successfully Jul 08 01:45:36 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-9b41c5da-793a-4969-8f4a-f78545786458 tempest-ServersNegativeTestJSON-797912140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74924881-45bf-4e77-9ad6-09a437f8f69e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:36 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-9b41c5da-793a-4969-8f4a-f78545786458 tempest-ServersNegativeTestJSON-797912140 None] Flow 'volume_create_manager' (d26e5df9-30d3-40cb-9f07-61990b6a8bec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:45:37 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-9b41c5da-793a-4969-8f4a-f78545786458 tempest-ServersNegativeTestJSON-797912140 None] Created volume successfully. Jul 08 01:45:39 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2d0f886-efe4-44f4-80d9-ee4e73e738b2 tempest-ServersNegativeTestJSON-797912140 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:45:39 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f2d0f886-efe4-44f4-80d9-ee4e73e738b2 tempest-ServersNegativeTestJSON-797912140 None] Flow 'volume_create_manager' (6a1d621e-fc08-48a5-bc04-2199099d64fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:45:39 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f2d0f886-efe4-44f4-80d9-ee4e73e738b2 tempest-ServersNegativeTestJSON-797912140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16aefeb8-f8e1-407f-9d30-db19592b2711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:39 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f2d0f886-efe4-44f4-80d9-ee4e73e738b2 tempest-ServersNegativeTestJSON-797912140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16aefeb8-f8e1-407f-9d30-db19592b2711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:45:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-888385345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1740fac-8dbc-4b2c-96ea-c4cfa0f478e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17f12c8061c4417ab02030f7b17e9852',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:45:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:45:40Z,use_quota=True,user_id='0b8a152bf5ad4229a75a25f6eae8d82b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:39 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f2d0f886-efe4-44f4-80d9-ee4e73e738b2 tempest-ServersNegativeTestJSON-797912140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61ec0ad8-722e-4c7c-aa9a-f75e627fb411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:39 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f2d0f886-efe4-44f4-80d9-ee4e73e738b2 tempest-ServersNegativeTestJSON-797912140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61ec0ad8-722e-4c7c-aa9a-f75e627fb411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:39 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f2d0f886-efe4-44f4-80d9-ee4e73e738b2 tempest-ServersNegativeTestJSON-797912140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3903e2c6-77e1-42a0-be80-3950b08beba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:39 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f2d0f886-efe4-44f4-80d9-ee4e73e738b2 tempest-ServersNegativeTestJSON-797912140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3903e2c6-77e1-42a0-be80-3950b08beba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1740fac-8dbc-4b2c-96ea-c4cfa0f478e0', 'volume_name': 'volume-d1740fac-8dbc-4b2c-96ea-c4cfa0f478e0', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:39 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f2d0f886-efe4-44f4-80d9-ee4e73e738b2 tempest-ServersNegativeTestJSON-797912140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feb8010f-89a5-40aa-851b-bfa2895a2356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:39 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f2d0f886-efe4-44f4-80d9-ee4e73e738b2 tempest-ServersNegativeTestJSON-797912140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feb8010f-89a5-40aa-851b-bfa2895a2356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:39 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f2d0f886-efe4-44f4-80d9-ee4e73e738b2 tempest-ServersNegativeTestJSON-797912140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (677e9794-7cfd-4308-8960-8d8069ddf798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:39 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-f2d0f886-efe4-44f4-80d9-ee4e73e738b2 tempest-ServersNegativeTestJSON-797912140 None] Volume d1740fac-8dbc-4b2c-96ea-c4cfa0f478e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1740fac-8dbc-4b2c-96ea-c4cfa0f478e0', 'volume_size': 1} Jul 08 01:45:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-f2d0f886-efe4-44f4-80d9-ee4e73e738b2 tempest-ServersNegativeTestJSON-797912140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:45:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-f2d0f886-efe4-44f4-80d9-ee4e73e738b2 tempest-ServersNegativeTestJSON-797912140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:45:39 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-f2d0f886-efe4-44f4-80d9-ee4e73e738b2 tempest-ServersNegativeTestJSON-797912140 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:45:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-888385345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1740fac-8dbc-4b2c-96ea-c4cfa0f478e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17f12c8061c4417ab02030f7b17e9852',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:45:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:45:40Z,use_quota=True,user_id='0b8a152bf5ad4229a75a25f6eae8d82b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:45:39 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-f2d0f886-efe4-44f4-80d9-ee4e73e738b2 tempest-ServersNegativeTestJSON-797912140 None] Creating volume d1740fac-8dbc-4b2c-96ea-c4cfa0f478e0 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:45:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-f2d0f886-efe4-44f4-80d9-ee4e73e738b2 tempest-ServersNegativeTestJSON-797912140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:45:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-f2d0f886-efe4-44f4-80d9-ee4e73e738b2 tempest-ServersNegativeTestJSON-797912140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:45:39 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-f2d0f886-efe4-44f4-80d9-ee4e73e738b2 tempest-ServersNegativeTestJSON-797912140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:45:39 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-f2d0f886-efe4-44f4-80d9-ee4e73e738b2 tempest-ServersNegativeTestJSON-797912140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:45:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-f2d0f886-efe4-44f4-80d9-ee4e73e738b2 tempest-ServersNegativeTestJSON-797912140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:45:39 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-f2d0f886-efe4-44f4-80d9-ee4e73e738b2 tempest-ServersNegativeTestJSON-797912140 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:45:39 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-f2d0f886-efe4-44f4-80d9-ee4e73e738b2 tempest-ServersNegativeTestJSON-797912140 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:45:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f2d0f886-efe4-44f4-80d9-ee4e73e738b2 tempest-ServersNegativeTestJSON-797912140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d1740fac-8dbc-4b2c-96ea-c4cfa0f478e0 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:39 devstack sudo[92513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d1740fac-8dbc-4b2c-96ea-c4cfa0f478e0 1073741824 Jul 08 01:45:39 devstack sudo[92513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:40 devstack sudo[92513]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f2d0f886-efe4-44f4-80d9-ee4e73e738b2 tempest-ServersNegativeTestJSON-797912140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d1740fac-8dbc-4b2c-96ea-c4cfa0f478e0 1073741824" returned: 0 in 0.992s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f2d0f886-efe4-44f4-80d9-ee4e73e738b2 tempest-ServersNegativeTestJSON-797912140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d1740fac-8dbc-4b2c-96ea-c4cfa0f478e0 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:40 devstack sudo[92519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d1740fac-8dbc-4b2c-96ea-c4cfa0f478e0 Jul 08 01:45:40 devstack sudo[92519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:41 devstack sudo[92519]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f2d0f886-efe4-44f4-80d9-ee4e73e738b2 tempest-ServersNegativeTestJSON-797912140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d1740fac-8dbc-4b2c-96ea-c4cfa0f478e0" returned: 0 in 0.770s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:41 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-f2d0f886-efe4-44f4-80d9-ee4e73e738b2 tempest-ServersNegativeTestJSON-797912140 None] <== create_volume: return (1810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:45:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-f2d0f886-efe4-44f4-80d9-ee4e73e738b2 tempest-ServersNegativeTestJSON-797912140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.812s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:45:41 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f2d0f886-efe4-44f4-80d9-ee4e73e738b2 tempest-ServersNegativeTestJSON-797912140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (677e9794-7cfd-4308-8960-8d8069ddf798) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1740fac-8dbc-4b2c-96ea-c4cfa0f478e0', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:41 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f2d0f886-efe4-44f4-80d9-ee4e73e738b2 tempest-ServersNegativeTestJSON-797912140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2568250-5918-4804-8cbf-d951bd691eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:41 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-f2d0f886-efe4-44f4-80d9-ee4e73e738b2 tempest-ServersNegativeTestJSON-797912140 None] Volume volume-d1740fac-8dbc-4b2c-96ea-c4cfa0f478e0 (d1740fac-8dbc-4b2c-96ea-c4cfa0f478e0): created successfully Jul 08 01:45:41 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f2d0f886-efe4-44f4-80d9-ee4e73e738b2 tempest-ServersNegativeTestJSON-797912140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2568250-5918-4804-8cbf-d951bd691eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:41 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f2d0f886-efe4-44f4-80d9-ee4e73e738b2 tempest-ServersNegativeTestJSON-797912140 None] Flow 'volume_create_manager' (6a1d621e-fc08-48a5-bc04-2199099d64fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:45:41 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-f2d0f886-efe4-44f4-80d9-ee4e73e738b2 tempest-ServersNegativeTestJSON-797912140 None] Created volume successfully. Jul 08 01:45:44 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-58a1e12d-e13d-4a74-a3fc-a2affdc70d37 tempest-ServersNegativeTestJSON-797912140 None] Acquiring lock "cinder-d1740fac-8dbc-4b2c-96ea-c4cfa0f478e0-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:45:44 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-58a1e12d-e13d-4a74-a3fc-a2affdc70d37 tempest-ServersNegativeTestJSON-797912140 None] Lock "cinder-d1740fac-8dbc-4b2c-96ea-c4cfa0f478e0-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:45:44 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-58a1e12d-e13d-4a74-a3fc-a2affdc70d37 tempest-ServersNegativeTestJSON-797912140 None] Acquiring lock "cinder-quobyte-d1740fac-8dbc-4b2c-96ea-c4cfa0f478e0" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:45:44 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-58a1e12d-e13d-4a74-a3fc-a2affdc70d37 tempest-ServersNegativeTestJSON-797912140 None] Lock "cinder-quobyte-d1740fac-8dbc-4b2c-96ea-c4cfa0f478e0" acquired by "delete_volume" :: waited 0.027s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:45:44 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b0a69f-65e7-4fbb-9f68-a68759e13c9b]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:45:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-58a1e12d-e13d-4a74-a3fc-a2affdc70d37 tempest-ServersNegativeTestJSON-797912140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d1740fac-8dbc-4b2c-96ea-c4cfa0f478e0 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:44 devstack sudo[92523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d1740fac-8dbc-4b2c-96ea-c4cfa0f478e0 Jul 08 01:45:44 devstack sudo[92523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:45 devstack sudo[92523]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-58a1e12d-e13d-4a74-a3fc-a2affdc70d37 tempest-ServersNegativeTestJSON-797912140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d1740fac-8dbc-4b2c-96ea-c4cfa0f478e0" returned: 0 in 1.570s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-58a1e12d-e13d-4a74-a3fc-a2affdc70d37 tempest-ServersNegativeTestJSON-797912140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d1740fac-8dbc-4b2c-96ea-c4cfa0f478e0 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:46 devstack sudo[92529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d1740fac-8dbc-4b2c-96ea-c4cfa0f478e0 Jul 08 01:45:46 devstack sudo[92529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:47 devstack sudo[92529]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-58a1e12d-e13d-4a74-a3fc-a2affdc70d37 tempest-ServersNegativeTestJSON-797912140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d1740fac-8dbc-4b2c-96ea-c4cfa0f478e0" returned: 0 in 1.033s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:47 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-58a1e12d-e13d-4a74-a3fc-a2affdc70d37 tempest-ServersNegativeTestJSON-797912140 None] Lock "cinder-quobyte-d1740fac-8dbc-4b2c-96ea-c4cfa0f478e0" released by "delete_volume" :: held 2.685s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:45:47 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-58a1e12d-e13d-4a74-a3fc-a2affdc70d37 tempest-ServersNegativeTestJSON-797912140 None] Created reservations ['90c24d36-dd13-4d05-b100-3c0810477cd1', '91dc66e6-9ec5-4f0c-bca6-2c0abaf509de', 'ee1ad457-5f50-4524-a556-d749360e620c', '918607a4-f705-41b9-b9ca-9ee2421144e4'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:45:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-58a1e12d-e13d-4a74-a3fc-a2affdc70d37 tempest-ServersNegativeTestJSON-797912140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:45:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-58a1e12d-e13d-4a74-a3fc-a2affdc70d37 tempest-ServersNegativeTestJSON-797912140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:45:47 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-58a1e12d-e13d-4a74-a3fc-a2affdc70d37 tempest-ServersNegativeTestJSON-797912140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:45:47 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-58a1e12d-e13d-4a74-a3fc-a2affdc70d37 tempest-ServersNegativeTestJSON-797912140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:45:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-58a1e12d-e13d-4a74-a3fc-a2affdc70d37 tempest-ServersNegativeTestJSON-797912140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:45:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-58a1e12d-e13d-4a74-a3fc-a2affdc70d37 tempest-ServersNegativeTestJSON-797912140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:47 devstack sudo[92534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:45:47 devstack sudo[92534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:47 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-81280a15-f591-46b2-8b1a-5a4e79582b5c tempest-AttachVolumeTestJSON-1797241320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:45:47 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-81280a15-f591-46b2-8b1a-5a4e79582b5c tempest-AttachVolumeTestJSON-1797241320 None] Flow 'volume_create_manager' (650677b9-16a1-456e-957d-b79f486c358f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:45:47 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-81280a15-f591-46b2-8b1a-5a4e79582b5c tempest-AttachVolumeTestJSON-1797241320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c8a2452-9115-48b8-9e4d-0fa9411a2af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:47 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-81280a15-f591-46b2-8b1a-5a4e79582b5c tempest-AttachVolumeTestJSON-1797241320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c8a2452-9115-48b8-9e4d-0fa9411a2af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:45:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1975766647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3073e016-9d88-4724-a234-a17a83eeeeb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='140660a969d943bb9e00ad55f0d190e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:45:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:45:48Z,use_quota=True,user_id='c5c6b353c9bc4b8887e7113f648b541b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:47 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-81280a15-f591-46b2-8b1a-5a4e79582b5c tempest-AttachVolumeTestJSON-1797241320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1beb02b-5847-4fdc-9d93-938fb70ccc33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:47 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-81280a15-f591-46b2-8b1a-5a4e79582b5c tempest-AttachVolumeTestJSON-1797241320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1beb02b-5847-4fdc-9d93-938fb70ccc33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:47 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-81280a15-f591-46b2-8b1a-5a4e79582b5c tempest-AttachVolumeTestJSON-1797241320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a68e32a5-70c1-4cea-b460-ade812c582fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:47 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-81280a15-f591-46b2-8b1a-5a4e79582b5c tempest-AttachVolumeTestJSON-1797241320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a68e32a5-70c1-4cea-b460-ade812c582fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3073e016-9d88-4724-a234-a17a83eeeeb7', 'volume_name': 'volume-3073e016-9d88-4724-a234-a17a83eeeeb7', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:47 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-81280a15-f591-46b2-8b1a-5a4e79582b5c tempest-AttachVolumeTestJSON-1797241320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ba89ad0-e760-44f5-be0c-91c784a21ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:47 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-81280a15-f591-46b2-8b1a-5a4e79582b5c tempest-AttachVolumeTestJSON-1797241320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ba89ad0-e760-44f5-be0c-91c784a21ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:47 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-81280a15-f591-46b2-8b1a-5a4e79582b5c tempest-AttachVolumeTestJSON-1797241320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd949180-e616-45f1-83b3-de18697cb206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:47 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-81280a15-f591-46b2-8b1a-5a4e79582b5c tempest-AttachVolumeTestJSON-1797241320 None] Volume 3073e016-9d88-4724-a234-a17a83eeeeb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3073e016-9d88-4724-a234-a17a83eeeeb7', 'volume_size': 1} Jul 08 01:45:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-81280a15-f591-46b2-8b1a-5a4e79582b5c tempest-AttachVolumeTestJSON-1797241320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:45:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-81280a15-f591-46b2-8b1a-5a4e79582b5c tempest-AttachVolumeTestJSON-1797241320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:45:47 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-81280a15-f591-46b2-8b1a-5a4e79582b5c tempest-AttachVolumeTestJSON-1797241320 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:45:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1975766647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3073e016-9d88-4724-a234-a17a83eeeeb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='140660a969d943bb9e00ad55f0d190e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:45:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:45:48Z,use_quota=True,user_id='c5c6b353c9bc4b8887e7113f648b541b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:45:47 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-81280a15-f591-46b2-8b1a-5a4e79582b5c tempest-AttachVolumeTestJSON-1797241320 None] Creating volume 3073e016-9d88-4724-a234-a17a83eeeeb7 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:45:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-81280a15-f591-46b2-8b1a-5a4e79582b5c tempest-AttachVolumeTestJSON-1797241320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:45:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-81280a15-f591-46b2-8b1a-5a4e79582b5c tempest-AttachVolumeTestJSON-1797241320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:45:47 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-81280a15-f591-46b2-8b1a-5a4e79582b5c tempest-AttachVolumeTestJSON-1797241320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:45:47 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-81280a15-f591-46b2-8b1a-5a4e79582b5c tempest-AttachVolumeTestJSON-1797241320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:45:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-81280a15-f591-46b2-8b1a-5a4e79582b5c tempest-AttachVolumeTestJSON-1797241320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:45:47 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-81280a15-f591-46b2-8b1a-5a4e79582b5c tempest-AttachVolumeTestJSON-1797241320 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:45:47 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-81280a15-f591-46b2-8b1a-5a4e79582b5c tempest-AttachVolumeTestJSON-1797241320 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:45:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-81280a15-f591-46b2-8b1a-5a4e79582b5c tempest-AttachVolumeTestJSON-1797241320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3073e016-9d88-4724-a234-a17a83eeeeb7 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:47 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-efa6a74d-7a73-44ff-b5e8-fdcd0ff7c8fe tempest-ServersNegativeTestJSON-797912140 None] Acquiring lock "cinder-d76cbc25-41ce-4c5e-a4b4-57c7db7610b4-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:45:47 devstack sudo[92537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3073e016-9d88-4724-a234-a17a83eeeeb7 1073741824 Jul 08 01:45:47 devstack sudo[92537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:47 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-efa6a74d-7a73-44ff-b5e8-fdcd0ff7c8fe tempest-ServersNegativeTestJSON-797912140 None] Lock "cinder-d76cbc25-41ce-4c5e-a4b4-57c7db7610b4-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:45:48 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-efa6a74d-7a73-44ff-b5e8-fdcd0ff7c8fe tempest-ServersNegativeTestJSON-797912140 None] Acquiring lock "cinder-quobyte-d76cbc25-41ce-4c5e-a4b4-57c7db7610b4" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:45:48 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-efa6a74d-7a73-44ff-b5e8-fdcd0ff7c8fe tempest-ServersNegativeTestJSON-797912140 None] Lock "cinder-quobyte-d76cbc25-41ce-4c5e-a4b4-57c7db7610b4" acquired by "delete_volume" :: waited 0.035s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:45:48 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f3e62a-e586-49e5-9d82-7f527f4d4247]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:45:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-efa6a74d-7a73-44ff-b5e8-fdcd0ff7c8fe tempest-ServersNegativeTestJSON-797912140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d76cbc25-41ce-4c5e-a4b4-57c7db7610b4 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:48 devstack sudo[92534]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-58a1e12d-e13d-4a74-a3fc-a2affdc70d37 tempest-ServersNegativeTestJSON-797912140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 1.030s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:48 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-58a1e12d-e13d-4a74-a3fc-a2affdc70d37 tempest-ServersNegativeTestJSON-797912140 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:45:48 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-58a1e12d-e13d-4a74-a3fc-a2affdc70d37 tempest-ServersNegativeTestJSON-797912140 None] Deleted volume successfully. Jul 08 01:45:48 devstack sudo[92540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d76cbc25-41ce-4c5e-a4b4-57c7db7610b4 Jul 08 01:45:48 devstack sudo[92540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:48 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a19c003d-c02d-4937-9219-11be4ed62e67 tempest-TaggedAttachmentsTest-481431770 None] Acquiring lock "cinder-e2d414b7-8eb3-4ac3-969e-828a3f899be8-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:45:48 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-58a1e12d-e13d-4a74-a3fc-a2affdc70d37 tempest-ServersNegativeTestJSON-797912140 None] Lock "cinder-d1740fac-8dbc-4b2c-96ea-c4cfa0f478e0-delete_volume" released by "delete_volume" :: held 4.080s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:45:48 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a19c003d-c02d-4937-9219-11be4ed62e67 tempest-TaggedAttachmentsTest-481431770 None] Lock "cinder-e2d414b7-8eb3-4ac3-969e-828a3f899be8-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:45:48 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a19c003d-c02d-4937-9219-11be4ed62e67 tempest-TaggedAttachmentsTest-481431770 None] Acquiring lock "cinder-quobyte-e2d414b7-8eb3-4ac3-969e-828a3f899be8" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:45:48 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a19c003d-c02d-4937-9219-11be4ed62e67 tempest-TaggedAttachmentsTest-481431770 None] Lock "cinder-quobyte-e2d414b7-8eb3-4ac3-969e-828a3f899be8" acquired by "delete_volume" :: waited 0.023s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:45:48 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[704fe66a-a2c9-4041-9ed5-1653ca248506]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:45:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a19c003d-c02d-4937-9219-11be4ed62e67 tempest-TaggedAttachmentsTest-481431770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e2d414b7-8eb3-4ac3-969e-828a3f899be8 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:48 devstack sudo[92542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e2d414b7-8eb3-4ac3-969e-828a3f899be8 Jul 08 01:45:48 devstack sudo[92542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:48 devstack sudo[92537]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-81280a15-f591-46b2-8b1a-5a4e79582b5c tempest-AttachVolumeTestJSON-1797241320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3073e016-9d88-4724-a234-a17a83eeeeb7 1073741824" returned: 0 in 1.082s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:49 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-81280a15-f591-46b2-8b1a-5a4e79582b5c tempest-AttachVolumeTestJSON-1797241320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3073e016-9d88-4724-a234-a17a83eeeeb7 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:49 devstack sudo[92551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3073e016-9d88-4724-a234-a17a83eeeeb7 Jul 08 01:45:49 devstack sudo[92551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:49 devstack sudo[92540]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:49 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-efa6a74d-7a73-44ff-b5e8-fdcd0ff7c8fe tempest-ServersNegativeTestJSON-797912140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d76cbc25-41ce-4c5e-a4b4-57c7db7610b4" returned: 0 in 1.040s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:49 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-efa6a74d-7a73-44ff-b5e8-fdcd0ff7c8fe tempest-ServersNegativeTestJSON-797912140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d76cbc25-41ce-4c5e-a4b4-57c7db7610b4 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:49 devstack sudo[92553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d76cbc25-41ce-4c5e-a4b4-57c7db7610b4 Jul 08 01:45:49 devstack sudo[92553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:49 devstack sudo[92542]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:49 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a19c003d-c02d-4937-9219-11be4ed62e67 tempest-TaggedAttachmentsTest-481431770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e2d414b7-8eb3-4ac3-969e-828a3f899be8" returned: 0 in 1.058s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:49 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a19c003d-c02d-4937-9219-11be4ed62e67 tempest-TaggedAttachmentsTest-481431770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e2d414b7-8eb3-4ac3-969e-828a3f899be8 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:49 devstack sudo[92559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e2d414b7-8eb3-4ac3-969e-828a3f899be8 Jul 08 01:45:49 devstack sudo[92559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:49 devstack sudo[92551]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:49 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-81280a15-f591-46b2-8b1a-5a4e79582b5c tempest-AttachVolumeTestJSON-1797241320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3073e016-9d88-4724-a234-a17a83eeeeb7" returned: 0 in 0.711s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:49 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-81280a15-f591-46b2-8b1a-5a4e79582b5c tempest-AttachVolumeTestJSON-1797241320 None] <== create_volume: return (1887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:45:49 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-81280a15-f591-46b2-8b1a-5a4e79582b5c tempest-AttachVolumeTestJSON-1797241320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.890s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:45:49 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-81280a15-f591-46b2-8b1a-5a4e79582b5c tempest-AttachVolumeTestJSON-1797241320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd949180-e616-45f1-83b3-de18697cb206) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3073e016-9d88-4724-a234-a17a83eeeeb7', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:49 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-81280a15-f591-46b2-8b1a-5a4e79582b5c tempest-AttachVolumeTestJSON-1797241320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b216213-2c12-432c-9ea2-5efa5b2160a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:45:49 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-81280a15-f591-46b2-8b1a-5a4e79582b5c tempest-AttachVolumeTestJSON-1797241320 None] Volume volume-3073e016-9d88-4724-a234-a17a83eeeeb7 (3073e016-9d88-4724-a234-a17a83eeeeb7): created successfully Jul 08 01:45:49 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-81280a15-f591-46b2-8b1a-5a4e79582b5c tempest-AttachVolumeTestJSON-1797241320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b216213-2c12-432c-9ea2-5efa5b2160a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:45:49 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-81280a15-f591-46b2-8b1a-5a4e79582b5c tempest-AttachVolumeTestJSON-1797241320 None] Flow 'volume_create_manager' (650677b9-16a1-456e-957d-b79f486c358f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:45:49 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-81280a15-f591-46b2-8b1a-5a4e79582b5c tempest-AttachVolumeTestJSON-1797241320 None] Created volume successfully. Jul 08 01:45:49 devstack sudo[92553]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:49 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-efa6a74d-7a73-44ff-b5e8-fdcd0ff7c8fe tempest-ServersNegativeTestJSON-797912140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d76cbc25-41ce-4c5e-a4b4-57c7db7610b4" returned: 0 in 0.809s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:49 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-efa6a74d-7a73-44ff-b5e8-fdcd0ff7c8fe tempest-ServersNegativeTestJSON-797912140 None] Lock "cinder-quobyte-d76cbc25-41ce-4c5e-a4b4-57c7db7610b4" released by "delete_volume" :: held 1.909s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:45:50 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-efa6a74d-7a73-44ff-b5e8-fdcd0ff7c8fe tempest-ServersNegativeTestJSON-797912140 None] Created reservations ['ec001f40-9dd4-4cd4-8848-f766493d4d95', 'eaf52baa-a146-4db4-958e-48a0a03b2450', '736e6eee-580c-4b65-a9b6-6f010ff3ce79', '370f89ff-b458-4f37-a043-f8c0578b6b5d'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:45:50 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-efa6a74d-7a73-44ff-b5e8-fdcd0ff7c8fe tempest-ServersNegativeTestJSON-797912140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:45:50 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-efa6a74d-7a73-44ff-b5e8-fdcd0ff7c8fe tempest-ServersNegativeTestJSON-797912140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:45:50 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-efa6a74d-7a73-44ff-b5e8-fdcd0ff7c8fe tempest-ServersNegativeTestJSON-797912140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:45:50 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-efa6a74d-7a73-44ff-b5e8-fdcd0ff7c8fe tempest-ServersNegativeTestJSON-797912140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:45:50 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-efa6a74d-7a73-44ff-b5e8-fdcd0ff7c8fe tempest-ServersNegativeTestJSON-797912140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:45:50 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-efa6a74d-7a73-44ff-b5e8-fdcd0ff7c8fe tempest-ServersNegativeTestJSON-797912140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:50 devstack sudo[92566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:45:50 devstack sudo[92566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:50 devstack sudo[92559]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:50 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a19c003d-c02d-4937-9219-11be4ed62e67 tempest-TaggedAttachmentsTest-481431770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e2d414b7-8eb3-4ac3-969e-828a3f899be8" returned: 0 in 0.744s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:50 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a19c003d-c02d-4937-9219-11be4ed62e67 tempest-TaggedAttachmentsTest-481431770 None] Lock "cinder-quobyte-e2d414b7-8eb3-4ac3-969e-828a3f899be8" released by "delete_volume" :: held 1.854s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:45:50 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-a19c003d-c02d-4937-9219-11be4ed62e67 tempest-TaggedAttachmentsTest-481431770 None] Created reservations ['402fe123-2422-4840-8bc6-8542c6f3dd4c', '3cebab8e-5566-4522-8192-de4ded514488', '35594b74-f69f-491e-910f-2e8964ca852c', 'eccb7deb-6ec2-41da-899a-b7f4472df4c4'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:45:50 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-a19c003d-c02d-4937-9219-11be4ed62e67 tempest-TaggedAttachmentsTest-481431770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:45:50 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-a19c003d-c02d-4937-9219-11be4ed62e67 tempest-TaggedAttachmentsTest-481431770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:45:50 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-a19c003d-c02d-4937-9219-11be4ed62e67 tempest-TaggedAttachmentsTest-481431770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:45:50 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-a19c003d-c02d-4937-9219-11be4ed62e67 tempest-TaggedAttachmentsTest-481431770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:45:50 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-a19c003d-c02d-4937-9219-11be4ed62e67 tempest-TaggedAttachmentsTest-481431770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:45:50 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a19c003d-c02d-4937-9219-11be4ed62e67 tempest-TaggedAttachmentsTest-481431770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:50 devstack sudo[92569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:45:50 devstack sudo[92569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:50 devstack sudo[92566]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:50 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-efa6a74d-7a73-44ff-b5e8-fdcd0ff7c8fe tempest-ServersNegativeTestJSON-797912140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.750s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:50 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-efa6a74d-7a73-44ff-b5e8-fdcd0ff7c8fe tempest-ServersNegativeTestJSON-797912140 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:45:50 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-efa6a74d-7a73-44ff-b5e8-fdcd0ff7c8fe tempest-ServersNegativeTestJSON-797912140 None] Deleted volume successfully. Jul 08 01:45:50 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-efa6a74d-7a73-44ff-b5e8-fdcd0ff7c8fe tempest-ServersNegativeTestJSON-797912140 None] Lock "cinder-d76cbc25-41ce-4c5e-a4b4-57c7db7610b4-delete_volume" released by "delete_volume" :: held 2.986s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:45:51 devstack sudo[92569]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a19c003d-c02d-4937-9219-11be4ed62e67 tempest-TaggedAttachmentsTest-481431770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.735s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:51 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-a19c003d-c02d-4937-9219-11be4ed62e67 tempest-TaggedAttachmentsTest-481431770 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:45:51 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-a19c003d-c02d-4937-9219-11be4ed62e67 tempest-TaggedAttachmentsTest-481431770 None] Deleted volume successfully. Jul 08 01:45:51 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a19c003d-c02d-4937-9219-11be4ed62e67 tempest-TaggedAttachmentsTest-481431770 None] Lock "cinder-e2d414b7-8eb3-4ac3-969e-828a3f899be8-delete_volume" released by "delete_volume" :: held 2.845s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:45:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-34098c46-af77-4c29-a56b-7988c9d243ed req-aba7e8cd-b39c-4066-9d3d-921a7ab5dfe2 tempest-AttachVolumeTestJSON-1797241320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:45:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-34098c46-af77-4c29-a56b-7988c9d243ed req-aba7e8cd-b39c-4066-9d3d-921a7ab5dfe2 tempest-AttachVolumeTestJSON-1797241320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:45:54 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7d071d-6fb7-4168-8f2c-27c8a3cbf8c6]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:45:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-34098c46-af77-4c29-a56b-7988c9d243ed req-aba7e8cd-b39c-4066-9d3d-921a7ab5dfe2 tempest-AttachVolumeTestJSON-1797241320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3073e016-9d88-4724-a234-a17a83eeeeb7 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:45:54 devstack sudo[92611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3073e016-9d88-4724-a234-a17a83eeeeb7 Jul 08 01:45:54 devstack sudo[92611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:45:55 devstack sudo[92611]: pam_unix(sudo:session): session closed for user root Jul 08 01:45:55 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-34098c46-af77-4c29-a56b-7988c9d243ed req-aba7e8cd-b39c-4066-9d3d-921a7ab5dfe2 tempest-AttachVolumeTestJSON-1797241320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3073e016-9d88-4724-a234-a17a83eeeeb7" returned: 0 in 1.010s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:45:55 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-34098c46-af77-4c29-a56b-7988c9d243ed req-aba7e8cd-b39c-4066-9d3d-921a7ab5dfe2 tempest-AttachVolumeTestJSON-1797241320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.027s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:45:55 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [req-34098c46-af77-4c29-a56b-7988c9d243ed req-aba7e8cd-b39c-4066-9d3d-921a7ab5dfe2 tempest-AttachVolumeTestJSON-1797241320 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17', 'name': 'volume-3073e016-9d88-4724-a234-a17a83eeeeb7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7c831fa3-e748-4db6-8e05-74c307904f82', 'enforce_multipath': True} {{(pid=87134) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:45:55 devstack cinder-volume[87134]: INFO cinder.volume.manager [req-34098c46-af77-4c29-a56b-7988c9d243ed req-aba7e8cd-b39c-4066-9d3d-921a7ab5dfe2 tempest-AttachVolumeTestJSON-1797241320 None] attachment_update completed successfully. Jul 08 01:46:01 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a7e614d-936c-4bdb-b18b-59a7917e78bd tempest-AttachVolumeTestJSON-1797241320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:46:01 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-2a7e614d-936c-4bdb-b18b-59a7917e78bd tempest-AttachVolumeTestJSON-1797241320 None] Flow 'volume_create_manager' (ce0f5ff1-049c-48cb-bfc5-d7a1343f0b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:46:01 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-2a7e614d-936c-4bdb-b18b-59a7917e78bd tempest-AttachVolumeTestJSON-1797241320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0244f69c-a955-49ff-a641-2df93378c5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:01 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-2a7e614d-936c-4bdb-b18b-59a7917e78bd tempest-AttachVolumeTestJSON-1797241320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0244f69c-a955-49ff-a641-2df93378c5e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:46:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-766628530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8316f5a-c8a3-458c-9050-1d7493a16894,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='140660a969d943bb9e00ad55f0d190e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:46:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:46:01Z,use_quota=True,user_id='c5c6b353c9bc4b8887e7113f648b541b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:01 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-2a7e614d-936c-4bdb-b18b-59a7917e78bd tempest-AttachVolumeTestJSON-1797241320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc146721-a558-43e8-9d15-00ccbab48a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:01 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-2a7e614d-936c-4bdb-b18b-59a7917e78bd tempest-AttachVolumeTestJSON-1797241320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc146721-a558-43e8-9d15-00ccbab48a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:01 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-2a7e614d-936c-4bdb-b18b-59a7917e78bd tempest-AttachVolumeTestJSON-1797241320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36da6f37-0a5d-481c-9787-7a2a8aaf6e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:01 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-2a7e614d-936c-4bdb-b18b-59a7917e78bd tempest-AttachVolumeTestJSON-1797241320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36da6f37-0a5d-481c-9787-7a2a8aaf6e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8316f5a-c8a3-458c-9050-1d7493a16894', 'volume_name': 'volume-e8316f5a-c8a3-458c-9050-1d7493a16894', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:01 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-2a7e614d-936c-4bdb-b18b-59a7917e78bd tempest-AttachVolumeTestJSON-1797241320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (764cfc12-132c-4185-9225-579196ae16b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:01 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-2a7e614d-936c-4bdb-b18b-59a7917e78bd tempest-AttachVolumeTestJSON-1797241320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (764cfc12-132c-4185-9225-579196ae16b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:01 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-2a7e614d-936c-4bdb-b18b-59a7917e78bd tempest-AttachVolumeTestJSON-1797241320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55d7249e-2c5c-4c1e-9376-2a16b7173453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:01 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-2a7e614d-936c-4bdb-b18b-59a7917e78bd tempest-AttachVolumeTestJSON-1797241320 None] Volume e8316f5a-c8a3-458c-9050-1d7493a16894: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8316f5a-c8a3-458c-9050-1d7493a16894', 'volume_size': 1} Jul 08 01:46:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-2a7e614d-936c-4bdb-b18b-59a7917e78bd tempest-AttachVolumeTestJSON-1797241320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-2a7e614d-936c-4bdb-b18b-59a7917e78bd tempest-AttachVolumeTestJSON-1797241320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:01 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-2a7e614d-936c-4bdb-b18b-59a7917e78bd tempest-AttachVolumeTestJSON-1797241320 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:46:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-766628530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8316f5a-c8a3-458c-9050-1d7493a16894,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='140660a969d943bb9e00ad55f0d190e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:46:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:46:01Z,use_quota=True,user_id='c5c6b353c9bc4b8887e7113f648b541b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:46:01 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-2a7e614d-936c-4bdb-b18b-59a7917e78bd tempest-AttachVolumeTestJSON-1797241320 None] Creating volume e8316f5a-c8a3-458c-9050-1d7493a16894 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:46:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-2a7e614d-936c-4bdb-b18b-59a7917e78bd tempest-AttachVolumeTestJSON-1797241320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-2a7e614d-936c-4bdb-b18b-59a7917e78bd tempest-AttachVolumeTestJSON-1797241320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:01 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-2a7e614d-936c-4bdb-b18b-59a7917e78bd tempest-AttachVolumeTestJSON-1797241320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:46:01 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-2a7e614d-936c-4bdb-b18b-59a7917e78bd tempest-AttachVolumeTestJSON-1797241320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:46:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-2a7e614d-936c-4bdb-b18b-59a7917e78bd tempest-AttachVolumeTestJSON-1797241320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:01 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-2a7e614d-936c-4bdb-b18b-59a7917e78bd tempest-AttachVolumeTestJSON-1797241320 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:46:01 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-2a7e614d-936c-4bdb-b18b-59a7917e78bd tempest-AttachVolumeTestJSON-1797241320 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:46:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2a7e614d-936c-4bdb-b18b-59a7917e78bd tempest-AttachVolumeTestJSON-1797241320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e8316f5a-c8a3-458c-9050-1d7493a16894 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:01 devstack sudo[93028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e8316f5a-c8a3-458c-9050-1d7493a16894 1073741824 Jul 08 01:46:01 devstack sudo[93028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:02 devstack sudo[93028]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2a7e614d-936c-4bdb-b18b-59a7917e78bd tempest-AttachVolumeTestJSON-1797241320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e8316f5a-c8a3-458c-9050-1d7493a16894 1073741824" returned: 0 in 1.211s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2a7e614d-936c-4bdb-b18b-59a7917e78bd tempest-AttachVolumeTestJSON-1797241320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e8316f5a-c8a3-458c-9050-1d7493a16894 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:02 devstack sudo[93064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e8316f5a-c8a3-458c-9050-1d7493a16894 Jul 08 01:46:02 devstack sudo[93064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:03 devstack sudo[93064]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:03 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2a7e614d-936c-4bdb-b18b-59a7917e78bd tempest-AttachVolumeTestJSON-1797241320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e8316f5a-c8a3-458c-9050-1d7493a16894" returned: 0 in 1.358s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:03 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-2a7e614d-936c-4bdb-b18b-59a7917e78bd tempest-AttachVolumeTestJSON-1797241320 None] <== create_volume: return (2664ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:46:03 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-2a7e614d-936c-4bdb-b18b-59a7917e78bd tempest-AttachVolumeTestJSON-1797241320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.667s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:03 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-2a7e614d-936c-4bdb-b18b-59a7917e78bd tempest-AttachVolumeTestJSON-1797241320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55d7249e-2c5c-4c1e-9376-2a16b7173453) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8316f5a-c8a3-458c-9050-1d7493a16894', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:03 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-2a7e614d-936c-4bdb-b18b-59a7917e78bd tempest-AttachVolumeTestJSON-1797241320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fccc267-f198-4718-ae2f-1b64b0851b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:04 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-2a7e614d-936c-4bdb-b18b-59a7917e78bd tempest-AttachVolumeTestJSON-1797241320 None] Volume volume-e8316f5a-c8a3-458c-9050-1d7493a16894 (e8316f5a-c8a3-458c-9050-1d7493a16894): created successfully Jul 08 01:46:04 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-2a7e614d-936c-4bdb-b18b-59a7917e78bd tempest-AttachVolumeTestJSON-1797241320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fccc267-f198-4718-ae2f-1b64b0851b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:04 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-2a7e614d-936c-4bdb-b18b-59a7917e78bd tempest-AttachVolumeTestJSON-1797241320 None] Flow 'volume_create_manager' (ce0f5ff1-049c-48cb-bfc5-d7a1343f0b86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:46:04 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-2a7e614d-936c-4bdb-b18b-59a7917e78bd tempest-AttachVolumeTestJSON-1797241320 None] Created volume successfully. Jul 08 01:46:07 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-63371f71-1830-4234-85c3-7a6c25b56b8a req-4b077c2b-65eb-4925-b539-7eade53887bd tempest-AttachVolumeTestJSON-1797241320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:07 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-63371f71-1830-4234-85c3-7a6c25b56b8a req-4b077c2b-65eb-4925-b539-7eade53887bd tempest-AttachVolumeTestJSON-1797241320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:07 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fbf92a8-4b4b-4d27-b520-7c16f2584c76]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:46:07 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-63371f71-1830-4234-85c3-7a6c25b56b8a req-4b077c2b-65eb-4925-b539-7eade53887bd tempest-AttachVolumeTestJSON-1797241320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e8316f5a-c8a3-458c-9050-1d7493a16894 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:08 devstack sudo[93119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e8316f5a-c8a3-458c-9050-1d7493a16894 Jul 08 01:46:08 devstack sudo[93119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:08 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-1ce16e53-e9c1-4f10-b7ba-b1cf3b95a37a tempest-GroupSnapshotsTest-1290797889 None] Group tempest-GroupSnapshotsTest-Group-1376089787: creating Jul 08 01:46:08 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-1ce16e53-e9c1-4f10-b7ba-b1cf3b95a37a tempest-GroupSnapshotsTest-1290797889 None] Group tempest-GroupSnapshotsTest-Group-1376089787: created successfully Jul 08 01:46:08 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-1ce16e53-e9c1-4f10-b7ba-b1cf3b95a37a tempest-GroupSnapshotsTest-1290797889 None] Create group completed successfully. Jul 08 01:46:09 devstack sudo[93119]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:09 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-63371f71-1830-4234-85c3-7a6c25b56b8a req-4b077c2b-65eb-4925-b539-7eade53887bd tempest-AttachVolumeTestJSON-1797241320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e8316f5a-c8a3-458c-9050-1d7493a16894" returned: 0 in 1.274s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:09 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-63371f71-1830-4234-85c3-7a6c25b56b8a req-4b077c2b-65eb-4925-b539-7eade53887bd tempest-AttachVolumeTestJSON-1797241320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.310s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:09 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [req-63371f71-1830-4234-85c3-7a6c25b56b8a req-4b077c2b-65eb-4925-b539-7eade53887bd tempest-AttachVolumeTestJSON-1797241320 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17', 'name': 'volume-e8316f5a-c8a3-458c-9050-1d7493a16894', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8e46bedf-c44b-41a0-8667-52e2a6559f02', 'enforce_multipath': True} {{(pid=87134) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:46:09 devstack cinder-volume[87134]: INFO cinder.volume.manager [req-63371f71-1830-4234-85c3-7a6c25b56b8a req-4b077c2b-65eb-4925-b539-7eade53887bd tempest-AttachVolumeTestJSON-1797241320 None] attachment_update completed successfully. Jul 08 01:46:10 devstack cinder-volume[87134]: DEBUG dbcounter [-] [87134] Writing DB stats cinder:SELECT=48,cinder:UPDATE=46,cinder:INSERT=10,cinder:DELETE=6 {{(pid=87134) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:46:10 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-920a5450-3966-42c6-8b51-0c3e60384c8a tempest-GroupSnapshotsTest-1290797889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:46:10 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-920a5450-3966-42c6-8b51-0c3e60384c8a tempest-GroupSnapshotsTest-1290797889 None] Flow 'volume_create_manager' (eee49960-eb26-432e-a0de-d046ae03c6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:46:10 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-920a5450-3966-42c6-8b51-0c3e60384c8a tempest-GroupSnapshotsTest-1290797889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ef3c0cd-6da8-4b39-b2d4-4942a507666a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:10 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-920a5450-3966-42c6-8b51-0c3e60384c8a tempest-GroupSnapshotsTest-1290797889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ef3c0cd-6da8-4b39-b2d4-4942a507666a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:46:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2086402746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5cb5fc78-e778-4f16-af32-7a98c9aed3df,host='devstack@QuobyteHD#QuobyteHD',id=a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97c67429d4724bfc8f5a6fe449493946',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:46:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:46:10Z,use_quota=True,user_id='48d3a3ec668e45d9868f061cc6e1f0c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0abf2d6b-daa4-46e7-a098-85bba2e6ad16),volume_type_id=0abf2d6b-daa4-46e7-a098-85bba2e6ad16)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:10 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-920a5450-3966-42c6-8b51-0c3e60384c8a tempest-GroupSnapshotsTest-1290797889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8561a32d-d9f7-4f68-9fe7-f524e7d928e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:10 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-920a5450-3966-42c6-8b51-0c3e60384c8a tempest-GroupSnapshotsTest-1290797889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8561a32d-d9f7-4f68-9fe7-f524e7d928e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:10 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-920a5450-3966-42c6-8b51-0c3e60384c8a tempest-GroupSnapshotsTest-1290797889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52a40930-2f9a-4844-9732-e2fbef7703ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:10 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-920a5450-3966-42c6-8b51-0c3e60384c8a tempest-GroupSnapshotsTest-1290797889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52a40930-2f9a-4844-9732-e2fbef7703ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c', 'volume_name': 'volume-a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:10 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-920a5450-3966-42c6-8b51-0c3e60384c8a tempest-GroupSnapshotsTest-1290797889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (160830bd-46b3-40b5-8a98-301a2c8f87b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:10 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-920a5450-3966-42c6-8b51-0c3e60384c8a tempest-GroupSnapshotsTest-1290797889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (160830bd-46b3-40b5-8a98-301a2c8f87b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:10 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-920a5450-3966-42c6-8b51-0c3e60384c8a tempest-GroupSnapshotsTest-1290797889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (321cbc9b-1db5-49d1-a675-20e92ec7889b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:10 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-920a5450-3966-42c6-8b51-0c3e60384c8a tempest-GroupSnapshotsTest-1290797889 None] Volume a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c', 'volume_size': 1} Jul 08 01:46:10 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-920a5450-3966-42c6-8b51-0c3e60384c8a tempest-GroupSnapshotsTest-1290797889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:10 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-920a5450-3966-42c6-8b51-0c3e60384c8a tempest-GroupSnapshotsTest-1290797889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:10 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-920a5450-3966-42c6-8b51-0c3e60384c8a tempest-GroupSnapshotsTest-1290797889 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5cb5fc78-e778-4f16-af32-7a98c9aed3df,created_at=2026-07-07T23:46:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2086402746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5cb5fc78-e778-4f16-af32-7a98c9aed3df,host='devstack@QuobyteHD#QuobyteHD',id=a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97c67429d4724bfc8f5a6fe449493946',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:46:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:46:10Z,use_quota=True,user_id='48d3a3ec668e45d9868f061cc6e1f0c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0abf2d6b-daa4-46e7-a098-85bba2e6ad16),volume_type_id=0abf2d6b-daa4-46e7-a098-85bba2e6ad16)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:46:10 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-920a5450-3966-42c6-8b51-0c3e60384c8a tempest-GroupSnapshotsTest-1290797889 None] Creating volume a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:46:10 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-920a5450-3966-42c6-8b51-0c3e60384c8a tempest-GroupSnapshotsTest-1290797889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:10 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-920a5450-3966-42c6-8b51-0c3e60384c8a tempest-GroupSnapshotsTest-1290797889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:10 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-920a5450-3966-42c6-8b51-0c3e60384c8a tempest-GroupSnapshotsTest-1290797889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:46:10 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-920a5450-3966-42c6-8b51-0c3e60384c8a tempest-GroupSnapshotsTest-1290797889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:46:10 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-920a5450-3966-42c6-8b51-0c3e60384c8a tempest-GroupSnapshotsTest-1290797889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:10 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-920a5450-3966-42c6-8b51-0c3e60384c8a tempest-GroupSnapshotsTest-1290797889 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:46:10 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-920a5450-3966-42c6-8b51-0c3e60384c8a tempest-GroupSnapshotsTest-1290797889 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:46:10 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-920a5450-3966-42c6-8b51-0c3e60384c8a tempest-GroupSnapshotsTest-1290797889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:10 devstack sudo[93131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c 1073741824 Jul 08 01:46:10 devstack sudo[93131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:11 devstack sudo[93131]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:11 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-920a5450-3966-42c6-8b51-0c3e60384c8a tempest-GroupSnapshotsTest-1290797889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c 1073741824" returned: 0 in 0.958s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:11 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-920a5450-3966-42c6-8b51-0c3e60384c8a tempest-GroupSnapshotsTest-1290797889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:11 devstack sudo[93139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c Jul 08 01:46:11 devstack sudo[93139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:12 devstack sudo[93139]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:12 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-920a5450-3966-42c6-8b51-0c3e60384c8a tempest-GroupSnapshotsTest-1290797889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c" returned: 0 in 0.878s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:12 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-920a5450-3966-42c6-8b51-0c3e60384c8a tempest-GroupSnapshotsTest-1290797889 None] <== create_volume: return (1895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:46:12 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-920a5450-3966-42c6-8b51-0c3e60384c8a tempest-GroupSnapshotsTest-1290797889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.899s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:12 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-920a5450-3966-42c6-8b51-0c3e60384c8a tempest-GroupSnapshotsTest-1290797889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (321cbc9b-1db5-49d1-a675-20e92ec7889b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:12 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-920a5450-3966-42c6-8b51-0c3e60384c8a tempest-GroupSnapshotsTest-1290797889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b98530ac-5bdf-4e75-8f74-32161de8c78d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:12 devstack cinder-volume[87134]: DEBUG dbcounter [-] [87134] Writing DB stats cinder:SELECT=51,cinder:UPDATE=57,cinder:INSERT=10,cinder:DELETE=2 {{(pid=87134) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:46:12 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-920a5450-3966-42c6-8b51-0c3e60384c8a tempest-GroupSnapshotsTest-1290797889 None] Volume volume-a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c (a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c): created successfully Jul 08 01:46:12 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-920a5450-3966-42c6-8b51-0c3e60384c8a tempest-GroupSnapshotsTest-1290797889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b98530ac-5bdf-4e75-8f74-32161de8c78d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:12 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-920a5450-3966-42c6-8b51-0c3e60384c8a tempest-GroupSnapshotsTest-1290797889 None] Flow 'volume_create_manager' (eee49960-eb26-432e-a0de-d046ae03c6f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:46:12 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-920a5450-3966-42c6-8b51-0c3e60384c8a tempest-GroupSnapshotsTest-1290797889 None] Created volume successfully. Jul 08 01:46:13 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-9e2d8b0d-a7bc-4875-99d4-a495c47f6e94 tempest-GroupSnapshotsTest-1290797889 None] GroupSnapshot 48cb9475-ca7c-48f4-8be0-67b5ee4ca1b1: creating. Jul 08 01:46:13 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-9e2d8b0d-a7bc-4875-99d4-a495c47f6e94 tempest-GroupSnapshotsTest-1290797889 None] Group snapshot 48cb9475-ca7c-48f4-8be0-67b5ee4ca1b1: creating. {{(pid=87134) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 08 01:46:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-9e2d8b0d-a7bc-4875-99d4-a495c47f6e94 tempest-GroupSnapshotsTest-1290797889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-9e2d8b0d-a7bc-4875-99d4-a495c47f6e94 tempest-GroupSnapshotsTest-1290797889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:13 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-9e2d8b0d-a7bc-4875-99d4-a495c47f6e94 tempest-GroupSnapshotsTest-1290797889 None] Creating offline snapshot 4cf886bc-d04d-475c-8379-7b79fafb1cc6 of volume a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c {{(pid=87134) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:46:13 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[0362166d-6f1b-44e8-90b7-09fc7747ee9d]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:46:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9e2d8b0d-a7bc-4875-99d4-a495c47f6e94 tempest-GroupSnapshotsTest-1290797889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:13 devstack sudo[93145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c Jul 08 01:46:13 devstack sudo[93145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:14 devstack sudo[93145]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:14 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9e2d8b0d-a7bc-4875-99d4-a495c47f6e94 tempest-GroupSnapshotsTest-1290797889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c" returned: 0 in 0.933s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:14 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9e2d8b0d-a7bc-4875-99d4-a495c47f6e94 tempest-GroupSnapshotsTest-1290797889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c.4cf886bc-d04d-475c-8379-7b79fafb1cc6 1G {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:14 devstack sudo[93152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c.4cf886bc-d04d-475c-8379-7b79fafb1cc6 1G Jul 08 01:46:14 devstack sudo[93152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:15 devstack cinder-volume[87134]: INFO cinder.volume.manager [req-dce1b5a3-b80b-4713-bffc-dc3dadd56cbf req-6e946f33-f681-4516-a839-fe4e0e9915e2 tempest-AttachVolumeTestJSON-1797241320 None] Terminate volume connection completed successfully. Jul 08 01:46:15 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [req-dce1b5a3-b80b-4713-bffc-dc3dadd56cbf req-6e946f33-f681-4516-a839-fe4e0e9915e2 tempest-AttachVolumeTestJSON-1797241320 None] Deleting attachment 7c831fa3-e748-4db6-8e05-74c307904f82. {{(pid=87134) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:46:15 devstack sudo[93152]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9e2d8b0d-a7bc-4875-99d4-a495c47f6e94 tempest-GroupSnapshotsTest-1290797889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c.4cf886bc-d04d-475c-8379-7b79fafb1cc6 1G" returned: 0 in 0.939s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9e2d8b0d-a7bc-4875-99d4-a495c47f6e94 tempest-GroupSnapshotsTest-1290797889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c.4cf886bc-d04d-475c-8379-7b79fafb1cc6 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:15 devstack sudo[93160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c.4cf886bc-d04d-475c-8379-7b79fafb1cc6 Jul 08 01:46:15 devstack sudo[93160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:16 devstack sudo[93160]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9e2d8b0d-a7bc-4875-99d4-a495c47f6e94 tempest-GroupSnapshotsTest-1290797889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c.4cf886bc-d04d-475c-8379-7b79fafb1cc6" returned: 0 in 0.875s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:16 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-9e2d8b0d-a7bc-4875-99d4-a495c47f6e94 tempest-GroupSnapshotsTest-1290797889 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c.4cf886bc-d04d-475c-8379-7b79fafb1cc6 is being set with open permissions: ugo+rw: NotImplementedError Jul 08 01:46:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9e2d8b0d-a7bc-4875-99d4-a495c47f6e94 tempest-GroupSnapshotsTest-1290797889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c.4cf886bc-d04d-475c-8379-7b79fafb1cc6 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:16 devstack sudo[93190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c.4cf886bc-d04d-475c-8379-7b79fafb1cc6 Jul 08 01:46:16 devstack sudo[93190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:17 devstack sudo[93190]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9e2d8b0d-a7bc-4875-99d4-a495c47f6e94 tempest-GroupSnapshotsTest-1290797889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c.4cf886bc-d04d-475c-8379-7b79fafb1cc6" returned: 0 in 0.849s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9e2d8b0d-a7bc-4875-99d4-a495c47f6e94 tempest-GroupSnapshotsTest-1290797889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:17 devstack sudo[93194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c.info Jul 08 01:46:17 devstack sudo[93194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:17 devstack cinder-volume[87134]: INFO cinder.volume.manager [req-19774cad-4829-4dd1-ba38-e72086bbb36e req-109d2ee1-f563-49fc-bc33-7f1aa961c491 tempest-AttachVolumeTestJSON-1797241320 None] Terminate volume connection completed successfully. Jul 08 01:46:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [req-19774cad-4829-4dd1-ba38-e72086bbb36e req-109d2ee1-f563-49fc-bc33-7f1aa961c491 tempest-AttachVolumeTestJSON-1797241320 None] Deleting attachment 8e46bedf-c44b-41a0-8667-52e2a6559f02. {{(pid=87134) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:46:17 devstack sudo[93194]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9e2d8b0d-a7bc-4875-99d4-a495c47f6e94 tempest-GroupSnapshotsTest-1290797889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c.info" returned: 0 in 0.813s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:17 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-9e2d8b0d-a7bc-4875-99d4-a495c47f6e94 tempest-GroupSnapshotsTest-1290797889 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 01:46:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9e2d8b0d-a7bc-4875-99d4-a495c47f6e94 tempest-GroupSnapshotsTest-1290797889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:18 devstack sudo[93208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c.info Jul 08 01:46:18 devstack sudo[93208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:18 devstack sudo[93208]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9e2d8b0d-a7bc-4875-99d4-a495c47f6e94 tempest-GroupSnapshotsTest-1290797889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c.info" returned: 0 in 0.769s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-9e2d8b0d-a7bc-4875-99d4-a495c47f6e94 tempest-GroupSnapshotsTest-1290797889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.281s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:18 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-9e2d8b0d-a7bc-4875-99d4-a495c47f6e94 tempest-GroupSnapshotsTest-1290797889 None] group_snapshot 48cb9475-ca7c-48f4-8be0-67b5ee4ca1b1: created successfully Jul 08 01:46:20 devstack cinder-volume[87134]: DEBUG oslo_service.periodic_task [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87134) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:46:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:20 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:46:20 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:46:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:20 devstack sudo[93276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:46:20 devstack sudo[93276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-d4cba62f-7559-44ab-91ec-0f8103dc2f9c tempest-GroupSnapshotsTest-1290797889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-d4cba62f-7559-44ab-91ec-0f8103dc2f9c tempest-GroupSnapshotsTest-1290797889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:21 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-d4cba62f-7559-44ab-91ec-0f8103dc2f9c tempest-GroupSnapshotsTest-1290797889 None] Acquiring lock "cinder-quobyte-4cf886bc-d04d-475c-8379-7b79fafb1cc6-817ffa70-e3f3-446f-8b9c-cd98c681d3fd" by "_create_volume_from_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:46:21 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-d4cba62f-7559-44ab-91ec-0f8103dc2f9c tempest-GroupSnapshotsTest-1290797889 None] Lock "cinder-quobyte-4cf886bc-d04d-475c-8379-7b79fafb1cc6-817ffa70-e3f3-446f-8b9c-cd98c681d3fd" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:46:21 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-d4cba62f-7559-44ab-91ec-0f8103dc2f9c tempest-GroupSnapshotsTest-1290797889 None] Creating volume 817ffa70-e3f3-446f-8b9c-cd98c681d3fd from snapshot 4cf886bc-d04d-475c-8379-7b79fafb1cc6 {{(pid=87134) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 01:46:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-d4cba62f-7559-44ab-91ec-0f8103dc2f9c tempest-GroupSnapshotsTest-1290797889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-d4cba62f-7559-44ab-91ec-0f8103dc2f9c tempest-GroupSnapshotsTest-1290797889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:21 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-d4cba62f-7559-44ab-91ec-0f8103dc2f9c tempest-GroupSnapshotsTest-1290797889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:46:21 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-d4cba62f-7559-44ab-91ec-0f8103dc2f9c tempest-GroupSnapshotsTest-1290797889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:46:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-d4cba62f-7559-44ab-91ec-0f8103dc2f9c tempest-GroupSnapshotsTest-1290797889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:21 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-d4cba62f-7559-44ab-91ec-0f8103dc2f9c tempest-GroupSnapshotsTest-1290797889 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:46:21 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-d4cba62f-7559-44ab-91ec-0f8103dc2f9c tempest-GroupSnapshotsTest-1290797889 None] Acquiring lock "cinder-quobyte-817ffa70-e3f3-446f-8b9c-cd98c681d3fd" by "_copy_volume_from_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:46:21 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-d4cba62f-7559-44ab-91ec-0f8103dc2f9c tempest-GroupSnapshotsTest-1290797889 None] Lock "cinder-quobyte-817ffa70-e3f3-446f-8b9c-cd98c681d3fd" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:46:21 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-d4cba62f-7559-44ab-91ec-0f8103dc2f9c tempest-GroupSnapshotsTest-1290797889 None] snapshot: 4cf886bc-d04d-475c-8379-7b79fafb1cc6, volume: 817ffa70-e3f3-446f-8b9c-cd98c681d3fd, {{(pid=87134) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 01:46:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-d4cba62f-7559-44ab-91ec-0f8103dc2f9c tempest-GroupSnapshotsTest-1290797889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-d4cba62f-7559-44ab-91ec-0f8103dc2f9c tempest-GroupSnapshotsTest-1290797889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:21 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-d4cba62f-7559-44ab-91ec-0f8103dc2f9c tempest-GroupSnapshotsTest-1290797889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:46:21 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-d4cba62f-7559-44ab-91ec-0f8103dc2f9c tempest-GroupSnapshotsTest-1290797889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:46:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-d4cba62f-7559-44ab-91ec-0f8103dc2f9c tempest-GroupSnapshotsTest-1290797889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:21 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa061e8-5fa7-4917-a60a-9c1dae153aec]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:46:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d4cba62f-7559-44ab-91ec-0f8103dc2f9c tempest-GroupSnapshotsTest-1290797889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c.4cf886bc-d04d-475c-8379-7b79fafb1cc6 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:21 devstack sudo[93278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c.4cf886bc-d04d-475c-8379-7b79fafb1cc6 Jul 08 01:46:21 devstack sudo[93278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:21 devstack sudo[93276]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.784s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:21 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:46:21 devstack cinder-volume[87134]: DEBUG oslo_service.periodic_task [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running periodic task VolumeManager._thread_info {{(pid=87134) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:46:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] thread count: 8 {{(pid=87134) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:46:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] thread info: [<_MainThread(MainThread, started 129378964615296)>, , , , , , , ] {{(pid=87134) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:46:22 devstack sudo[93278]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d4cba62f-7559-44ab-91ec-0f8103dc2f9c tempest-GroupSnapshotsTest-1290797889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c.4cf886bc-d04d-475c-8379-7b79fafb1cc6" returned: 0 in 1.097s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:22 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-d4cba62f-7559-44ab-91ec-0f8103dc2f9c tempest-GroupSnapshotsTest-1290797889 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:46:22 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-d4cba62f-7559-44ab-91ec-0f8103dc2f9c tempest-GroupSnapshotsTest-1290797889 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c {{(pid=87134) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 01:46:22 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-d4cba62f-7559-44ab-91ec-0f8103dc2f9c tempest-GroupSnapshotsTest-1290797889 None] Creating direct copy from snapshot {{(pid=87134) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 01:46:22 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d3f83f-3bd9-4b52-9e61-e3c270f59a67]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:46:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d4cba62f-7559-44ab-91ec-0f8103dc2f9c tempest-GroupSnapshotsTest-1290797889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:22 devstack sudo[93301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c Jul 08 01:46:22 devstack sudo[93301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:23 devstack sudo[93301]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:23 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d4cba62f-7559-44ab-91ec-0f8103dc2f9c tempest-GroupSnapshotsTest-1290797889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c" returned: 0 in 0.956s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:23 devstack cinder-volume[87134]: DEBUG cinder.utils [None req-d4cba62f-7559-44ab-91ec-0f8103dc2f9c tempest-GroupSnapshotsTest-1290797889 None] Path /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-817ffa70-e3f3-446f-8b9c-cd98c681d3fd not found in is_blk_device check {{(pid=87134) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 01:46:23 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d4cba62f-7559-44ab-91ec-0f8103dc2f9c tempest-GroupSnapshotsTest-1290797889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-817ffa70-e3f3-446f-8b9c-cd98c681d3fd {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:23 devstack sudo[93312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-817ffa70-e3f3-446f-8b9c-cd98c681d3fd Jul 08 01:46:23 devstack sudo[93312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:23 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e569a9a-e7c8-45c0-a16e-54a9570d79d9 tempest-SnapshotsActionsTest-1208726570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:46:23 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5e569a9a-e7c8-45c0-a16e-54a9570d79d9 tempest-SnapshotsActionsTest-1208726570 None] Flow 'volume_create_manager' (3c0929b7-5a1e-42e4-a586-f33fe692bf57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:46:23 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5e569a9a-e7c8-45c0-a16e-54a9570d79d9 tempest-SnapshotsActionsTest-1208726570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de28ef7e-f0b9-4a1f-8976-32775a5a94bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:23 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5e569a9a-e7c8-45c0-a16e-54a9570d79d9 tempest-SnapshotsActionsTest-1208726570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de28ef7e-f0b9-4a1f-8976-32775a5a94bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:46:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1914700093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41e27e51-647a-4db5-a8d7-8e510c819658,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec8ae7f72c024af5965d9e3f4be41df6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:46:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:46:24Z,use_quota=True,user_id='8b55a44934014299b70f42bfcad06420',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:23 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5e569a9a-e7c8-45c0-a16e-54a9570d79d9 tempest-SnapshotsActionsTest-1208726570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e89e9133-713c-4f3a-b6fd-2c94c948e9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:23 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5e569a9a-e7c8-45c0-a16e-54a9570d79d9 tempest-SnapshotsActionsTest-1208726570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e89e9133-713c-4f3a-b6fd-2c94c948e9e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:23 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5e569a9a-e7c8-45c0-a16e-54a9570d79d9 tempest-SnapshotsActionsTest-1208726570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (530444d4-10a8-452d-b76c-488df65897cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:23 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5e569a9a-e7c8-45c0-a16e-54a9570d79d9 tempest-SnapshotsActionsTest-1208726570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (530444d4-10a8-452d-b76c-488df65897cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41e27e51-647a-4db5-a8d7-8e510c819658', 'volume_name': 'volume-41e27e51-647a-4db5-a8d7-8e510c819658', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:23 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5e569a9a-e7c8-45c0-a16e-54a9570d79d9 tempest-SnapshotsActionsTest-1208726570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcbd941c-e0cc-4c8f-bdd8-dffed12f8723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:23 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5e569a9a-e7c8-45c0-a16e-54a9570d79d9 tempest-SnapshotsActionsTest-1208726570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcbd941c-e0cc-4c8f-bdd8-dffed12f8723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:23 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5e569a9a-e7c8-45c0-a16e-54a9570d79d9 tempest-SnapshotsActionsTest-1208726570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4659d970-c924-4bf9-aab8-bf2be4cd3979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:23 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-5e569a9a-e7c8-45c0-a16e-54a9570d79d9 tempest-SnapshotsActionsTest-1208726570 None] Volume 41e27e51-647a-4db5-a8d7-8e510c819658: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41e27e51-647a-4db5-a8d7-8e510c819658', 'volume_size': 1} Jul 08 01:46:23 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5e569a9a-e7c8-45c0-a16e-54a9570d79d9 tempest-SnapshotsActionsTest-1208726570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:29 devstack sudo[93312]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d4cba62f-7559-44ab-91ec-0f8103dc2f9c tempest-GroupSnapshotsTest-1290797889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-817ffa70-e3f3-446f-8b9c-cd98c681d3fd" returned: 0 in 6.324s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:29 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[aacbad5e-587f-4831-9169-17de1a801c5e]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:46:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d4cba62f-7559-44ab-91ec-0f8103dc2f9c tempest-GroupSnapshotsTest-1290797889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:29 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-22d3368d-9a11-45c9-8d92-835c2ddd6cb2 tempest-AttachVolumeTestJSON-1797241320 None] Acquiring lock "cinder-e8316f5a-c8a3-458c-9050-1d7493a16894-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:46:29 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-22d3368d-9a11-45c9-8d92-835c2ddd6cb2 tempest-AttachVolumeTestJSON-1797241320 None] Lock "cinder-e8316f5a-c8a3-458c-9050-1d7493a16894-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:46:29 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-22d3368d-9a11-45c9-8d92-835c2ddd6cb2 tempest-AttachVolumeTestJSON-1797241320 None] Acquiring lock "cinder-quobyte-e8316f5a-c8a3-458c-9050-1d7493a16894" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:46:29 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-22d3368d-9a11-45c9-8d92-835c2ddd6cb2 tempest-AttachVolumeTestJSON-1797241320 None] Lock "cinder-quobyte-e8316f5a-c8a3-458c-9050-1d7493a16894" acquired by "delete_volume" :: waited 0.022s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:46:29 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b89d23-5e4f-4b47-b967-64d4322d9f3b]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:46:29 devstack sudo[93347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c Jul 08 01:46:29 devstack sudo[93347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-22d3368d-9a11-45c9-8d92-835c2ddd6cb2 tempest-AttachVolumeTestJSON-1797241320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e8316f5a-c8a3-458c-9050-1d7493a16894 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:30 devstack sudo[93352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e8316f5a-c8a3-458c-9050-1d7493a16894 Jul 08 01:46:30 devstack sudo[93352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:30 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd64afa5-b627-407a-a8ad-02369dc46995 tempest-AttachVolumeNegativeTest-677114920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:46:30 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-bd64afa5-b627-407a-a8ad-02369dc46995 tempest-AttachVolumeNegativeTest-677114920 None] Flow 'volume_create_manager' (29cb2c18-9fb7-4c89-beb3-fe17ac71f4b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:46:30 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-bd64afa5-b627-407a-a8ad-02369dc46995 tempest-AttachVolumeNegativeTest-677114920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a40c4a35-77a0-42c2-9f25-70356d134a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:30 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-bd64afa5-b627-407a-a8ad-02369dc46995 tempest-AttachVolumeNegativeTest-677114920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a40c4a35-77a0-42c2-9f25-70356d134a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:46:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1120906466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=817c387c-1811-4c4a-aefe-b56d7d98de48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d7bf0ee4dd241ae89007f93f5fbefaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:46:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:46:30Z,use_quota=True,user_id='26133f3fc0794c73a867ebf2d1393d53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:30 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-bd64afa5-b627-407a-a8ad-02369dc46995 tempest-AttachVolumeNegativeTest-677114920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bb79e4a-a8d9-492d-bf97-729eddfc2952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:30 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-bd64afa5-b627-407a-a8ad-02369dc46995 tempest-AttachVolumeNegativeTest-677114920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bb79e4a-a8d9-492d-bf97-729eddfc2952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:30 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-bd64afa5-b627-407a-a8ad-02369dc46995 tempest-AttachVolumeNegativeTest-677114920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02192598-d4e2-4d26-8a63-3339e640ffed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:30 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-bd64afa5-b627-407a-a8ad-02369dc46995 tempest-AttachVolumeNegativeTest-677114920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02192598-d4e2-4d26-8a63-3339e640ffed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '817c387c-1811-4c4a-aefe-b56d7d98de48', 'volume_name': 'volume-817c387c-1811-4c4a-aefe-b56d7d98de48', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:30 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-bd64afa5-b627-407a-a8ad-02369dc46995 tempest-AttachVolumeNegativeTest-677114920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (535f89fb-5e25-405b-a096-a4a735427bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:30 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-bd64afa5-b627-407a-a8ad-02369dc46995 tempest-AttachVolumeNegativeTest-677114920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (535f89fb-5e25-405b-a096-a4a735427bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:30 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-bd64afa5-b627-407a-a8ad-02369dc46995 tempest-AttachVolumeNegativeTest-677114920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4188df4c-2d71-4454-b54c-74e04181065e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:30 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-bd64afa5-b627-407a-a8ad-02369dc46995 tempest-AttachVolumeNegativeTest-677114920 None] Volume 817c387c-1811-4c4a-aefe-b56d7d98de48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-817c387c-1811-4c4a-aefe-b56d7d98de48', 'volume_size': 1} Jul 08 01:46:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-bd64afa5-b627-407a-a8ad-02369dc46995 tempest-AttachVolumeNegativeTest-677114920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:30 devstack sudo[93347]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d4cba62f-7559-44ab-91ec-0f8103dc2f9c tempest-GroupSnapshotsTest-1290797889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c" returned: 0 in 1.015s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:30 devstack cinder-volume[87134]: DEBUG cinder.image.image_utils [None req-d4cba62f-7559-44ab-91ec-0f8103dc2f9c tempest-GroupSnapshotsTest-1290797889 None] Image conversion details: src /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c, size 1024.00 MB, duration 6.33 sec, destination /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-817ffa70-e3f3-446f-8b9c-cd98c681d3fd {{(pid=87134) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:46:30 devstack cinder-volume[87134]: INFO cinder.image.image_utils [None req-d4cba62f-7559-44ab-91ec-0f8103dc2f9c tempest-GroupSnapshotsTest-1290797889 None] Converted 1024.00 MB image at 161.83 MB/s Jul 08 01:46:30 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-d4cba62f-7559-44ab-91ec-0f8103dc2f9c tempest-GroupSnapshotsTest-1290797889 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-817ffa70-e3f3-446f-8b9c-cd98c681d3fd is being set with open permissions: ugo+rw: NotImplementedError Jul 08 01:46:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d4cba62f-7559-44ab-91ec-0f8103dc2f9c tempest-GroupSnapshotsTest-1290797889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-817ffa70-e3f3-446f-8b9c-cd98c681d3fd {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:30 devstack sudo[93360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-817ffa70-e3f3-446f-8b9c-cd98c681d3fd Jul 08 01:46:30 devstack sudo[93360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:30 devstack sudo[93352]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-22d3368d-9a11-45c9-8d92-835c2ddd6cb2 tempest-AttachVolumeTestJSON-1797241320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e8316f5a-c8a3-458c-9050-1d7493a16894" returned: 0 in 0.937s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-22d3368d-9a11-45c9-8d92-835c2ddd6cb2 tempest-AttachVolumeTestJSON-1797241320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e8316f5a-c8a3-458c-9050-1d7493a16894 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:30 devstack sudo[93362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e8316f5a-c8a3-458c-9050-1d7493a16894 Jul 08 01:46:30 devstack sudo[93362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:31 devstack sudo[93362]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-22d3368d-9a11-45c9-8d92-835c2ddd6cb2 tempest-AttachVolumeTestJSON-1797241320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e8316f5a-c8a3-458c-9050-1d7493a16894" returned: 0 in 0.638s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:31 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-22d3368d-9a11-45c9-8d92-835c2ddd6cb2 tempest-AttachVolumeTestJSON-1797241320 None] Lock "cinder-quobyte-e8316f5a-c8a3-458c-9050-1d7493a16894" released by "delete_volume" :: held 1.628s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:46:31 devstack sudo[93360]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d4cba62f-7559-44ab-91ec-0f8103dc2f9c tempest-GroupSnapshotsTest-1290797889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-817ffa70-e3f3-446f-8b9c-cd98c681d3fd" returned: 0 in 0.775s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:31 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-d4cba62f-7559-44ab-91ec-0f8103dc2f9c tempest-GroupSnapshotsTest-1290797889 None] Lock "cinder-quobyte-817ffa70-e3f3-446f-8b9c-cd98c681d3fd" released by "_copy_volume_from_snapshot" :: held 10.287s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:46:31 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-22d3368d-9a11-45c9-8d92-835c2ddd6cb2 tempest-AttachVolumeTestJSON-1797241320 None] Created reservations ['9132a0c9-dcb1-4c9c-9335-10e333df8d45', '7152df6f-94dc-4bb3-ac33-35ab0e954fc9', '1cbb4472-0a23-4316-8370-90860b2390c8', 'fce54c9d-3018-4b61-b433-8382e3fbce1a'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:46:31 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-d4cba62f-7559-44ab-91ec-0f8103dc2f9c tempest-GroupSnapshotsTest-1290797889 None] Lock "cinder-quobyte-4cf886bc-d04d-475c-8379-7b79fafb1cc6-817ffa70-e3f3-446f-8b9c-cd98c681d3fd" released by "_create_volume_from_snapshot" :: held 10.334s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:46:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-d4cba62f-7559-44ab-91ec-0f8103dc2f9c tempest-GroupSnapshotsTest-1290797889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.362s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5e569a9a-e7c8-45c0-a16e-54a9570d79d9 tempest-SnapshotsActionsTest-1208726570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.980s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:31 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-5e569a9a-e7c8-45c0-a16e-54a9570d79d9 tempest-SnapshotsActionsTest-1208726570 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:46:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1914700093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41e27e51-647a-4db5-a8d7-8e510c819658,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec8ae7f72c024af5965d9e3f4be41df6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:46:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:46:24Z,use_quota=True,user_id='8b55a44934014299b70f42bfcad06420',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:46:31 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-5e569a9a-e7c8-45c0-a16e-54a9570d79d9 tempest-SnapshotsActionsTest-1208726570 None] Creating volume 41e27e51-647a-4db5-a8d7-8e510c819658 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:46:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5e569a9a-e7c8-45c0-a16e-54a9570d79d9 tempest-SnapshotsActionsTest-1208726570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5e569a9a-e7c8-45c0-a16e-54a9570d79d9 tempest-SnapshotsActionsTest-1208726570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:31 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-5e569a9a-e7c8-45c0-a16e-54a9570d79d9 tempest-SnapshotsActionsTest-1208726570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:46:31 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-5e569a9a-e7c8-45c0-a16e-54a9570d79d9 tempest-SnapshotsActionsTest-1208726570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:46:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5e569a9a-e7c8-45c0-a16e-54a9570d79d9 tempest-SnapshotsActionsTest-1208726570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:31 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-5e569a9a-e7c8-45c0-a16e-54a9570d79d9 tempest-SnapshotsActionsTest-1208726570 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:46:31 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-5e569a9a-e7c8-45c0-a16e-54a9570d79d9 tempest-SnapshotsActionsTest-1208726570 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:46:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5e569a9a-e7c8-45c0-a16e-54a9570d79d9 tempest-SnapshotsActionsTest-1208726570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:31 devstack sudo[93367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658 1073741824 Jul 08 01:46:31 devstack sudo[93367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-22d3368d-9a11-45c9-8d92-835c2ddd6cb2 tempest-AttachVolumeTestJSON-1797241320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-22d3368d-9a11-45c9-8d92-835c2ddd6cb2 tempest-AttachVolumeTestJSON-1797241320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:31 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-22d3368d-9a11-45c9-8d92-835c2ddd6cb2 tempest-AttachVolumeTestJSON-1797241320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:46:31 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-22d3368d-9a11-45c9-8d92-835c2ddd6cb2 tempest-AttachVolumeTestJSON-1797241320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:46:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-22d3368d-9a11-45c9-8d92-835c2ddd6cb2 tempest-AttachVolumeTestJSON-1797241320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-22d3368d-9a11-45c9-8d92-835c2ddd6cb2 tempest-AttachVolumeTestJSON-1797241320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:31 devstack sudo[93369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:46:31 devstack sudo[93369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:31 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-d4cba62f-7559-44ab-91ec-0f8103dc2f9c tempest-GroupSnapshotsTest-1290797889 None] Create group from source-snapshot-48cb9475-ca7c-48f4-8be0-67b5ee4ca1b1 completed successfully. Jul 08 01:46:32 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-0755124b-c2a4-40f5-9233-1481cfa47a06 tempest-AttachVolumeTestJSON-1797241320 None] Acquiring lock "cinder-3073e016-9d88-4724-a234-a17a83eeeeb7-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:46:32 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-0755124b-c2a4-40f5-9233-1481cfa47a06 tempest-AttachVolumeTestJSON-1797241320 None] Lock "cinder-3073e016-9d88-4724-a234-a17a83eeeeb7-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:46:32 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-0755124b-c2a4-40f5-9233-1481cfa47a06 tempest-AttachVolumeTestJSON-1797241320 None] Acquiring lock "cinder-quobyte-3073e016-9d88-4724-a234-a17a83eeeeb7" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:46:32 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-0755124b-c2a4-40f5-9233-1481cfa47a06 tempest-AttachVolumeTestJSON-1797241320 None] Lock "cinder-quobyte-3073e016-9d88-4724-a234-a17a83eeeeb7" acquired by "delete_volume" :: waited 0.018s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:46:32 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2898d1-0509-44b8-8f14-6584d2927769]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:46:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-0755124b-c2a4-40f5-9233-1481cfa47a06 tempest-AttachVolumeTestJSON-1797241320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3073e016-9d88-4724-a234-a17a83eeeeb7 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:32 devstack sudo[93372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3073e016-9d88-4724-a234-a17a83eeeeb7 Jul 08 01:46:32 devstack sudo[93372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:32 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-dc09a286-ce29-48b7-b285-a7f34213a054 tempest-GroupSnapshotsTest-1290797889 None] Acquiring lock "cinder-quobyte-817ffa70-e3f3-446f-8b9c-cd98c681d3fd" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:46:32 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-dc09a286-ce29-48b7-b285-a7f34213a054 tempest-GroupSnapshotsTest-1290797889 None] Lock "cinder-quobyte-817ffa70-e3f3-446f-8b9c-cd98c681d3fd" acquired by "delete_volume" :: waited 0.026s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:46:32 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a2bf0d-4b9e-486c-a921-89f716f7187d]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:46:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-dc09a286-ce29-48b7-b285-a7f34213a054 tempest-GroupSnapshotsTest-1290797889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-817ffa70-e3f3-446f-8b9c-cd98c681d3fd {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:32 devstack sudo[93369]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-22d3368d-9a11-45c9-8d92-835c2ddd6cb2 tempest-AttachVolumeTestJSON-1797241320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.790s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:32 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-22d3368d-9a11-45c9-8d92-835c2ddd6cb2 tempest-AttachVolumeTestJSON-1797241320 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:46:32 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-22d3368d-9a11-45c9-8d92-835c2ddd6cb2 tempest-AttachVolumeTestJSON-1797241320 None] Deleted volume successfully. Jul 08 01:46:32 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-22d3368d-9a11-45c9-8d92-835c2ddd6cb2 tempest-AttachVolumeTestJSON-1797241320 None] Lock "cinder-e8316f5a-c8a3-458c-9050-1d7493a16894-delete_volume" released by "delete_volume" :: held 2.830s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:46:32 devstack sudo[93379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-817ffa70-e3f3-446f-8b9c-cd98c681d3fd Jul 08 01:46:32 devstack sudo[93379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:32 devstack sudo[93367]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5e569a9a-e7c8-45c0-a16e-54a9570d79d9 tempest-SnapshotsActionsTest-1208726570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658 1073741824" returned: 0 in 1.078s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5e569a9a-e7c8-45c0-a16e-54a9570d79d9 tempest-SnapshotsActionsTest-1208726570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:32 devstack sudo[93381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658 Jul 08 01:46:32 devstack sudo[93381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:33 devstack sudo[93372]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-0755124b-c2a4-40f5-9233-1481cfa47a06 tempest-AttachVolumeTestJSON-1797241320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3073e016-9d88-4724-a234-a17a83eeeeb7" returned: 0 in 0.977s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-0755124b-c2a4-40f5-9233-1481cfa47a06 tempest-AttachVolumeTestJSON-1797241320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3073e016-9d88-4724-a234-a17a83eeeeb7 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:33 devstack sudo[93386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3073e016-9d88-4724-a234-a17a83eeeeb7 Jul 08 01:46:33 devstack sudo[93386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:33 devstack sudo[93379]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-dc09a286-ce29-48b7-b285-a7f34213a054 tempest-GroupSnapshotsTest-1290797889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-817ffa70-e3f3-446f-8b9c-cd98c681d3fd" returned: 0 in 0.837s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-dc09a286-ce29-48b7-b285-a7f34213a054 tempest-GroupSnapshotsTest-1290797889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-817ffa70-e3f3-446f-8b9c-cd98c681d3fd {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:33 devstack sudo[93392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-817ffa70-e3f3-446f-8b9c-cd98c681d3fd Jul 08 01:46:33 devstack sudo[93392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:33 devstack sudo[93381]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5e569a9a-e7c8-45c0-a16e-54a9570d79d9 tempest-SnapshotsActionsTest-1208726570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658" returned: 0 in 0.681s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:33 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-5e569a9a-e7c8-45c0-a16e-54a9570d79d9 tempest-SnapshotsActionsTest-1208726570 None] <== create_volume: return (1815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:46:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5e569a9a-e7c8-45c0-a16e-54a9570d79d9 tempest-SnapshotsActionsTest-1208726570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.819s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-bd64afa5-b627-407a-a8ad-02369dc46995 tempest-AttachVolumeNegativeTest-677114920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.918s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:33 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-bd64afa5-b627-407a-a8ad-02369dc46995 tempest-AttachVolumeNegativeTest-677114920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:46:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1120906466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=817c387c-1811-4c4a-aefe-b56d7d98de48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d7bf0ee4dd241ae89007f93f5fbefaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:46:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:46:30Z,use_quota=True,user_id='26133f3fc0794c73a867ebf2d1393d53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:46:33 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-bd64afa5-b627-407a-a8ad-02369dc46995 tempest-AttachVolumeNegativeTest-677114920 None] Creating volume 817c387c-1811-4c4a-aefe-b56d7d98de48 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:46:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-bd64afa5-b627-407a-a8ad-02369dc46995 tempest-AttachVolumeNegativeTest-677114920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-bd64afa5-b627-407a-a8ad-02369dc46995 tempest-AttachVolumeNegativeTest-677114920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:33 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-bd64afa5-b627-407a-a8ad-02369dc46995 tempest-AttachVolumeNegativeTest-677114920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:46:33 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-bd64afa5-b627-407a-a8ad-02369dc46995 tempest-AttachVolumeNegativeTest-677114920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:46:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-bd64afa5-b627-407a-a8ad-02369dc46995 tempest-AttachVolumeNegativeTest-677114920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:33 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-bd64afa5-b627-407a-a8ad-02369dc46995 tempest-AttachVolumeNegativeTest-677114920 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:46:33 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-bd64afa5-b627-407a-a8ad-02369dc46995 tempest-AttachVolumeNegativeTest-677114920 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:46:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-bd64afa5-b627-407a-a8ad-02369dc46995 tempest-AttachVolumeNegativeTest-677114920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-817c387c-1811-4c4a-aefe-b56d7d98de48 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:33 devstack sudo[93394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-817c387c-1811-4c4a-aefe-b56d7d98de48 1073741824 Jul 08 01:46:33 devstack sudo[93394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:33 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5e569a9a-e7c8-45c0-a16e-54a9570d79d9 tempest-SnapshotsActionsTest-1208726570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4659d970-c924-4bf9-aab8-bf2be4cd3979) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41e27e51-647a-4db5-a8d7-8e510c819658', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:33 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5e569a9a-e7c8-45c0-a16e-54a9570d79d9 tempest-SnapshotsActionsTest-1208726570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f773fe1-acb9-4df1-95f7-e511dd829d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:33 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-5e569a9a-e7c8-45c0-a16e-54a9570d79d9 tempest-SnapshotsActionsTest-1208726570 None] Volume volume-41e27e51-647a-4db5-a8d7-8e510c819658 (41e27e51-647a-4db5-a8d7-8e510c819658): created successfully Jul 08 01:46:33 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5e569a9a-e7c8-45c0-a16e-54a9570d79d9 tempest-SnapshotsActionsTest-1208726570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f773fe1-acb9-4df1-95f7-e511dd829d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:33 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5e569a9a-e7c8-45c0-a16e-54a9570d79d9 tempest-SnapshotsActionsTest-1208726570 None] Flow 'volume_create_manager' (3c0929b7-5a1e-42e4-a586-f33fe692bf57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:46:33 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-5e569a9a-e7c8-45c0-a16e-54a9570d79d9 tempest-SnapshotsActionsTest-1208726570 None] Created volume successfully. Jul 08 01:46:33 devstack sudo[93386]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-0755124b-c2a4-40f5-9233-1481cfa47a06 tempest-AttachVolumeTestJSON-1797241320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3073e016-9d88-4724-a234-a17a83eeeeb7" returned: 0 in 0.718s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:33 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-0755124b-c2a4-40f5-9233-1481cfa47a06 tempest-AttachVolumeTestJSON-1797241320 None] Lock "cinder-quobyte-3073e016-9d88-4724-a234-a17a83eeeeb7" released by "delete_volume" :: held 1.754s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:46:33 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-0755124b-c2a4-40f5-9233-1481cfa47a06 tempest-AttachVolumeTestJSON-1797241320 None] Created reservations ['9d2c8287-c585-4527-964e-73906c1cdede', '06ecb959-9ce1-4ce6-a175-3ccf882110af', '3f2797a6-92ad-4a5e-baf5-eee636cecb0a', '65f0eba4-30a1-4aba-9bd3-48a6d1713bd0'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:46:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-0755124b-c2a4-40f5-9233-1481cfa47a06 tempest-AttachVolumeTestJSON-1797241320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-0755124b-c2a4-40f5-9233-1481cfa47a06 tempest-AttachVolumeTestJSON-1797241320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:34 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-0755124b-c2a4-40f5-9233-1481cfa47a06 tempest-AttachVolumeTestJSON-1797241320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:46:34 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-0755124b-c2a4-40f5-9233-1481cfa47a06 tempest-AttachVolumeTestJSON-1797241320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:46:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-0755124b-c2a4-40f5-9233-1481cfa47a06 tempest-AttachVolumeTestJSON-1797241320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-0755124b-c2a4-40f5-9233-1481cfa47a06 tempest-AttachVolumeTestJSON-1797241320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:34 devstack sudo[93398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:46:34 devstack sudo[93398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:34 devstack sudo[93392]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-dc09a286-ce29-48b7-b285-a7f34213a054 tempest-GroupSnapshotsTest-1290797889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-817ffa70-e3f3-446f-8b9c-cd98c681d3fd" returned: 0 in 0.744s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:34 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-dc09a286-ce29-48b7-b285-a7f34213a054 tempest-GroupSnapshotsTest-1290797889 None] Lock "cinder-quobyte-817ffa70-e3f3-446f-8b9c-cd98c681d3fd" released by "delete_volume" :: held 1.639s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:46:34 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-dc09a286-ce29-48b7-b285-a7f34213a054 tempest-GroupSnapshotsTest-1290797889 None] Created reservations ['9eec97a1-1955-464c-bbb0-c49e0a7c8d26'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:46:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-acb2fcb4-2a4f-4d77-b780-e387394b08a0 tempest-SnapshotsActionsTest-1208726570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:34 devstack cinder-volume[87134]: WARNING cinder.quota [None req-dc09a286-ce29-48b7-b285-a7f34213a054 tempest-GroupSnapshotsTest-1290797889 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1922575431 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1922575431, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:46:34 devstack cinder-volume[87134]: WARNING cinder.quota [None req-dc09a286-ce29-48b7-b285-a7f34213a054 tempest-GroupSnapshotsTest-1290797889 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1922575431 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1922575431, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:46:34 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-dc09a286-ce29-48b7-b285-a7f34213a054 tempest-GroupSnapshotsTest-1290797889 None] Created reservations ['9981ab73-da01-4601-8190-d95fa22ceb3d', 'a9ca24f5-e2d9-47cb-baa4-bca33e0b28d9', '4d593efc-384d-48e4-a338-fb55ce441364', '7f42cca3-7639-4afd-872f-054ea9f30b22'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:46:34 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-dfc47bdf-f80e-4722-96e2-66fd0d22785f tempest-AttachVolumeTestJSON-1797241320 None] Acquiring lock "cinder-369c1741-6616-4dd7-a99f-c342446dec3c-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:46:34 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-dfc47bdf-f80e-4722-96e2-66fd0d22785f tempest-AttachVolumeTestJSON-1797241320 None] Lock "cinder-369c1741-6616-4dd7-a99f-c342446dec3c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:46:34 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-dfc47bdf-f80e-4722-96e2-66fd0d22785f tempest-AttachVolumeTestJSON-1797241320 None] Acquiring lock "cinder-quobyte-369c1741-6616-4dd7-a99f-c342446dec3c" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:46:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-dc09a286-ce29-48b7-b285-a7f34213a054 tempest-GroupSnapshotsTest-1290797889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-dc09a286-ce29-48b7-b285-a7f34213a054 tempest-GroupSnapshotsTest-1290797889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:34 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-dc09a286-ce29-48b7-b285-a7f34213a054 tempest-GroupSnapshotsTest-1290797889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:46:34 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-dc09a286-ce29-48b7-b285-a7f34213a054 tempest-GroupSnapshotsTest-1290797889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:46:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-dc09a286-ce29-48b7-b285-a7f34213a054 tempest-GroupSnapshotsTest-1290797889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-dc09a286-ce29-48b7-b285-a7f34213a054 tempest-GroupSnapshotsTest-1290797889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:34 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-dfc47bdf-f80e-4722-96e2-66fd0d22785f tempest-AttachVolumeTestJSON-1797241320 None] Lock "cinder-quobyte-369c1741-6616-4dd7-a99f-c342446dec3c" acquired by "delete_volume" :: waited 0.038s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:46:34 devstack sudo[93394]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:34 devstack sudo[93404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:46:34 devstack sudo[93404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-bd64afa5-b627-407a-a8ad-02369dc46995 tempest-AttachVolumeNegativeTest-677114920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-817c387c-1811-4c4a-aefe-b56d7d98de48 1073741824" returned: 0 in 1.090s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:34 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e2ef40-5657-41a2-9718-edce4915e415]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:46:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-dfc47bdf-f80e-4722-96e2-66fd0d22785f tempest-AttachVolumeTestJSON-1797241320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-369c1741-6616-4dd7-a99f-c342446dec3c {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-bd64afa5-b627-407a-a8ad-02369dc46995 tempest-AttachVolumeNegativeTest-677114920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-817c387c-1811-4c4a-aefe-b56d7d98de48 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:34 devstack sudo[93407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-817c387c-1811-4c4a-aefe-b56d7d98de48 Jul 08 01:46:34 devstack sudo[93407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:34 devstack sudo[93406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-369c1741-6616-4dd7-a99f-c342446dec3c Jul 08 01:46:34 devstack sudo[93406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:34 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-6fa2a658-670d-4178-89f5-e79dc0ce6648 tempest-GroupSnapshotsTest-1290797889 None] group_snapshot 48cb9475-ca7c-48f4-8be0-67b5ee4ca1b1: deleting Jul 08 01:46:35 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6fa2a658-670d-4178-89f5-e79dc0ce6648 tempest-GroupSnapshotsTest-1290797889 None] group_snapshot 48cb9475-ca7c-48f4-8be0-67b5ee4ca1b1: deleting {{(pid=87134) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 08 01:46:35 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-6fa2a658-670d-4178-89f5-e79dc0ce6648 tempest-GroupSnapshotsTest-1290797889 None] Acquiring lock "cinder-quobyte-a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:46:35 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-6fa2a658-670d-4178-89f5-e79dc0ce6648 tempest-GroupSnapshotsTest-1290797889 None] Lock "cinder-quobyte-a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:46:35 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-6fa2a658-670d-4178-89f5-e79dc0ce6648 tempest-GroupSnapshotsTest-1290797889 None] Acquiring lock "cinder-quobyte-4cf886bc-d04d-475c-8379-7b79fafb1cc6" by "_delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:46:35 devstack sudo[93398]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-0755124b-c2a4-40f5-9233-1481cfa47a06 tempest-AttachVolumeTestJSON-1797241320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 1.051s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:35 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-0755124b-c2a4-40f5-9233-1481cfa47a06 tempest-AttachVolumeTestJSON-1797241320 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:46:35 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-6fa2a658-670d-4178-89f5-e79dc0ce6648 tempest-GroupSnapshotsTest-1290797889 None] Lock "cinder-quobyte-4cf886bc-d04d-475c-8379-7b79fafb1cc6" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:46:35 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-6fa2a658-670d-4178-89f5-e79dc0ce6648 tempest-GroupSnapshotsTest-1290797889 None] Deleting offline snapshot 4cf886bc-d04d-475c-8379-7b79fafb1cc6 of volume a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:46:35 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-6fa2a658-670d-4178-89f5-e79dc0ce6648 tempest-GroupSnapshotsTest-1290797889 None] snapshot_file for this snap is: volume-a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c.4cf886bc-d04d-475c-8379-7b79fafb1cc6 {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:46:35 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-0755124b-c2a4-40f5-9233-1481cfa47a06 tempest-AttachVolumeTestJSON-1797241320 None] Deleted volume successfully. Jul 08 01:46:35 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58f4671-a429-48cd-85d7-6f833b2d17b8]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:46:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6fa2a658-670d-4178-89f5-e79dc0ce6648 tempest-GroupSnapshotsTest-1290797889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c.4cf886bc-d04d-475c-8379-7b79fafb1cc6 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:35 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-0755124b-c2a4-40f5-9233-1481cfa47a06 tempest-AttachVolumeTestJSON-1797241320 None] Lock "cinder-3073e016-9d88-4724-a234-a17a83eeeeb7-delete_volume" released by "delete_volume" :: held 3.153s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:46:35 devstack sudo[93411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c.4cf886bc-d04d-475c-8379-7b79fafb1cc6 Jul 08 01:46:35 devstack sudo[93411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:35 devstack sudo[93404]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-dc09a286-ce29-48b7-b285-a7f34213a054 tempest-GroupSnapshotsTest-1290797889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.935s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:35 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-dc09a286-ce29-48b7-b285-a7f34213a054 tempest-GroupSnapshotsTest-1290797889 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:46:35 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-dc09a286-ce29-48b7-b285-a7f34213a054 tempest-GroupSnapshotsTest-1290797889 None] Delete group completed successfully. Jul 08 01:46:35 devstack sudo[93407]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-bd64afa5-b627-407a-a8ad-02369dc46995 tempest-AttachVolumeNegativeTest-677114920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-817c387c-1811-4c4a-aefe-b56d7d98de48" returned: 0 in 0.881s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:35 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-bd64afa5-b627-407a-a8ad-02369dc46995 tempest-AttachVolumeNegativeTest-677114920 None] <== create_volume: return (2030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:46:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-bd64afa5-b627-407a-a8ad-02369dc46995 tempest-AttachVolumeNegativeTest-677114920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.033s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-acb2fcb4-2a4f-4d77-b780-e387394b08a0 tempest-SnapshotsActionsTest-1208726570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.222s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:35 devstack sudo[93406]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-dfc47bdf-f80e-4722-96e2-66fd0d22785f tempest-AttachVolumeTestJSON-1797241320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-369c1741-6616-4dd7-a99f-c342446dec3c" returned: 0 in 0.926s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-dfc47bdf-f80e-4722-96e2-66fd0d22785f tempest-AttachVolumeTestJSON-1797241320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-369c1741-6616-4dd7-a99f-c342446dec3c {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:35 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-bd64afa5-b627-407a-a8ad-02369dc46995 tempest-AttachVolumeNegativeTest-677114920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4188df4c-2d71-4454-b54c-74e04181065e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-817c387c-1811-4c4a-aefe-b56d7d98de48', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:35 devstack sudo[93419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-369c1741-6616-4dd7-a99f-c342446dec3c Jul 08 01:46:35 devstack sudo[93419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:35 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-bd64afa5-b627-407a-a8ad-02369dc46995 tempest-AttachVolumeNegativeTest-677114920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa7f47cb-d03f-4830-a1d7-df09075e009e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:35 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-acb2fcb4-2a4f-4d77-b780-e387394b08a0 tempest-SnapshotsActionsTest-1208726570 None] Creating offline snapshot 1432a5c9-0a9f-46a6-a0b9-57de9ecf375e of volume 41e27e51-647a-4db5-a8d7-8e510c819658 {{(pid=87134) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:46:35 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-bd64afa5-b627-407a-a8ad-02369dc46995 tempest-AttachVolumeNegativeTest-677114920 None] Volume volume-817c387c-1811-4c4a-aefe-b56d7d98de48 (817c387c-1811-4c4a-aefe-b56d7d98de48): created successfully Jul 08 01:46:35 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-bd64afa5-b627-407a-a8ad-02369dc46995 tempest-AttachVolumeNegativeTest-677114920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa7f47cb-d03f-4830-a1d7-df09075e009e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:35 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-bd64afa5-b627-407a-a8ad-02369dc46995 tempest-AttachVolumeNegativeTest-677114920 None] Flow 'volume_create_manager' (29cb2c18-9fb7-4c89-beb3-fe17ac71f4b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:46:35 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc0f3c6-1bf1-45a4-95d4-bff3a8606318]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:46:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-acb2fcb4-2a4f-4d77-b780-e387394b08a0 tempest-SnapshotsActionsTest-1208726570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:35 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-bd64afa5-b627-407a-a8ad-02369dc46995 tempest-AttachVolumeNegativeTest-677114920 None] Created volume successfully. Jul 08 01:46:35 devstack sudo[93421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658 Jul 08 01:46:35 devstack sudo[93421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:36 devstack sudo[93411]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6fa2a658-670d-4178-89f5-e79dc0ce6648 tempest-GroupSnapshotsTest-1290797889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c.4cf886bc-d04d-475c-8379-7b79fafb1cc6" returned: 0 in 0.909s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:36 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-6fa2a658-670d-4178-89f5-e79dc0ce6648 tempest-GroupSnapshotsTest-1290797889 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:46:36 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[511e1deb-ea66-4966-aab5-95095193f306]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:46:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6fa2a658-670d-4178-89f5-e79dc0ce6648 tempest-GroupSnapshotsTest-1290797889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:36 devstack sudo[93431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c Jul 08 01:46:36 devstack sudo[93431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:36 devstack sudo[93419]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-dfc47bdf-f80e-4722-96e2-66fd0d22785f tempest-AttachVolumeTestJSON-1797241320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-369c1741-6616-4dd7-a99f-c342446dec3c" returned: 0 in 0.751s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:36 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-dfc47bdf-f80e-4722-96e2-66fd0d22785f tempest-AttachVolumeTestJSON-1797241320 None] Lock "cinder-quobyte-369c1741-6616-4dd7-a99f-c342446dec3c" released by "delete_volume" :: held 1.738s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:46:36 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-dfc47bdf-f80e-4722-96e2-66fd0d22785f tempest-AttachVolumeTestJSON-1797241320 None] Created reservations ['26f4fa72-7874-4f10-8358-fef357a2dea8', 'efe924a5-9131-4b8e-8dc2-db5515b1f607', 'be2f8965-731d-4ed6-960d-0749b9bf7c72', '1208d66e-bdd0-4de4-8d1d-6a9cdf29ff9d'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:46:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-dfc47bdf-f80e-4722-96e2-66fd0d22785f tempest-AttachVolumeTestJSON-1797241320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-dfc47bdf-f80e-4722-96e2-66fd0d22785f tempest-AttachVolumeTestJSON-1797241320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:36 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-dfc47bdf-f80e-4722-96e2-66fd0d22785f tempest-AttachVolumeTestJSON-1797241320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:46:36 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-dfc47bdf-f80e-4722-96e2-66fd0d22785f tempest-AttachVolumeTestJSON-1797241320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:46:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-dfc47bdf-f80e-4722-96e2-66fd0d22785f tempest-AttachVolumeTestJSON-1797241320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-dfc47bdf-f80e-4722-96e2-66fd0d22785f tempest-AttachVolumeTestJSON-1797241320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:36 devstack sudo[93436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:46:36 devstack sudo[93436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:36 devstack sudo[93421]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-acb2fcb4-2a4f-4d77-b780-e387394b08a0 tempest-SnapshotsActionsTest-1208726570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658" returned: 0 in 0.870s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-acb2fcb4-2a4f-4d77-b780-e387394b08a0 tempest-SnapshotsActionsTest-1208726570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.1432a5c9-0a9f-46a6-a0b9-57de9ecf375e 1G {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:36 devstack sudo[93438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.1432a5c9-0a9f-46a6-a0b9-57de9ecf375e 1G Jul 08 01:46:36 devstack sudo[93438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:37 devstack sudo[93431]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6fa2a658-670d-4178-89f5-e79dc0ce6648 tempest-GroupSnapshotsTest-1290797889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c" returned: 0 in 0.876s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6fa2a658-670d-4178-89f5-e79dc0ce6648 tempest-GroupSnapshotsTest-1290797889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c.4cf886bc-d04d-475c-8379-7b79fafb1cc6 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:37 devstack sudo[93445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c.4cf886bc-d04d-475c-8379-7b79fafb1cc6 Jul 08 01:46:37 devstack sudo[93445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:37 devstack sudo[93436]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-dfc47bdf-f80e-4722-96e2-66fd0d22785f tempest-AttachVolumeTestJSON-1797241320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.753s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:37 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-dfc47bdf-f80e-4722-96e2-66fd0d22785f tempest-AttachVolumeTestJSON-1797241320 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:46:37 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-dfc47bdf-f80e-4722-96e2-66fd0d22785f tempest-AttachVolumeTestJSON-1797241320 None] Deleted volume successfully. Jul 08 01:46:37 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-dfc47bdf-f80e-4722-96e2-66fd0d22785f tempest-AttachVolumeTestJSON-1797241320 None] Lock "cinder-369c1741-6616-4dd7-a99f-c342446dec3c-delete_volume" released by "delete_volume" :: held 2.757s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:46:37 devstack sudo[93438]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-acb2fcb4-2a4f-4d77-b780-e387394b08a0 tempest-SnapshotsActionsTest-1208726570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.1432a5c9-0a9f-46a6-a0b9-57de9ecf375e 1G" returned: 0 in 0.913s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-acb2fcb4-2a4f-4d77-b780-e387394b08a0 tempest-SnapshotsActionsTest-1208726570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41e27e51-647a-4db5-a8d7-8e510c819658 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.1432a5c9-0a9f-46a6-a0b9-57de9ecf375e {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:37 devstack sudo[93451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41e27e51-647a-4db5-a8d7-8e510c819658 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.1432a5c9-0a9f-46a6-a0b9-57de9ecf375e Jul 08 01:46:37 devstack sudo[93451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:37 devstack sudo[93445]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6fa2a658-670d-4178-89f5-e79dc0ce6648 tempest-GroupSnapshotsTest-1290797889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c.4cf886bc-d04d-475c-8379-7b79fafb1cc6" returned: 0 in 0.918s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6fa2a658-670d-4178-89f5-e79dc0ce6648 tempest-GroupSnapshotsTest-1290797889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c.4cf886bc-d04d-475c-8379-7b79fafb1cc6 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:37 devstack sudo[93456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c.4cf886bc-d04d-475c-8379-7b79fafb1cc6 Jul 08 01:46:37 devstack sudo[93456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:38 devstack sudo[93451]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-acb2fcb4-2a4f-4d77-b780-e387394b08a0 tempest-SnapshotsActionsTest-1208726570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41e27e51-647a-4db5-a8d7-8e510c819658 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.1432a5c9-0a9f-46a6-a0b9-57de9ecf375e" returned: 0 in 0.794s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:38 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-acb2fcb4-2a4f-4d77-b780-e387394b08a0 tempest-SnapshotsActionsTest-1208726570 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.1432a5c9-0a9f-46a6-a0b9-57de9ecf375e is being set with open permissions: ugo+rw Jul 08 01:46:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-acb2fcb4-2a4f-4d77-b780-e387394b08a0 tempest-SnapshotsActionsTest-1208726570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.1432a5c9-0a9f-46a6-a0b9-57de9ecf375e {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:38 devstack sudo[93463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.1432a5c9-0a9f-46a6-a0b9-57de9ecf375e Jul 08 01:46:38 devstack sudo[93463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:38 devstack sudo[93456]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6fa2a658-670d-4178-89f5-e79dc0ce6648 tempest-GroupSnapshotsTest-1290797889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c.4cf886bc-d04d-475c-8379-7b79fafb1cc6" returned: 0 in 0.790s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:38 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-6fa2a658-670d-4178-89f5-e79dc0ce6648 tempest-GroupSnapshotsTest-1290797889 None] Lock "cinder-quobyte-4cf886bc-d04d-475c-8379-7b79fafb1cc6" released by "_delete_snapshot" :: held 3.655s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:46:38 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-6fa2a658-670d-4178-89f5-e79dc0ce6648 tempest-GroupSnapshotsTest-1290797889 None] Lock "cinder-quobyte-a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c" released by "delete_snapshot" :: held 3.692s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:46:38 devstack cinder-volume[87134]: WARNING cinder.quota [None req-6fa2a658-670d-4178-89f5-e79dc0ce6648 tempest-GroupSnapshotsTest-1290797889 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1922575431 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1922575431, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:46:38 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-6fa2a658-670d-4178-89f5-e79dc0ce6648 tempest-GroupSnapshotsTest-1290797889 None] Created reservations ['a5b306e4-81f3-4a46-b837-9a7a78690492', '15ee8def-68d2-40d3-b72f-ee9b2352dddd', 'b5dca50c-88bf-4ba1-abdf-12d19458f3e3', '040a3104-5a98-475d-98d5-792711382530'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:46:38 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-6fa2a658-670d-4178-89f5-e79dc0ce6648 tempest-GroupSnapshotsTest-1290797889 None] group_snapshot 48cb9475-ca7c-48f4-8be0-67b5ee4ca1b1: deleted successfully Jul 08 01:46:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-8cf0fd27-f300-446a-ac55-597411c1435d req-4302240a-367d-4fef-86df-78897020da63 tempest-AttachVolumeNegativeTest-677114920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:38 devstack sudo[93463]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-acb2fcb4-2a4f-4d77-b780-e387394b08a0 tempest-SnapshotsActionsTest-1208726570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.1432a5c9-0a9f-46a6-a0b9-57de9ecf375e" returned: 0 in 0.807s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-acb2fcb4-2a4f-4d77-b780-e387394b08a0 tempest-SnapshotsActionsTest-1208726570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:39 devstack sudo[93476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.info Jul 08 01:46:39 devstack sudo[93476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:39 devstack sudo[93476]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-acb2fcb4-2a4f-4d77-b780-e387394b08a0 tempest-SnapshotsActionsTest-1208726570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.info" returned: 0 in 0.731s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:39 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-acb2fcb4-2a4f-4d77-b780-e387394b08a0 tempest-SnapshotsActionsTest-1208726570 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.info is being set with open permissions: ugo+rw Jul 08 01:46:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-acb2fcb4-2a4f-4d77-b780-e387394b08a0 tempest-SnapshotsActionsTest-1208726570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:39 devstack sudo[93479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.info Jul 08 01:46:39 devstack sudo[93479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:39 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-4fd6737a-83ae-4e49-939d-16f233cfda32 tempest-GroupSnapshotsTest-1290797889 None] Acquiring lock "cinder-quobyte-a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:46:39 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-4fd6737a-83ae-4e49-939d-16f233cfda32 tempest-GroupSnapshotsTest-1290797889 None] Lock "cinder-quobyte-a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c" acquired by "delete_volume" :: waited 0.019s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:46:39 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[84fb1a97-b1e6-4a0b-baa8-11932b642787]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:46:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4fd6737a-83ae-4e49-939d-16f233cfda32 tempest-GroupSnapshotsTest-1290797889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:40 devstack sudo[93481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c Jul 08 01:46:40 devstack sudo[93481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:40 devstack sudo[93479]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-acb2fcb4-2a4f-4d77-b780-e387394b08a0 tempest-SnapshotsActionsTest-1208726570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.info" returned: 0 in 0.786s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-acb2fcb4-2a4f-4d77-b780-e387394b08a0 tempest-SnapshotsActionsTest-1208726570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.060s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-8cf0fd27-f300-446a-ac55-597411c1435d req-4302240a-367d-4fef-86df-78897020da63 tempest-AttachVolumeNegativeTest-677114920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.586s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:40 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a2d56b-0a58-46a2-a10d-6507bb41a951]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:46:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-8cf0fd27-f300-446a-ac55-597411c1435d req-4302240a-367d-4fef-86df-78897020da63 tempest-AttachVolumeNegativeTest-677114920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-817c387c-1811-4c4a-aefe-b56d7d98de48 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:40 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-acb2fcb4-2a4f-4d77-b780-e387394b08a0 tempest-SnapshotsActionsTest-1208726570 None] Create snapshot completed successfully Jul 08 01:46:40 devstack sudo[93484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-817c387c-1811-4c4a-aefe-b56d7d98de48 Jul 08 01:46:40 devstack sudo[93484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:40 devstack sudo[93481]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4fd6737a-83ae-4e49-939d-16f233cfda32 tempest-GroupSnapshotsTest-1290797889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c" returned: 0 in 0.920s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4fd6737a-83ae-4e49-939d-16f233cfda32 tempest-GroupSnapshotsTest-1290797889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:40 devstack sudo[93490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c Jul 08 01:46:40 devstack sudo[93490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:41 devstack sudo[93484]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-8cf0fd27-f300-446a-ac55-597411c1435d req-4302240a-367d-4fef-86df-78897020da63 tempest-AttachVolumeNegativeTest-677114920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-817c387c-1811-4c4a-aefe-b56d7d98de48" returned: 0 in 0.880s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-8cf0fd27-f300-446a-ac55-597411c1435d req-4302240a-367d-4fef-86df-78897020da63 tempest-AttachVolumeNegativeTest-677114920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.909s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:41 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [req-8cf0fd27-f300-446a-ac55-597411c1435d req-4302240a-367d-4fef-86df-78897020da63 tempest-AttachVolumeNegativeTest-677114920 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17', 'name': 'volume-817c387c-1811-4c4a-aefe-b56d7d98de48', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dd0064f0-f031-469b-ac0d-01e97d901e64', 'enforce_multipath': True} {{(pid=87134) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:46:41 devstack cinder-volume[87134]: INFO cinder.volume.manager [req-8cf0fd27-f300-446a-ac55-597411c1435d req-4302240a-367d-4fef-86df-78897020da63 tempest-AttachVolumeNegativeTest-677114920 None] attachment_update completed successfully. Jul 08 01:46:41 devstack sudo[93490]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4fd6737a-83ae-4e49-939d-16f233cfda32 tempest-GroupSnapshotsTest-1290797889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c" returned: 0 in 0.822s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:41 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-4fd6737a-83ae-4e49-939d-16f233cfda32 tempest-GroupSnapshotsTest-1290797889 None] Lock "cinder-quobyte-a0349e53-4e6f-43ef-8d1a-b37e10cd4a8c" released by "delete_volume" :: held 1.879s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:46:41 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-4fd6737a-83ae-4e49-939d-16f233cfda32 tempest-GroupSnapshotsTest-1290797889 None] Created reservations ['19bfdc13-91d9-47ab-ab3e-d9b2daa9914f'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:46:41 devstack cinder-volume[87134]: WARNING cinder.db.api [None req-4fd6737a-83ae-4e49-939d-16f233cfda32 tempest-GroupSnapshotsTest-1290797889 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1922575431'] Jul 08 01:46:41 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-4fd6737a-83ae-4e49-939d-16f233cfda32 tempest-GroupSnapshotsTest-1290797889 None] Created reservations ['2ea7cfe8-07d8-41b4-8631-d751666dbc1d', '2c67dc13-7e48-4baa-b9ee-b1a6d04c3f7a', 'ff703d9f-94b4-4f48-8a1f-cc0c5dd7b654', 'af52e02d-3de5-49ad-a3f3-04ad919cddda'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:46:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-4fd6737a-83ae-4e49-939d-16f233cfda32 tempest-GroupSnapshotsTest-1290797889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-4fd6737a-83ae-4e49-939d-16f233cfda32 tempest-GroupSnapshotsTest-1290797889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:41 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-4fd6737a-83ae-4e49-939d-16f233cfda32 tempest-GroupSnapshotsTest-1290797889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:46:41 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-4fd6737a-83ae-4e49-939d-16f233cfda32 tempest-GroupSnapshotsTest-1290797889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:46:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-4fd6737a-83ae-4e49-939d-16f233cfda32 tempest-GroupSnapshotsTest-1290797889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4fd6737a-83ae-4e49-939d-16f233cfda32 tempest-GroupSnapshotsTest-1290797889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:42 devstack sudo[93496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:46:42 devstack sudo[93496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-fdb6af1a-f185-437f-a8ba-18390bd5e47f tempest-SnapshotsActionsTest-1208726570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-fdb6af1a-f185-437f-a8ba-18390bd5e47f tempest-SnapshotsActionsTest-1208726570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:42 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-fdb6af1a-f185-437f-a8ba-18390bd5e47f tempest-SnapshotsActionsTest-1208726570 None] Creating offline snapshot 96e141b3-8986-4dc2-9950-4e299e23bd77 of volume 41e27e51-647a-4db5-a8d7-8e510c819658 {{(pid=87134) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:46:42 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[2634f1fb-016f-4cf8-b2e9-7fd6c81b4f78]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:46:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-fdb6af1a-f185-437f-a8ba-18390bd5e47f tempest-SnapshotsActionsTest-1208726570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.1432a5c9-0a9f-46a6-a0b9-57de9ecf375e {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:43 devstack sudo[93881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.1432a5c9-0a9f-46a6-a0b9-57de9ecf375e Jul 08 01:46:43 devstack sudo[93881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:43 devstack sudo[93496]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4fd6737a-83ae-4e49-939d-16f233cfda32 tempest-GroupSnapshotsTest-1290797889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 1.080s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:43 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-4fd6737a-83ae-4e49-939d-16f233cfda32 tempest-GroupSnapshotsTest-1290797889 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:46:43 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-4fd6737a-83ae-4e49-939d-16f233cfda32 tempest-GroupSnapshotsTest-1290797889 None] Delete group completed successfully. Jul 08 01:46:43 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-92266db3-4a65-4f3c-a373-97b4944bf982 tempest-GroupSnapshotsTest-1290797889 None] Group tempest-GroupSnapshotsTest-Group-1110412648: creating Jul 08 01:46:43 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-92266db3-4a65-4f3c-a373-97b4944bf982 tempest-GroupSnapshotsTest-1290797889 None] Group tempest-GroupSnapshotsTest-Group-1110412648: created successfully Jul 08 01:46:43 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-92266db3-4a65-4f3c-a373-97b4944bf982 tempest-GroupSnapshotsTest-1290797889 None] Create group completed successfully. Jul 08 01:46:43 devstack sudo[93881]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-fdb6af1a-f185-437f-a8ba-18390bd5e47f tempest-SnapshotsActionsTest-1208726570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.1432a5c9-0a9f-46a6-a0b9-57de9ecf375e" returned: 0 in 0.849s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:43 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-fdb6af1a-f185-437f-a8ba-18390bd5e47f tempest-SnapshotsActionsTest-1208726570 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41e27e51-647a-4db5-a8d7-8e510c819658(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:46:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-fdb6af1a-f185-437f-a8ba-18390bd5e47f tempest-SnapshotsActionsTest-1208726570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.1432a5c9-0a9f-46a6-a0b9-57de9ecf375e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.96e141b3-8986-4dc2-9950-4e299e23bd77 1G {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:43 devstack sudo[93887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.1432a5c9-0a9f-46a6-a0b9-57de9ecf375e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.96e141b3-8986-4dc2-9950-4e299e23bd77 1G Jul 08 01:46:43 devstack sudo[93887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:44 devstack sudo[93887]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-fdb6af1a-f185-437f-a8ba-18390bd5e47f tempest-SnapshotsActionsTest-1208726570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.1432a5c9-0a9f-46a6-a0b9-57de9ecf375e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.96e141b3-8986-4dc2-9950-4e299e23bd77 1G" returned: 0 in 1.004s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-fdb6af1a-f185-437f-a8ba-18390bd5e47f tempest-SnapshotsActionsTest-1208726570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41e27e51-647a-4db5-a8d7-8e510c819658.1432a5c9-0a9f-46a6-a0b9-57de9ecf375e -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.96e141b3-8986-4dc2-9950-4e299e23bd77 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:44 devstack sudo[93893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41e27e51-647a-4db5-a8d7-8e510c819658.1432a5c9-0a9f-46a6-a0b9-57de9ecf375e -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.96e141b3-8986-4dc2-9950-4e299e23bd77 Jul 08 01:46:44 devstack sudo[93893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:44 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-e166d4ab-0093-4f73-b3d1-7f7b35549298 tempest-GroupSnapshotsTest-1290797889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:46:44 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e166d4ab-0093-4f73-b3d1-7f7b35549298 tempest-GroupSnapshotsTest-1290797889 None] Flow 'volume_create_manager' (3097bbdb-bdab-4f7d-a671-3ba67b3a6a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:46:44 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e166d4ab-0093-4f73-b3d1-7f7b35549298 tempest-GroupSnapshotsTest-1290797889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa84eb74-4f7d-4614-b988-daa82478c315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:44 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e166d4ab-0093-4f73-b3d1-7f7b35549298 tempest-GroupSnapshotsTest-1290797889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa84eb74-4f7d-4614-b988-daa82478c315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:46:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-936629679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f7d5b53f-6526-4663-984b-dec52dba8530,host='devstack@QuobyteHD#QuobyteHD',id=a2cdf661-d32a-49d5-8fe8-78cd456896d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97c67429d4724bfc8f5a6fe449493946',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:46:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:46:45Z,use_quota=True,user_id='48d3a3ec668e45d9868f061cc6e1f0c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed6f8986-1582-4712-a39b-aa86c971fb70),volume_type_id=ed6f8986-1582-4712-a39b-aa86c971fb70)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:44 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e166d4ab-0093-4f73-b3d1-7f7b35549298 tempest-GroupSnapshotsTest-1290797889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eeaf4ce3-b6be-4bae-8a55-0597cc499c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:44 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e166d4ab-0093-4f73-b3d1-7f7b35549298 tempest-GroupSnapshotsTest-1290797889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eeaf4ce3-b6be-4bae-8a55-0597cc499c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:44 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e166d4ab-0093-4f73-b3d1-7f7b35549298 tempest-GroupSnapshotsTest-1290797889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dc1b975-040e-4c0e-a0d8-05ae4c4ad278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:44 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e166d4ab-0093-4f73-b3d1-7f7b35549298 tempest-GroupSnapshotsTest-1290797889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dc1b975-040e-4c0e-a0d8-05ae4c4ad278) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2cdf661-d32a-49d5-8fe8-78cd456896d2', 'volume_name': 'volume-a2cdf661-d32a-49d5-8fe8-78cd456896d2', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:44 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e166d4ab-0093-4f73-b3d1-7f7b35549298 tempest-GroupSnapshotsTest-1290797889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cec4b5a1-4ddc-4730-b4f9-f178d04f208c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:44 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e166d4ab-0093-4f73-b3d1-7f7b35549298 tempest-GroupSnapshotsTest-1290797889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cec4b5a1-4ddc-4730-b4f9-f178d04f208c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:44 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e166d4ab-0093-4f73-b3d1-7f7b35549298 tempest-GroupSnapshotsTest-1290797889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba3e431c-1387-4da3-b783-b71a46b47c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:44 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-e166d4ab-0093-4f73-b3d1-7f7b35549298 tempest-GroupSnapshotsTest-1290797889 None] Volume a2cdf661-d32a-49d5-8fe8-78cd456896d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2cdf661-d32a-49d5-8fe8-78cd456896d2', 'volume_size': 1} Jul 08 01:46:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e166d4ab-0093-4f73-b3d1-7f7b35549298 tempest-GroupSnapshotsTest-1290797889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:45 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [req-3707cf14-d5fd-47b9-8562-2324da50e976 req-0a9f56a5-cf0d-4e4e-a8b6-691bb75697f3 tempest-VolumesSnapshotsTestJSON-1763905505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:46:45 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [req-3707cf14-d5fd-47b9-8562-2324da50e976 req-0a9f56a5-cf0d-4e4e-a8b6-691bb75697f3 tempest-VolumesSnapshotsTestJSON-1763905505 None] Flow 'volume_create_manager' (5fc1dc87-2275-4537-9b0c-7b5b39df58e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:46:45 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [req-3707cf14-d5fd-47b9-8562-2324da50e976 req-0a9f56a5-cf0d-4e4e-a8b6-691bb75697f3 tempest-VolumesSnapshotsTestJSON-1763905505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d3580f0-2af7-47ad-9d21-3d1050c86ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:45 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [req-3707cf14-d5fd-47b9-8562-2324da50e976 req-0a9f56a5-cf0d-4e4e-a8b6-691bb75697f3 tempest-VolumesSnapshotsTestJSON-1763905505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d3580f0-2af7-47ad-9d21-3d1050c86ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:46:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-789374181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34e139f7-b1f0-420f-bce6-2b13b9d3f019,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a39741418eb843d58f804e2cba3f4228',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:46:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:46:45Z,use_quota=True,user_id='5d478a18648542279e3ca014ef4cabd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:45 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [req-3707cf14-d5fd-47b9-8562-2324da50e976 req-0a9f56a5-cf0d-4e4e-a8b6-691bb75697f3 tempest-VolumesSnapshotsTestJSON-1763905505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (937e1e59-8e02-4aaa-aabc-753d6a178c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:45 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [req-3707cf14-d5fd-47b9-8562-2324da50e976 req-0a9f56a5-cf0d-4e4e-a8b6-691bb75697f3 tempest-VolumesSnapshotsTestJSON-1763905505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (937e1e59-8e02-4aaa-aabc-753d6a178c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:45 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [req-3707cf14-d5fd-47b9-8562-2324da50e976 req-0a9f56a5-cf0d-4e4e-a8b6-691bb75697f3 tempest-VolumesSnapshotsTestJSON-1763905505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aceddada-3eec-4da5-b909-301a50dbce56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:45 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [req-3707cf14-d5fd-47b9-8562-2324da50e976 req-0a9f56a5-cf0d-4e4e-a8b6-691bb75697f3 tempest-VolumesSnapshotsTestJSON-1763905505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aceddada-3eec-4da5-b909-301a50dbce56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34e139f7-b1f0-420f-bce6-2b13b9d3f019', 'volume_name': 'volume-34e139f7-b1f0-420f-bce6-2b13b9d3f019', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:45 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [req-3707cf14-d5fd-47b9-8562-2324da50e976 req-0a9f56a5-cf0d-4e4e-a8b6-691bb75697f3 tempest-VolumesSnapshotsTestJSON-1763905505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80fce18c-e0bb-4f39-abc3-a29d83f29a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:45 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [req-3707cf14-d5fd-47b9-8562-2324da50e976 req-0a9f56a5-cf0d-4e4e-a8b6-691bb75697f3 tempest-VolumesSnapshotsTestJSON-1763905505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80fce18c-e0bb-4f39-abc3-a29d83f29a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:45 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [req-3707cf14-d5fd-47b9-8562-2324da50e976 req-0a9f56a5-cf0d-4e4e-a8b6-691bb75697f3 tempest-VolumesSnapshotsTestJSON-1763905505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0aa4116e-afc7-4827-9a12-640e4e417c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:45 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [req-3707cf14-d5fd-47b9-8562-2324da50e976 req-0a9f56a5-cf0d-4e4e-a8b6-691bb75697f3 tempest-VolumesSnapshotsTestJSON-1763905505 None] Volume 34e139f7-b1f0-420f-bce6-2b13b9d3f019: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34e139f7-b1f0-420f-bce6-2b13b9d3f019', 'volume_size': 1} Jul 08 01:46:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-3707cf14-d5fd-47b9-8562-2324da50e976 req-0a9f56a5-cf0d-4e4e-a8b6-691bb75697f3 tempest-VolumesSnapshotsTestJSON-1763905505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:45 devstack sudo[93893]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-fdb6af1a-f185-437f-a8ba-18390bd5e47f tempest-SnapshotsActionsTest-1208726570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41e27e51-647a-4db5-a8d7-8e510c819658.1432a5c9-0a9f-46a6-a0b9-57de9ecf375e -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.96e141b3-8986-4dc2-9950-4e299e23bd77" returned: 0 in 0.776s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:45 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-fdb6af1a-f185-437f-a8ba-18390bd5e47f tempest-SnapshotsActionsTest-1208726570 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.96e141b3-8986-4dc2-9950-4e299e23bd77 is being set with open permissions: ugo+rw Jul 08 01:46:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-fdb6af1a-f185-437f-a8ba-18390bd5e47f tempest-SnapshotsActionsTest-1208726570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.96e141b3-8986-4dc2-9950-4e299e23bd77 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:45 devstack sudo[93898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.96e141b3-8986-4dc2-9950-4e299e23bd77 Jul 08 01:46:45 devstack sudo[93898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:46 devstack sudo[93898]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-fdb6af1a-f185-437f-a8ba-18390bd5e47f tempest-SnapshotsActionsTest-1208726570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.96e141b3-8986-4dc2-9950-4e299e23bd77" returned: 0 in 0.665s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-fdb6af1a-f185-437f-a8ba-18390bd5e47f tempest-SnapshotsActionsTest-1208726570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.452s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e166d4ab-0093-4f73-b3d1-7f7b35549298 tempest-GroupSnapshotsTest-1290797889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.296s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:46 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-e166d4ab-0093-4f73-b3d1-7f7b35549298 tempest-GroupSnapshotsTest-1290797889 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f7d5b53f-6526-4663-984b-dec52dba8530,created_at=2026-07-07T23:46:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-936629679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f7d5b53f-6526-4663-984b-dec52dba8530,host='devstack@QuobyteHD#QuobyteHD',id=a2cdf661-d32a-49d5-8fe8-78cd456896d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97c67429d4724bfc8f5a6fe449493946',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:46:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:46:45Z,use_quota=True,user_id='48d3a3ec668e45d9868f061cc6e1f0c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed6f8986-1582-4712-a39b-aa86c971fb70),volume_type_id=ed6f8986-1582-4712-a39b-aa86c971fb70)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:46:46 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-e166d4ab-0093-4f73-b3d1-7f7b35549298 tempest-GroupSnapshotsTest-1290797889 None] Creating volume a2cdf661-d32a-49d5-8fe8-78cd456896d2 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:46:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e166d4ab-0093-4f73-b3d1-7f7b35549298 tempest-GroupSnapshotsTest-1290797889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e166d4ab-0093-4f73-b3d1-7f7b35549298 tempest-GroupSnapshotsTest-1290797889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:46 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-e166d4ab-0093-4f73-b3d1-7f7b35549298 tempest-GroupSnapshotsTest-1290797889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:46:46 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-e166d4ab-0093-4f73-b3d1-7f7b35549298 tempest-GroupSnapshotsTest-1290797889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:46:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e166d4ab-0093-4f73-b3d1-7f7b35549298 tempest-GroupSnapshotsTest-1290797889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:46 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-e166d4ab-0093-4f73-b3d1-7f7b35549298 tempest-GroupSnapshotsTest-1290797889 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:46:46 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-e166d4ab-0093-4f73-b3d1-7f7b35549298 tempest-GroupSnapshotsTest-1290797889 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:46:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e166d4ab-0093-4f73-b3d1-7f7b35549298 tempest-GroupSnapshotsTest-1290797889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a2cdf661-d32a-49d5-8fe8-78cd456896d2 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:46 devstack sudo[93901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a2cdf661-d32a-49d5-8fe8-78cd456896d2 1073741824 Jul 08 01:46:46 devstack sudo[93901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:46 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-fdb6af1a-f185-437f-a8ba-18390bd5e47f tempest-SnapshotsActionsTest-1208726570 None] Create snapshot completed successfully Jul 08 01:46:47 devstack sudo[93901]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e166d4ab-0093-4f73-b3d1-7f7b35549298 tempest-GroupSnapshotsTest-1290797889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a2cdf661-d32a-49d5-8fe8-78cd456896d2 1073741824" returned: 0 in 0.936s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e166d4ab-0093-4f73-b3d1-7f7b35549298 tempest-GroupSnapshotsTest-1290797889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a2cdf661-d32a-49d5-8fe8-78cd456896d2 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:47 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-d6c34d5f-000f-4382-bca6-4b85b32d8dca tempest-SnapshotsActionsTest-973068087 None] Acquiring lock "cinder-96e141b3-8986-4dc2-9950-4e299e23bd77-delete_snapshot" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:46:47 devstack sudo[93906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a2cdf661-d32a-49d5-8fe8-78cd456896d2 Jul 08 01:46:47 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-d6c34d5f-000f-4382-bca6-4b85b32d8dca tempest-SnapshotsActionsTest-973068087 None] Lock "cinder-96e141b3-8986-4dc2-9950-4e299e23bd77-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:46:47 devstack sudo[93906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:47 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-d6c34d5f-000f-4382-bca6-4b85b32d8dca tempest-SnapshotsActionsTest-973068087 None] Acquiring lock "cinder-quobyte-41e27e51-647a-4db5-a8d7-8e510c819658" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:46:47 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-d6c34d5f-000f-4382-bca6-4b85b32d8dca tempest-SnapshotsActionsTest-973068087 None] Lock "cinder-quobyte-41e27e51-647a-4db5-a8d7-8e510c819658" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:46:47 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-d6c34d5f-000f-4382-bca6-4b85b32d8dca tempest-SnapshotsActionsTest-973068087 None] Acquiring lock "cinder-quobyte-96e141b3-8986-4dc2-9950-4e299e23bd77" by "_delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:46:47 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-d6c34d5f-000f-4382-bca6-4b85b32d8dca tempest-SnapshotsActionsTest-973068087 None] Lock "cinder-quobyte-96e141b3-8986-4dc2-9950-4e299e23bd77" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:46:47 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-d6c34d5f-000f-4382-bca6-4b85b32d8dca tempest-SnapshotsActionsTest-973068087 None] Deleting offline snapshot 96e141b3-8986-4dc2-9950-4e299e23bd77 of volume 41e27e51-647a-4db5-a8d7-8e510c819658 {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:46:47 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-d6c34d5f-000f-4382-bca6-4b85b32d8dca tempest-SnapshotsActionsTest-973068087 None] snapshot_file for this snap is: volume-41e27e51-647a-4db5-a8d7-8e510c819658.96e141b3-8986-4dc2-9950-4e299e23bd77 {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:46:47 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b45e481-8d22-438d-8530-a501b0f3dbb7]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:46:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d6c34d5f-000f-4382-bca6-4b85b32d8dca tempest-SnapshotsActionsTest-973068087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.96e141b3-8986-4dc2-9950-4e299e23bd77 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:47 devstack sudo[93908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.96e141b3-8986-4dc2-9950-4e299e23bd77 Jul 08 01:46:47 devstack sudo[93908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:47 devstack sudo[93906]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e166d4ab-0093-4f73-b3d1-7f7b35549298 tempest-GroupSnapshotsTest-1290797889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a2cdf661-d32a-49d5-8fe8-78cd456896d2" returned: 0 in 0.756s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:47 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-e166d4ab-0093-4f73-b3d1-7f7b35549298 tempest-GroupSnapshotsTest-1290797889 None] <== create_volume: return (1764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:46:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e166d4ab-0093-4f73-b3d1-7f7b35549298 tempest-GroupSnapshotsTest-1290797889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.767s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-3707cf14-d5fd-47b9-8562-2324da50e976 req-0a9f56a5-cf0d-4e4e-a8b6-691bb75697f3 tempest-VolumesSnapshotsTestJSON-1763905505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.809s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:47 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [req-3707cf14-d5fd-47b9-8562-2324da50e976 req-0a9f56a5-cf0d-4e4e-a8b6-691bb75697f3 tempest-VolumesSnapshotsTestJSON-1763905505 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:46:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-789374181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34e139f7-b1f0-420f-bce6-2b13b9d3f019,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a39741418eb843d58f804e2cba3f4228',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:46:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:46:45Z,use_quota=True,user_id='5d478a18648542279e3ca014ef4cabd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:46:47 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [req-3707cf14-d5fd-47b9-8562-2324da50e976 req-0a9f56a5-cf0d-4e4e-a8b6-691bb75697f3 tempest-VolumesSnapshotsTestJSON-1763905505 None] Creating volume 34e139f7-b1f0-420f-bce6-2b13b9d3f019 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:46:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-3707cf14-d5fd-47b9-8562-2324da50e976 req-0a9f56a5-cf0d-4e4e-a8b6-691bb75697f3 tempest-VolumesSnapshotsTestJSON-1763905505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-3707cf14-d5fd-47b9-8562-2324da50e976 req-0a9f56a5-cf0d-4e4e-a8b6-691bb75697f3 tempest-VolumesSnapshotsTestJSON-1763905505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:48 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [req-3707cf14-d5fd-47b9-8562-2324da50e976 req-0a9f56a5-cf0d-4e4e-a8b6-691bb75697f3 tempest-VolumesSnapshotsTestJSON-1763905505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:46:48 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [req-3707cf14-d5fd-47b9-8562-2324da50e976 req-0a9f56a5-cf0d-4e4e-a8b6-691bb75697f3 tempest-VolumesSnapshotsTestJSON-1763905505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:46:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-3707cf14-d5fd-47b9-8562-2324da50e976 req-0a9f56a5-cf0d-4e4e-a8b6-691bb75697f3 tempest-VolumesSnapshotsTestJSON-1763905505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:48 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [req-3707cf14-d5fd-47b9-8562-2324da50e976 req-0a9f56a5-cf0d-4e4e-a8b6-691bb75697f3 tempest-VolumesSnapshotsTestJSON-1763905505 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:46:48 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [req-3707cf14-d5fd-47b9-8562-2324da50e976 req-0a9f56a5-cf0d-4e4e-a8b6-691bb75697f3 tempest-VolumesSnapshotsTestJSON-1763905505 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:46:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-3707cf14-d5fd-47b9-8562-2324da50e976 req-0a9f56a5-cf0d-4e4e-a8b6-691bb75697f3 tempest-VolumesSnapshotsTestJSON-1763905505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-34e139f7-b1f0-420f-bce6-2b13b9d3f019 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:48 devstack sudo[93911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-34e139f7-b1f0-420f-bce6-2b13b9d3f019 1073741824 Jul 08 01:46:48 devstack sudo[93911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:48 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e166d4ab-0093-4f73-b3d1-7f7b35549298 tempest-GroupSnapshotsTest-1290797889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba3e431c-1387-4da3-b783-b71a46b47c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2cdf661-d32a-49d5-8fe8-78cd456896d2', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:48 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e166d4ab-0093-4f73-b3d1-7f7b35549298 tempest-GroupSnapshotsTest-1290797889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (358ba8ff-3b2a-42a2-a9ee-059fd7c483ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:48 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-e166d4ab-0093-4f73-b3d1-7f7b35549298 tempest-GroupSnapshotsTest-1290797889 None] Volume volume-a2cdf661-d32a-49d5-8fe8-78cd456896d2 (a2cdf661-d32a-49d5-8fe8-78cd456896d2): created successfully Jul 08 01:46:48 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e166d4ab-0093-4f73-b3d1-7f7b35549298 tempest-GroupSnapshotsTest-1290797889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (358ba8ff-3b2a-42a2-a9ee-059fd7c483ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:48 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e166d4ab-0093-4f73-b3d1-7f7b35549298 tempest-GroupSnapshotsTest-1290797889 None] Flow 'volume_create_manager' (3097bbdb-bdab-4f7d-a671-3ba67b3a6a05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:46:48 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-e166d4ab-0093-4f73-b3d1-7f7b35549298 tempest-GroupSnapshotsTest-1290797889 None] Created volume successfully. Jul 08 01:46:48 devstack sudo[93908]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d6c34d5f-000f-4382-bca6-4b85b32d8dca tempest-SnapshotsActionsTest-973068087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.96e141b3-8986-4dc2-9950-4e299e23bd77" returned: 0 in 0.902s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:48 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-d6c34d5f-000f-4382-bca6-4b85b32d8dca tempest-SnapshotsActionsTest-973068087 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41e27e51-647a-4db5-a8d7-8e510c819658(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:46:48 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c7af53-0d08-4b1f-a958-ad11a32db9c7]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:46:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d6c34d5f-000f-4382-bca6-4b85b32d8dca tempest-SnapshotsActionsTest-973068087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.1432a5c9-0a9f-46a6-a0b9-57de9ecf375e {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:48 devstack sudo[93918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.1432a5c9-0a9f-46a6-a0b9-57de9ecf375e Jul 08 01:46:48 devstack sudo[93918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:49 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-b64e126d-5f51-4cd2-b615-9eda81b7aeb0 tempest-GroupSnapshotsTest-1290797889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:46:49 devstack sudo[93911]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:49 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b64e126d-5f51-4cd2-b615-9eda81b7aeb0 tempest-GroupSnapshotsTest-1290797889 None] Flow 'volume_create_manager' (4051d6d4-21d3-4209-b154-934f063c2be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:46:49 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b64e126d-5f51-4cd2-b615-9eda81b7aeb0 tempest-GroupSnapshotsTest-1290797889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (429e6d01-c956-4a95-abbe-ed6c9ed21f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:49 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-3707cf14-d5fd-47b9-8562-2324da50e976 req-0a9f56a5-cf0d-4e4e-a8b6-691bb75697f3 tempest-VolumesSnapshotsTestJSON-1763905505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-34e139f7-b1f0-420f-bce6-2b13b9d3f019 1073741824" returned: 0 in 1.216s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:49 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b64e126d-5f51-4cd2-b615-9eda81b7aeb0 tempest-GroupSnapshotsTest-1290797889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (429e6d01-c956-4a95-abbe-ed6c9ed21f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:46:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1141828573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f7d5b53f-6526-4663-984b-dec52dba8530,host='devstack@QuobyteHD#QuobyteHD',id=fbd8ea42-95d7-440a-8d2a-193729481368,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97c67429d4724bfc8f5a6fe449493946',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:46:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:46:49Z,use_quota=True,user_id='48d3a3ec668e45d9868f061cc6e1f0c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed6f8986-1582-4712-a39b-aa86c971fb70),volume_type_id=ed6f8986-1582-4712-a39b-aa86c971fb70)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:49 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b64e126d-5f51-4cd2-b615-9eda81b7aeb0 tempest-GroupSnapshotsTest-1290797889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f47e23d0-1bdc-4a15-bc12-fda8526d1000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:49 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b64e126d-5f51-4cd2-b615-9eda81b7aeb0 tempest-GroupSnapshotsTest-1290797889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f47e23d0-1bdc-4a15-bc12-fda8526d1000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:49 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b64e126d-5f51-4cd2-b615-9eda81b7aeb0 tempest-GroupSnapshotsTest-1290797889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fbabc46-93f3-4400-b1e6-82c691d82724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:49 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b64e126d-5f51-4cd2-b615-9eda81b7aeb0 tempest-GroupSnapshotsTest-1290797889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fbabc46-93f3-4400-b1e6-82c691d82724) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbd8ea42-95d7-440a-8d2a-193729481368', 'volume_name': 'volume-fbd8ea42-95d7-440a-8d2a-193729481368', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:49 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b64e126d-5f51-4cd2-b615-9eda81b7aeb0 tempest-GroupSnapshotsTest-1290797889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (967df743-bfaa-4cfc-8901-eaefb1dc0978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:49 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b64e126d-5f51-4cd2-b615-9eda81b7aeb0 tempest-GroupSnapshotsTest-1290797889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (967df743-bfaa-4cfc-8901-eaefb1dc0978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:49 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b64e126d-5f51-4cd2-b615-9eda81b7aeb0 tempest-GroupSnapshotsTest-1290797889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39c611e7-7c36-44e7-a9d2-0bba56fa8bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:49 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-b64e126d-5f51-4cd2-b615-9eda81b7aeb0 tempest-GroupSnapshotsTest-1290797889 None] Volume fbd8ea42-95d7-440a-8d2a-193729481368: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbd8ea42-95d7-440a-8d2a-193729481368', 'volume_size': 1} Jul 08 01:46:49 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b64e126d-5f51-4cd2-b615-9eda81b7aeb0 tempest-GroupSnapshotsTest-1290797889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:49 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-3707cf14-d5fd-47b9-8562-2324da50e976 req-0a9f56a5-cf0d-4e4e-a8b6-691bb75697f3 tempest-VolumesSnapshotsTestJSON-1763905505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-34e139f7-b1f0-420f-bce6-2b13b9d3f019 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:49 devstack sudo[93918]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:49 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d6c34d5f-000f-4382-bca6-4b85b32d8dca tempest-SnapshotsActionsTest-973068087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.1432a5c9-0a9f-46a6-a0b9-57de9ecf375e" returned: 0 in 0.991s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:49 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-d6c34d5f-000f-4382-bca6-4b85b32d8dca tempest-SnapshotsActionsTest-973068087 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41e27e51-647a-4db5-a8d7-8e510c819658(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:46:49 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d6c34d5f-000f-4382-bca6-4b85b32d8dca tempest-SnapshotsActionsTest-973068087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.96e141b3-8986-4dc2-9950-4e299e23bd77 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:49 devstack sudo[93927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-34e139f7-b1f0-420f-bce6-2b13b9d3f019 Jul 08 01:46:49 devstack sudo[93927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:49 devstack sudo[93928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.96e141b3-8986-4dc2-9950-4e299e23bd77 Jul 08 01:46:49 devstack sudo[93928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:50 devstack sudo[93927]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:50 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-3707cf14-d5fd-47b9-8562-2324da50e976 req-0a9f56a5-cf0d-4e4e-a8b6-691bb75697f3 tempest-VolumesSnapshotsTestJSON-1763905505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-34e139f7-b1f0-420f-bce6-2b13b9d3f019" returned: 0 in 0.717s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:50 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [req-3707cf14-d5fd-47b9-8562-2324da50e976 req-0a9f56a5-cf0d-4e4e-a8b6-691bb75697f3 tempest-VolumesSnapshotsTestJSON-1763905505 None] <== create_volume: return (2031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:46:50 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-3707cf14-d5fd-47b9-8562-2324da50e976 req-0a9f56a5-cf0d-4e4e-a8b6-691bb75697f3 tempest-VolumesSnapshotsTestJSON-1763905505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.034s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:50 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b64e126d-5f51-4cd2-b615-9eda81b7aeb0 tempest-GroupSnapshotsTest-1290797889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.750s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:50 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-b64e126d-5f51-4cd2-b615-9eda81b7aeb0 tempest-GroupSnapshotsTest-1290797889 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f7d5b53f-6526-4663-984b-dec52dba8530,created_at=2026-07-07T23:46:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1141828573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f7d5b53f-6526-4663-984b-dec52dba8530,host='devstack@QuobyteHD#QuobyteHD',id=fbd8ea42-95d7-440a-8d2a-193729481368,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97c67429d4724bfc8f5a6fe449493946',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:46:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:46:49Z,use_quota=True,user_id='48d3a3ec668e45d9868f061cc6e1f0c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed6f8986-1582-4712-a39b-aa86c971fb70),volume_type_id=ed6f8986-1582-4712-a39b-aa86c971fb70)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:46:50 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-b64e126d-5f51-4cd2-b615-9eda81b7aeb0 tempest-GroupSnapshotsTest-1290797889 None] Creating volume fbd8ea42-95d7-440a-8d2a-193729481368 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:46:50 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b64e126d-5f51-4cd2-b615-9eda81b7aeb0 tempest-GroupSnapshotsTest-1290797889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:50 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b64e126d-5f51-4cd2-b615-9eda81b7aeb0 tempest-GroupSnapshotsTest-1290797889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:50 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-b64e126d-5f51-4cd2-b615-9eda81b7aeb0 tempest-GroupSnapshotsTest-1290797889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:46:50 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-b64e126d-5f51-4cd2-b615-9eda81b7aeb0 tempest-GroupSnapshotsTest-1290797889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:46:50 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b64e126d-5f51-4cd2-b615-9eda81b7aeb0 tempest-GroupSnapshotsTest-1290797889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:50 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-b64e126d-5f51-4cd2-b615-9eda81b7aeb0 tempest-GroupSnapshotsTest-1290797889 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:46:50 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-b64e126d-5f51-4cd2-b615-9eda81b7aeb0 tempest-GroupSnapshotsTest-1290797889 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:46:50 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b64e126d-5f51-4cd2-b615-9eda81b7aeb0 tempest-GroupSnapshotsTest-1290797889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-fbd8ea42-95d7-440a-8d2a-193729481368 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:50 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [req-3707cf14-d5fd-47b9-8562-2324da50e976 req-0a9f56a5-cf0d-4e4e-a8b6-691bb75697f3 tempest-VolumesSnapshotsTestJSON-1763905505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0aa4116e-afc7-4827-9a12-640e4e417c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34e139f7-b1f0-420f-bce6-2b13b9d3f019', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:50 devstack sudo[93938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-fbd8ea42-95d7-440a-8d2a-193729481368 1073741824 Jul 08 01:46:50 devstack sudo[93938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:50 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [req-3707cf14-d5fd-47b9-8562-2324da50e976 req-0a9f56a5-cf0d-4e4e-a8b6-691bb75697f3 tempest-VolumesSnapshotsTestJSON-1763905505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a58f825-d963-4bcf-be47-8fcf228cd06f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:50 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [req-3707cf14-d5fd-47b9-8562-2324da50e976 req-0a9f56a5-cf0d-4e4e-a8b6-691bb75697f3 tempest-VolumesSnapshotsTestJSON-1763905505 None] Volume volume-34e139f7-b1f0-420f-bce6-2b13b9d3f019 (34e139f7-b1f0-420f-bce6-2b13b9d3f019): created successfully Jul 08 01:46:50 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [req-3707cf14-d5fd-47b9-8562-2324da50e976 req-0a9f56a5-cf0d-4e4e-a8b6-691bb75697f3 tempest-VolumesSnapshotsTestJSON-1763905505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a58f825-d963-4bcf-be47-8fcf228cd06f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:50 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [req-3707cf14-d5fd-47b9-8562-2324da50e976 req-0a9f56a5-cf0d-4e4e-a8b6-691bb75697f3 tempest-VolumesSnapshotsTestJSON-1763905505 None] Flow 'volume_create_manager' (5fc1dc87-2275-4537-9b0c-7b5b39df58e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:46:50 devstack cinder-volume[87134]: INFO cinder.volume.manager [req-3707cf14-d5fd-47b9-8562-2324da50e976 req-0a9f56a5-cf0d-4e4e-a8b6-691bb75697f3 tempest-VolumesSnapshotsTestJSON-1763905505 None] Created volume successfully. Jul 08 01:46:50 devstack sudo[93928]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:50 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d6c34d5f-000f-4382-bca6-4b85b32d8dca tempest-SnapshotsActionsTest-973068087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.96e141b3-8986-4dc2-9950-4e299e23bd77" returned: 0 in 0.965s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:50 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d6c34d5f-000f-4382-bca6-4b85b32d8dca tempest-SnapshotsActionsTest-973068087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.96e141b3-8986-4dc2-9950-4e299e23bd77 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:50 devstack sudo[93940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.96e141b3-8986-4dc2-9950-4e299e23bd77 Jul 08 01:46:50 devstack sudo[93940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-a88a2c2f-cf8c-411b-a9ba-588ff01a376f req-2e0924e1-cd22-470c-916a-5006c901b80f tempest-VolumesSnapshotsTestJSON-1763905505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:51 devstack sudo[93940]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d6c34d5f-000f-4382-bca6-4b85b32d8dca tempest-SnapshotsActionsTest-973068087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.96e141b3-8986-4dc2-9950-4e299e23bd77" returned: 0 in 0.762s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:51 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-d6c34d5f-000f-4382-bca6-4b85b32d8dca tempest-SnapshotsActionsTest-973068087 None] Lock "cinder-quobyte-96e141b3-8986-4dc2-9950-4e299e23bd77" released by "_delete_snapshot" :: held 3.770s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:46:51 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-d6c34d5f-000f-4382-bca6-4b85b32d8dca tempest-SnapshotsActionsTest-973068087 None] Lock "cinder-quobyte-41e27e51-647a-4db5-a8d7-8e510c819658" released by "delete_snapshot" :: held 3.794s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:46:51 devstack cinder-volume[87134]: WARNING cinder.quota [None req-d6c34d5f-000f-4382-bca6-4b85b32d8dca tempest-SnapshotsActionsTest-973068087 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:46:51 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-d6c34d5f-000f-4382-bca6-4b85b32d8dca tempest-SnapshotsActionsTest-973068087 None] Created reservations ['2d0bb35b-6fc3-47f7-a107-8851ee0d4cf2', 'e43a7e69-7e42-40f0-baa8-ff40df2db3ec', 'e563e7cc-d721-480b-ba4c-b94a767b8e29', '2ad6f6de-d39f-43aa-8a18-676673a3bc98'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:46:51 devstack sudo[93938]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b64e126d-5f51-4cd2-b615-9eda81b7aeb0 tempest-GroupSnapshotsTest-1290797889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-fbd8ea42-95d7-440a-8d2a-193729481368 1073741824" returned: 0 in 1.149s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b64e126d-5f51-4cd2-b615-9eda81b7aeb0 tempest-GroupSnapshotsTest-1290797889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-fbd8ea42-95d7-440a-8d2a-193729481368 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:51 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-d6c34d5f-000f-4382-bca6-4b85b32d8dca tempest-SnapshotsActionsTest-973068087 None] Delete snapshot completed successfully. Jul 08 01:46:51 devstack sudo[93948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-fbd8ea42-95d7-440a-8d2a-193729481368 Jul 08 01:46:51 devstack sudo[93948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:51 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-d6c34d5f-000f-4382-bca6-4b85b32d8dca tempest-SnapshotsActionsTest-973068087 None] Lock "cinder-96e141b3-8986-4dc2-9950-4e299e23bd77-delete_snapshot" released by "delete_snapshot" :: held 4.000s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:46:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-686ad7bb-2edd-4c40-bc65-584d10f5b2ba tempest-SnapshotsActionsTest-1208726570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:51 devstack sudo[93948]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b64e126d-5f51-4cd2-b615-9eda81b7aeb0 tempest-GroupSnapshotsTest-1290797889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-fbd8ea42-95d7-440a-8d2a-193729481368" returned: 0 in 0.700s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:51 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-b64e126d-5f51-4cd2-b615-9eda81b7aeb0 tempest-GroupSnapshotsTest-1290797889 None] <== create_volume: return (1908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:46:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b64e126d-5f51-4cd2-b615-9eda81b7aeb0 tempest-GroupSnapshotsTest-1290797889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.912s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-a88a2c2f-cf8c-411b-a9ba-588ff01a376f req-2e0924e1-cd22-470c-916a-5006c901b80f tempest-VolumesSnapshotsTestJSON-1763905505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.908s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:51 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [req-a88a2c2f-cf8c-411b-a9ba-588ff01a376f req-2e0924e1-cd22-470c-916a-5006c901b80f tempest-VolumesSnapshotsTestJSON-1763905505 None] Creating offline snapshot 77c1c903-980e-45ab-8bb2-c36e2f6fa024 of volume 34e139f7-b1f0-420f-bce6-2b13b9d3f019 {{(pid=87134) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:46:51 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b64e126d-5f51-4cd2-b615-9eda81b7aeb0 tempest-GroupSnapshotsTest-1290797889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39c611e7-7c36-44e7-a9d2-0bba56fa8bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbd8ea42-95d7-440a-8d2a-193729481368', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:51 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b64e126d-5f51-4cd2-b615-9eda81b7aeb0 tempest-GroupSnapshotsTest-1290797889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47ded3a9-edfe-4952-b4bd-e10625490ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:46:51 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbde3d94-f281-4e69-8703-221cb2121bad]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:46:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-a88a2c2f-cf8c-411b-a9ba-588ff01a376f req-2e0924e1-cd22-470c-916a-5006c901b80f tempest-VolumesSnapshotsTestJSON-1763905505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-34e139f7-b1f0-420f-bce6-2b13b9d3f019 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:52 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-b64e126d-5f51-4cd2-b615-9eda81b7aeb0 tempest-GroupSnapshotsTest-1290797889 None] Volume volume-fbd8ea42-95d7-440a-8d2a-193729481368 (fbd8ea42-95d7-440a-8d2a-193729481368): created successfully Jul 08 01:46:52 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b64e126d-5f51-4cd2-b615-9eda81b7aeb0 tempest-GroupSnapshotsTest-1290797889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47ded3a9-edfe-4952-b4bd-e10625490ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:46:52 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b64e126d-5f51-4cd2-b615-9eda81b7aeb0 tempest-GroupSnapshotsTest-1290797889 None] Flow 'volume_create_manager' (4051d6d4-21d3-4209-b154-934f063c2be5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:46:52 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-b64e126d-5f51-4cd2-b615-9eda81b7aeb0 tempest-GroupSnapshotsTest-1290797889 None] Created volume successfully. Jul 08 01:46:52 devstack sudo[93951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-34e139f7-b1f0-420f-bce6-2b13b9d3f019 Jul 08 01:46:52 devstack sudo[93951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:52 devstack sudo[93951]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:52 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-a88a2c2f-cf8c-411b-a9ba-588ff01a376f req-2e0924e1-cd22-470c-916a-5006c901b80f tempest-VolumesSnapshotsTestJSON-1763905505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-34e139f7-b1f0-420f-bce6-2b13b9d3f019" returned: 0 in 0.850s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:52 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-a88a2c2f-cf8c-411b-a9ba-588ff01a376f req-2e0924e1-cd22-470c-916a-5006c901b80f tempest-VolumesSnapshotsTestJSON-1763905505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-34e139f7-b1f0-420f-bce6-2b13b9d3f019,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-34e139f7-b1f0-420f-bce6-2b13b9d3f019.77c1c903-980e-45ab-8bb2-c36e2f6fa024 1G {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:52 devstack sudo[93957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-34e139f7-b1f0-420f-bce6-2b13b9d3f019,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-34e139f7-b1f0-420f-bce6-2b13b9d3f019.77c1c903-980e-45ab-8bb2-c36e2f6fa024 1G Jul 08 01:46:52 devstack sudo[93957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:53 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-04c770a5-1dee-485e-b8fb-56f763f1f8d0 tempest-GroupSnapshotsTest-1290797889 None] Update group completed successfully. Jul 08 01:46:53 devstack sudo[93957]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-a88a2c2f-cf8c-411b-a9ba-588ff01a376f req-2e0924e1-cd22-470c-916a-5006c901b80f tempest-VolumesSnapshotsTestJSON-1763905505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-34e139f7-b1f0-420f-bce6-2b13b9d3f019,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-34e139f7-b1f0-420f-bce6-2b13b9d3f019.77c1c903-980e-45ab-8bb2-c36e2f6fa024 1G" returned: 0 in 0.860s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-a88a2c2f-cf8c-411b-a9ba-588ff01a376f req-2e0924e1-cd22-470c-916a-5006c901b80f tempest-VolumesSnapshotsTestJSON-1763905505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34e139f7-b1f0-420f-bce6-2b13b9d3f019 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-34e139f7-b1f0-420f-bce6-2b13b9d3f019.77c1c903-980e-45ab-8bb2-c36e2f6fa024 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:53 devstack sudo[93963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34e139f7-b1f0-420f-bce6-2b13b9d3f019 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-34e139f7-b1f0-420f-bce6-2b13b9d3f019.77c1c903-980e-45ab-8bb2-c36e2f6fa024 Jul 08 01:46:53 devstack sudo[93963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:54 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-884992c8-eb6b-455d-a532-4a528e738d5a tempest-GroupSnapshotsTest-1290797889 None] Update group completed successfully. Jul 08 01:46:54 devstack sudo[93963]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-a88a2c2f-cf8c-411b-a9ba-588ff01a376f req-2e0924e1-cd22-470c-916a-5006c901b80f tempest-VolumesSnapshotsTestJSON-1763905505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34e139f7-b1f0-420f-bce6-2b13b9d3f019 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-34e139f7-b1f0-420f-bce6-2b13b9d3f019.77c1c903-980e-45ab-8bb2-c36e2f6fa024" returned: 0 in 0.729s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:54 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [req-a88a2c2f-cf8c-411b-a9ba-588ff01a376f req-2e0924e1-cd22-470c-916a-5006c901b80f tempest-VolumesSnapshotsTestJSON-1763905505 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-34e139f7-b1f0-420f-bce6-2b13b9d3f019.77c1c903-980e-45ab-8bb2-c36e2f6fa024 is being set with open permissions: ugo+rw Jul 08 01:46:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-a88a2c2f-cf8c-411b-a9ba-588ff01a376f req-2e0924e1-cd22-470c-916a-5006c901b80f tempest-VolumesSnapshotsTestJSON-1763905505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-34e139f7-b1f0-420f-bce6-2b13b9d3f019.77c1c903-980e-45ab-8bb2-c36e2f6fa024 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:54 devstack sudo[93968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-34e139f7-b1f0-420f-bce6-2b13b9d3f019.77c1c903-980e-45ab-8bb2-c36e2f6fa024 Jul 08 01:46:54 devstack sudo[93968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:55 devstack sudo[93968]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:55 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-a88a2c2f-cf8c-411b-a9ba-588ff01a376f req-2e0924e1-cd22-470c-916a-5006c901b80f tempest-VolumesSnapshotsTestJSON-1763905505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-34e139f7-b1f0-420f-bce6-2b13b9d3f019.77c1c903-980e-45ab-8bb2-c36e2f6fa024" returned: 0 in 0.775s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:55 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-a88a2c2f-cf8c-411b-a9ba-588ff01a376f req-2e0924e1-cd22-470c-916a-5006c901b80f tempest-VolumesSnapshotsTestJSON-1763905505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-34e139f7-b1f0-420f-bce6-2b13b9d3f019.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:55 devstack sudo[93971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-34e139f7-b1f0-420f-bce6-2b13b9d3f019.info Jul 08 01:46:55 devstack sudo[93971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:55 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-da9196d3-37af-45a7-9190-b66dee021f27 tempest-GroupSnapshotsTest-1290797889 None] Update group completed successfully. Jul 08 01:46:56 devstack sudo[93971]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:56 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-a88a2c2f-cf8c-411b-a9ba-588ff01a376f req-2e0924e1-cd22-470c-916a-5006c901b80f tempest-VolumesSnapshotsTestJSON-1763905505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-34e139f7-b1f0-420f-bce6-2b13b9d3f019.info" returned: 0 in 0.773s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:56 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [req-a88a2c2f-cf8c-411b-a9ba-588ff01a376f req-2e0924e1-cd22-470c-916a-5006c901b80f tempest-VolumesSnapshotsTestJSON-1763905505 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-34e139f7-b1f0-420f-bce6-2b13b9d3f019.info is being set with open permissions: ugo+rw Jul 08 01:46:56 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-a88a2c2f-cf8c-411b-a9ba-588ff01a376f req-2e0924e1-cd22-470c-916a-5006c901b80f tempest-VolumesSnapshotsTestJSON-1763905505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-34e139f7-b1f0-420f-bce6-2b13b9d3f019.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:56 devstack sudo[93974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-34e139f7-b1f0-420f-bce6-2b13b9d3f019.info Jul 08 01:46:56 devstack sudo[93974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:56 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-1ed4a27e-0cd8-4dab-8d13-c60a765db432 tempest-GroupSnapshotsTest-1290797889 None] Update group completed successfully. Jul 08 01:46:56 devstack sudo[93974]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:56 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-a88a2c2f-cf8c-411b-a9ba-588ff01a376f req-2e0924e1-cd22-470c-916a-5006c901b80f tempest-VolumesSnapshotsTestJSON-1763905505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-34e139f7-b1f0-420f-bce6-2b13b9d3f019.info" returned: 0 in 0.759s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:56 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-a88a2c2f-cf8c-411b-a9ba-588ff01a376f req-2e0924e1-cd22-470c-916a-5006c901b80f tempest-VolumesSnapshotsTestJSON-1763905505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.866s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:46:56 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-686ad7bb-2edd-4c40-bc65-584d10f5b2ba tempest-SnapshotsActionsTest-1208726570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.958s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:46:56 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-686ad7bb-2edd-4c40-bc65-584d10f5b2ba tempest-SnapshotsActionsTest-1208726570 None] Creating offline snapshot ab8bd802-51dd-484c-bacb-9f648efe682d of volume 41e27e51-647a-4db5-a8d7-8e510c819658 {{(pid=87134) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:46:56 devstack cinder-volume[87134]: INFO cinder.volume.manager [req-a88a2c2f-cf8c-411b-a9ba-588ff01a376f req-2e0924e1-cd22-470c-916a-5006c901b80f tempest-VolumesSnapshotsTestJSON-1763905505 None] Create snapshot completed successfully Jul 08 01:46:56 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[27db4285-5a56-4ff6-a190-1af839ded857]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:46:56 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-686ad7bb-2edd-4c40-bc65-584d10f5b2ba tempest-SnapshotsActionsTest-1208726570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.1432a5c9-0a9f-46a6-a0b9-57de9ecf375e {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:57 devstack sudo[93981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.1432a5c9-0a9f-46a6-a0b9-57de9ecf375e Jul 08 01:46:57 devstack sudo[93981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:57 devstack cinder-volume[87134]: DEBUG cinder.coordination [req-fd589903-d3b9-416d-9bb5-b899d2415eb8 req-2c0bbca1-f0c0-4540-92ac-30a4b79da8b0 tempest-VolumesSnapshotsTestJSON-1763905505 None] Acquiring lock "cinder-77c1c903-980e-45ab-8bb2-c36e2f6fa024-delete_snapshot" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:46:57 devstack cinder-volume[87134]: DEBUG cinder.coordination [req-fd589903-d3b9-416d-9bb5-b899d2415eb8 req-2c0bbca1-f0c0-4540-92ac-30a4b79da8b0 tempest-VolumesSnapshotsTestJSON-1763905505 None] Lock "cinder-77c1c903-980e-45ab-8bb2-c36e2f6fa024-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:46:57 devstack cinder-volume[87134]: DEBUG cinder.coordination [req-fd589903-d3b9-416d-9bb5-b899d2415eb8 req-2c0bbca1-f0c0-4540-92ac-30a4b79da8b0 tempest-VolumesSnapshotsTestJSON-1763905505 None] Acquiring lock "cinder-quobyte-34e139f7-b1f0-420f-bce6-2b13b9d3f019" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:46:57 devstack cinder-volume[87134]: DEBUG cinder.coordination [req-fd589903-d3b9-416d-9bb5-b899d2415eb8 req-2c0bbca1-f0c0-4540-92ac-30a4b79da8b0 tempest-VolumesSnapshotsTestJSON-1763905505 None] Lock "cinder-quobyte-34e139f7-b1f0-420f-bce6-2b13b9d3f019" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:46:57 devstack cinder-volume[87134]: DEBUG cinder.coordination [req-fd589903-d3b9-416d-9bb5-b899d2415eb8 req-2c0bbca1-f0c0-4540-92ac-30a4b79da8b0 tempest-VolumesSnapshotsTestJSON-1763905505 None] Acquiring lock "cinder-quobyte-77c1c903-980e-45ab-8bb2-c36e2f6fa024" by "_delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:46:57 devstack cinder-volume[87134]: DEBUG cinder.coordination [req-fd589903-d3b9-416d-9bb5-b899d2415eb8 req-2c0bbca1-f0c0-4540-92ac-30a4b79da8b0 tempest-VolumesSnapshotsTestJSON-1763905505 None] Lock "cinder-quobyte-77c1c903-980e-45ab-8bb2-c36e2f6fa024" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:46:57 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [req-fd589903-d3b9-416d-9bb5-b899d2415eb8 req-2c0bbca1-f0c0-4540-92ac-30a4b79da8b0 tempest-VolumesSnapshotsTestJSON-1763905505 None] Deleting offline snapshot 77c1c903-980e-45ab-8bb2-c36e2f6fa024 of volume 34e139f7-b1f0-420f-bce6-2b13b9d3f019 {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:46:57 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [req-fd589903-d3b9-416d-9bb5-b899d2415eb8 req-2c0bbca1-f0c0-4540-92ac-30a4b79da8b0 tempest-VolumesSnapshotsTestJSON-1763905505 None] snapshot_file for this snap is: volume-34e139f7-b1f0-420f-bce6-2b13b9d3f019.77c1c903-980e-45ab-8bb2-c36e2f6fa024 {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:46:57 devstack sudo[93981]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:57 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-686ad7bb-2edd-4c40-bc65-584d10f5b2ba tempest-SnapshotsActionsTest-1208726570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.1432a5c9-0a9f-46a6-a0b9-57de9ecf375e" returned: 0 in 0.927s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:57 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-686ad7bb-2edd-4c40-bc65-584d10f5b2ba tempest-SnapshotsActionsTest-1208726570 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41e27e51-647a-4db5-a8d7-8e510c819658(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:46:57 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-686ad7bb-2edd-4c40-bc65-584d10f5b2ba tempest-SnapshotsActionsTest-1208726570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.1432a5c9-0a9f-46a6-a0b9-57de9ecf375e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.ab8bd802-51dd-484c-bacb-9f648efe682d 1G {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:57 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b2bb36a-e043-4053-9ef2-2963eb99e062]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:46:57 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-fd589903-d3b9-416d-9bb5-b899d2415eb8 req-2c0bbca1-f0c0-4540-92ac-30a4b79da8b0 tempest-VolumesSnapshotsTestJSON-1763905505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-34e139f7-b1f0-420f-bce6-2b13b9d3f019.77c1c903-980e-45ab-8bb2-c36e2f6fa024 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:57 devstack sudo[93998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.1432a5c9-0a9f-46a6-a0b9-57de9ecf375e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.ab8bd802-51dd-484c-bacb-9f648efe682d 1G Jul 08 01:46:57 devstack sudo[93998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:57 devstack sudo[93999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-34e139f7-b1f0-420f-bce6-2b13b9d3f019.77c1c903-980e-45ab-8bb2-c36e2f6fa024 Jul 08 01:46:57 devstack sudo[93999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:58 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-e0da4e16-8bc5-46b8-9d4c-60a0b75388e0 tempest-GroupSnapshotsTest-1290797889 None] GroupSnapshot b7076e42-7d8d-4d9d-be84-75570c38e82b: creating. Jul 08 01:46:58 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e0da4e16-8bc5-46b8-9d4c-60a0b75388e0 tempest-GroupSnapshotsTest-1290797889 None] Group snapshot b7076e42-7d8d-4d9d-be84-75570c38e82b: creating. {{(pid=87134) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 08 01:46:58 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e0da4e16-8bc5-46b8-9d4c-60a0b75388e0 tempest-GroupSnapshotsTest-1290797889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:46:58 devstack sudo[93999]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:58 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-fd589903-d3b9-416d-9bb5-b899d2415eb8 req-2c0bbca1-f0c0-4540-92ac-30a4b79da8b0 tempest-VolumesSnapshotsTestJSON-1763905505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-34e139f7-b1f0-420f-bce6-2b13b9d3f019.77c1c903-980e-45ab-8bb2-c36e2f6fa024" returned: 0 in 0.875s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:58 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [req-fd589903-d3b9-416d-9bb5-b899d2415eb8 req-2c0bbca1-f0c0-4540-92ac-30a4b79da8b0 tempest-VolumesSnapshotsTestJSON-1763905505 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34e139f7-b1f0-420f-bce6-2b13b9d3f019(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:46:58 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[056aedce-291a-4fca-aa6f-6ec6d5086cba]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:46:58 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-fd589903-d3b9-416d-9bb5-b899d2415eb8 req-2c0bbca1-f0c0-4540-92ac-30a4b79da8b0 tempest-VolumesSnapshotsTestJSON-1763905505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-34e139f7-b1f0-420f-bce6-2b13b9d3f019 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:58 devstack sudo[93998]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:58 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-686ad7bb-2edd-4c40-bc65-584d10f5b2ba tempest-SnapshotsActionsTest-1208726570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.1432a5c9-0a9f-46a6-a0b9-57de9ecf375e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.ab8bd802-51dd-484c-bacb-9f648efe682d 1G" returned: 0 in 0.938s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:58 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-686ad7bb-2edd-4c40-bc65-584d10f5b2ba tempest-SnapshotsActionsTest-1208726570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41e27e51-647a-4db5-a8d7-8e510c819658.1432a5c9-0a9f-46a6-a0b9-57de9ecf375e -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.ab8bd802-51dd-484c-bacb-9f648efe682d {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:58 devstack sudo[94010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41e27e51-647a-4db5-a8d7-8e510c819658.1432a5c9-0a9f-46a6-a0b9-57de9ecf375e -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.ab8bd802-51dd-484c-bacb-9f648efe682d Jul 08 01:46:58 devstack sudo[94010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:58 devstack sudo[94009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-34e139f7-b1f0-420f-bce6-2b13b9d3f019 Jul 08 01:46:58 devstack sudo[94009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:59 devstack sudo[94010]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-686ad7bb-2edd-4c40-bc65-584d10f5b2ba tempest-SnapshotsActionsTest-1208726570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41e27e51-647a-4db5-a8d7-8e510c819658.1432a5c9-0a9f-46a6-a0b9-57de9ecf375e -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.ab8bd802-51dd-484c-bacb-9f648efe682d" returned: 0 in 0.756s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:59 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-686ad7bb-2edd-4c40-bc65-584d10f5b2ba tempest-SnapshotsActionsTest-1208726570 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.ab8bd802-51dd-484c-bacb-9f648efe682d is being set with open permissions: ugo+rw Jul 08 01:46:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-686ad7bb-2edd-4c40-bc65-584d10f5b2ba tempest-SnapshotsActionsTest-1208726570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.ab8bd802-51dd-484c-bacb-9f648efe682d {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:59 devstack sudo[94020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.ab8bd802-51dd-484c-bacb-9f648efe682d Jul 08 01:46:59 devstack sudo[94020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:46:59 devstack sudo[94009]: pam_unix(sudo:session): session closed for user root Jul 08 01:46:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-fd589903-d3b9-416d-9bb5-b899d2415eb8 req-2c0bbca1-f0c0-4540-92ac-30a4b79da8b0 tempest-VolumesSnapshotsTestJSON-1763905505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-34e139f7-b1f0-420f-bce6-2b13b9d3f019" returned: 0 in 0.848s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:46:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-fd589903-d3b9-416d-9bb5-b899d2415eb8 req-2c0bbca1-f0c0-4540-92ac-30a4b79da8b0 tempest-VolumesSnapshotsTestJSON-1763905505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-34e139f7-b1f0-420f-bce6-2b13b9d3f019.77c1c903-980e-45ab-8bb2-c36e2f6fa024 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:46:59 devstack sudo[94022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-34e139f7-b1f0-420f-bce6-2b13b9d3f019.77c1c903-980e-45ab-8bb2-c36e2f6fa024 Jul 08 01:46:59 devstack sudo[94022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:00 devstack sudo[94020]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-686ad7bb-2edd-4c40-bc65-584d10f5b2ba tempest-SnapshotsActionsTest-1208726570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.ab8bd802-51dd-484c-bacb-9f648efe682d" returned: 0 in 0.704s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-686ad7bb-2edd-4c40-bc65-584d10f5b2ba tempest-SnapshotsActionsTest-1208726570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.456s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e0da4e16-8bc5-46b8-9d4c-60a0b75388e0 tempest-GroupSnapshotsTest-1290797889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.919s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:00 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-e0da4e16-8bc5-46b8-9d4c-60a0b75388e0 tempest-GroupSnapshotsTest-1290797889 None] Creating offline snapshot 6069af2e-9858-4588-9e4e-da357e0e94f2 of volume fbd8ea42-95d7-440a-8d2a-193729481368 {{(pid=87134) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:47:00 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-686ad7bb-2edd-4c40-bc65-584d10f5b2ba tempest-SnapshotsActionsTest-1208726570 None] Create snapshot completed successfully Jul 08 01:47:00 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37e4333-5b68-4b60-86c7-4686f8af1c12]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e0da4e16-8bc5-46b8-9d4c-60a0b75388e0 tempest-GroupSnapshotsTest-1290797889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-fbd8ea42-95d7-440a-8d2a-193729481368 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:00 devstack sudo[94022]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-fd589903-d3b9-416d-9bb5-b899d2415eb8 req-2c0bbca1-f0c0-4540-92ac-30a4b79da8b0 tempest-VolumesSnapshotsTestJSON-1763905505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-34e139f7-b1f0-420f-bce6-2b13b9d3f019.77c1c903-980e-45ab-8bb2-c36e2f6fa024" returned: 0 in 0.776s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-fd589903-d3b9-416d-9bb5-b899d2415eb8 req-2c0bbca1-f0c0-4540-92ac-30a4b79da8b0 tempest-VolumesSnapshotsTestJSON-1763905505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-34e139f7-b1f0-420f-bce6-2b13b9d3f019.77c1c903-980e-45ab-8bb2-c36e2f6fa024 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:00 devstack sudo[94029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-34e139f7-b1f0-420f-bce6-2b13b9d3f019.77c1c903-980e-45ab-8bb2-c36e2f6fa024 Jul 08 01:47:00 devstack sudo[94029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:00 devstack sudo[94028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-fbd8ea42-95d7-440a-8d2a-193729481368 Jul 08 01:47:00 devstack sudo[94028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:01 devstack sudo[94029]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-fd589903-d3b9-416d-9bb5-b899d2415eb8 req-2c0bbca1-f0c0-4540-92ac-30a4b79da8b0 tempest-VolumesSnapshotsTestJSON-1763905505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-34e139f7-b1f0-420f-bce6-2b13b9d3f019.77c1c903-980e-45ab-8bb2-c36e2f6fa024" returned: 0 in 0.977s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:01 devstack cinder-volume[87134]: DEBUG cinder.coordination [req-fd589903-d3b9-416d-9bb5-b899d2415eb8 req-2c0bbca1-f0c0-4540-92ac-30a4b79da8b0 tempest-VolumesSnapshotsTestJSON-1763905505 None] Lock "cinder-quobyte-77c1c903-980e-45ab-8bb2-c36e2f6fa024" released by "_delete_snapshot" :: held 3.644s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:01 devstack cinder-volume[87134]: DEBUG cinder.coordination [req-fd589903-d3b9-416d-9bb5-b899d2415eb8 req-2c0bbca1-f0c0-4540-92ac-30a4b79da8b0 tempest-VolumesSnapshotsTestJSON-1763905505 None] Lock "cinder-quobyte-34e139f7-b1f0-420f-bce6-2b13b9d3f019" released by "delete_snapshot" :: held 3.677s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:01 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-c46c94f1-85c0-44c1-9167-9d1cc3e042eb tempest-SnapshotsActionsTest-973068087 None] Acquiring lock "cinder-ab8bd802-51dd-484c-bacb-9f648efe682d-delete_snapshot" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:01 devstack cinder-volume[87134]: DEBUG cinder.quota [req-fd589903-d3b9-416d-9bb5-b899d2415eb8 req-2c0bbca1-f0c0-4540-92ac-30a4b79da8b0 tempest-VolumesSnapshotsTestJSON-1763905505 None] Created reservations ['5894d673-949a-40db-90c4-100e26ab22ec', 'db36d6b8-f3be-4289-a54b-1e88ad2703f8', 'be656a5e-58a1-481f-9ac4-0b1ca552565b', '0db7e6a8-14de-41c9-96e1-9a5802db0906'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:47:01 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-c46c94f1-85c0-44c1-9167-9d1cc3e042eb tempest-SnapshotsActionsTest-973068087 None] Lock "cinder-ab8bd802-51dd-484c-bacb-9f648efe682d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:01 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-c46c94f1-85c0-44c1-9167-9d1cc3e042eb tempest-SnapshotsActionsTest-973068087 None] Acquiring lock "cinder-quobyte-41e27e51-647a-4db5-a8d7-8e510c819658" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:01 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-c46c94f1-85c0-44c1-9167-9d1cc3e042eb tempest-SnapshotsActionsTest-973068087 None] Lock "cinder-quobyte-41e27e51-647a-4db5-a8d7-8e510c819658" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:01 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-c46c94f1-85c0-44c1-9167-9d1cc3e042eb tempest-SnapshotsActionsTest-973068087 None] Acquiring lock "cinder-quobyte-ab8bd802-51dd-484c-bacb-9f648efe682d" by "_delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:01 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-c46c94f1-85c0-44c1-9167-9d1cc3e042eb tempest-SnapshotsActionsTest-973068087 None] Lock "cinder-quobyte-ab8bd802-51dd-484c-bacb-9f648efe682d" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:01 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-c46c94f1-85c0-44c1-9167-9d1cc3e042eb tempest-SnapshotsActionsTest-973068087 None] Deleting offline snapshot ab8bd802-51dd-484c-bacb-9f648efe682d of volume 41e27e51-647a-4db5-a8d7-8e510c819658 {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:47:01 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-c46c94f1-85c0-44c1-9167-9d1cc3e042eb tempest-SnapshotsActionsTest-973068087 None] snapshot_file for this snap is: volume-41e27e51-647a-4db5-a8d7-8e510c819658.ab8bd802-51dd-484c-bacb-9f648efe682d {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:47:01 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ac3ad6-e282-4102-b076-6e00ddc93165]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c46c94f1-85c0-44c1-9167-9d1cc3e042eb tempest-SnapshotsActionsTest-973068087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.ab8bd802-51dd-484c-bacb-9f648efe682d {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:01 devstack sudo[94028]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e0da4e16-8bc5-46b8-9d4c-60a0b75388e0 tempest-GroupSnapshotsTest-1290797889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-fbd8ea42-95d7-440a-8d2a-193729481368" returned: 0 in 1.368s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e0da4e16-8bc5-46b8-9d4c-60a0b75388e0 tempest-GroupSnapshotsTest-1290797889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-fbd8ea42-95d7-440a-8d2a-193729481368,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-fbd8ea42-95d7-440a-8d2a-193729481368.6069af2e-9858-4588-9e4e-da357e0e94f2 1G {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:01 devstack cinder-volume[87134]: INFO cinder.volume.manager [req-fd589903-d3b9-416d-9bb5-b899d2415eb8 req-2c0bbca1-f0c0-4540-92ac-30a4b79da8b0 tempest-VolumesSnapshotsTestJSON-1763905505 None] Delete snapshot completed successfully. Jul 08 01:47:01 devstack cinder-volume[87134]: DEBUG cinder.coordination [req-fd589903-d3b9-416d-9bb5-b899d2415eb8 req-2c0bbca1-f0c0-4540-92ac-30a4b79da8b0 tempest-VolumesSnapshotsTestJSON-1763905505 None] Lock "cinder-77c1c903-980e-45ab-8bb2-c36e2f6fa024-delete_snapshot" released by "delete_snapshot" :: held 3.985s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:01 devstack sudo[94066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-fbd8ea42-95d7-440a-8d2a-193729481368,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-fbd8ea42-95d7-440a-8d2a-193729481368.6069af2e-9858-4588-9e4e-da357e0e94f2 1G Jul 08 01:47:01 devstack sudo[94066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:01 devstack sudo[94065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.ab8bd802-51dd-484c-bacb-9f648efe682d Jul 08 01:47:01 devstack sudo[94065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:02 devstack cinder-volume[87134]: DEBUG cinder.coordination [req-c1781a7c-ff27-4e07-bdba-2a5c223ce93e req-94d4e30e-e4fd-4934-a5c3-afbb2552b981 tempest-VolumesSnapshotsTestJSON-1763905505 None] Acquiring lock "cinder-34e139f7-b1f0-420f-bce6-2b13b9d3f019-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:02 devstack cinder-volume[87134]: DEBUG cinder.coordination [req-c1781a7c-ff27-4e07-bdba-2a5c223ce93e req-94d4e30e-e4fd-4934-a5c3-afbb2552b981 tempest-VolumesSnapshotsTestJSON-1763905505 None] Lock "cinder-34e139f7-b1f0-420f-bce6-2b13b9d3f019-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:02 devstack cinder-volume[87134]: DEBUG cinder.coordination [req-c1781a7c-ff27-4e07-bdba-2a5c223ce93e req-94d4e30e-e4fd-4934-a5c3-afbb2552b981 tempest-VolumesSnapshotsTestJSON-1763905505 None] Acquiring lock "cinder-quobyte-34e139f7-b1f0-420f-bce6-2b13b9d3f019" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:02 devstack cinder-volume[87134]: DEBUG cinder.coordination [req-c1781a7c-ff27-4e07-bdba-2a5c223ce93e req-94d4e30e-e4fd-4934-a5c3-afbb2552b981 tempest-VolumesSnapshotsTestJSON-1763905505 None] Lock "cinder-quobyte-34e139f7-b1f0-420f-bce6-2b13b9d3f019" acquired by "delete_volume" :: waited 0.040s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:02 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8f8222-a598-41c4-9023-70206bdce459]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-c1781a7c-ff27-4e07-bdba-2a5c223ce93e req-94d4e30e-e4fd-4934-a5c3-afbb2552b981 tempest-VolumesSnapshotsTestJSON-1763905505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-34e139f7-b1f0-420f-bce6-2b13b9d3f019 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:02 devstack sudo[94065]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c46c94f1-85c0-44c1-9167-9d1cc3e042eb tempest-SnapshotsActionsTest-973068087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.ab8bd802-51dd-484c-bacb-9f648efe682d" returned: 0 in 1.138s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:02 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-c46c94f1-85c0-44c1-9167-9d1cc3e042eb tempest-SnapshotsActionsTest-973068087 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41e27e51-647a-4db5-a8d7-8e510c819658(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:47:02 devstack sudo[94119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-34e139f7-b1f0-420f-bce6-2b13b9d3f019 Jul 08 01:47:02 devstack sudo[94119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:02 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b3faf6-95ae-4ce1-92e5-32420e933876]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c46c94f1-85c0-44c1-9167-9d1cc3e042eb tempest-SnapshotsActionsTest-973068087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.1432a5c9-0a9f-46a6-a0b9-57de9ecf375e {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:02 devstack sudo[94066]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e0da4e16-8bc5-46b8-9d4c-60a0b75388e0 tempest-GroupSnapshotsTest-1290797889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-fbd8ea42-95d7-440a-8d2a-193729481368,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-fbd8ea42-95d7-440a-8d2a-193729481368.6069af2e-9858-4588-9e4e-da357e0e94f2 1G" returned: 0 in 1.241s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e0da4e16-8bc5-46b8-9d4c-60a0b75388e0 tempest-GroupSnapshotsTest-1290797889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbd8ea42-95d7-440a-8d2a-193729481368 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-fbd8ea42-95d7-440a-8d2a-193729481368.6069af2e-9858-4588-9e4e-da357e0e94f2 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:02 devstack sudo[94122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbd8ea42-95d7-440a-8d2a-193729481368 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-fbd8ea42-95d7-440a-8d2a-193729481368.6069af2e-9858-4588-9e4e-da357e0e94f2 Jul 08 01:47:02 devstack sudo[94122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:03 devstack sudo[94121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.1432a5c9-0a9f-46a6-a0b9-57de9ecf375e Jul 08 01:47:03 devstack sudo[94121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:03 devstack sudo[94119]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:03 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-c1781a7c-ff27-4e07-bdba-2a5c223ce93e req-94d4e30e-e4fd-4934-a5c3-afbb2552b981 tempest-VolumesSnapshotsTestJSON-1763905505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-34e139f7-b1f0-420f-bce6-2b13b9d3f019" returned: 0 in 1.190s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:03 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-c1781a7c-ff27-4e07-bdba-2a5c223ce93e req-94d4e30e-e4fd-4934-a5c3-afbb2552b981 tempest-VolumesSnapshotsTestJSON-1763905505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-34e139f7-b1f0-420f-bce6-2b13b9d3f019 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:03 devstack sudo[94139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-34e139f7-b1f0-420f-bce6-2b13b9d3f019 Jul 08 01:47:03 devstack sudo[94139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:03 devstack sudo[94121]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:03 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c46c94f1-85c0-44c1-9167-9d1cc3e042eb tempest-SnapshotsActionsTest-973068087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.1432a5c9-0a9f-46a6-a0b9-57de9ecf375e" returned: 0 in 1.084s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:03 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-c46c94f1-85c0-44c1-9167-9d1cc3e042eb tempest-SnapshotsActionsTest-973068087 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41e27e51-647a-4db5-a8d7-8e510c819658(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:47:03 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c46c94f1-85c0-44c1-9167-9d1cc3e042eb tempest-SnapshotsActionsTest-973068087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.ab8bd802-51dd-484c-bacb-9f648efe682d {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:03 devstack sudo[94141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.ab8bd802-51dd-484c-bacb-9f648efe682d Jul 08 01:47:03 devstack sudo[94141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:04 devstack sudo[94122]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:04 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e0da4e16-8bc5-46b8-9d4c-60a0b75388e0 tempest-GroupSnapshotsTest-1290797889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbd8ea42-95d7-440a-8d2a-193729481368 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-fbd8ea42-95d7-440a-8d2a-193729481368.6069af2e-9858-4588-9e4e-da357e0e94f2" returned: 0 in 1.141s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:04 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-e0da4e16-8bc5-46b8-9d4c-60a0b75388e0 tempest-GroupSnapshotsTest-1290797889 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-fbd8ea42-95d7-440a-8d2a-193729481368.6069af2e-9858-4588-9e4e-da357e0e94f2 is being set with open permissions: ugo+rw: NotImplementedError Jul 08 01:47:04 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e0da4e16-8bc5-46b8-9d4c-60a0b75388e0 tempest-GroupSnapshotsTest-1290797889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-fbd8ea42-95d7-440a-8d2a-193729481368.6069af2e-9858-4588-9e4e-da357e0e94f2 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:04 devstack sudo[94143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-fbd8ea42-95d7-440a-8d2a-193729481368.6069af2e-9858-4588-9e4e-da357e0e94f2 Jul 08 01:47:04 devstack sudo[94143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:05 devstack sudo[94139]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:05 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-c1781a7c-ff27-4e07-bdba-2a5c223ce93e req-94d4e30e-e4fd-4934-a5c3-afbb2552b981 tempest-VolumesSnapshotsTestJSON-1763905505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-34e139f7-b1f0-420f-bce6-2b13b9d3f019" returned: 0 in 1.190s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:05 devstack cinder-volume[87134]: DEBUG cinder.coordination [req-c1781a7c-ff27-4e07-bdba-2a5c223ce93e req-94d4e30e-e4fd-4934-a5c3-afbb2552b981 tempest-VolumesSnapshotsTestJSON-1763905505 None] Lock "cinder-quobyte-34e139f7-b1f0-420f-bce6-2b13b9d3f019" released by "delete_volume" :: held 2.515s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:05 devstack cinder-volume[87134]: DEBUG cinder.quota [req-c1781a7c-ff27-4e07-bdba-2a5c223ce93e req-94d4e30e-e4fd-4934-a5c3-afbb2552b981 tempest-VolumesSnapshotsTestJSON-1763905505 None] Created reservations ['19c5943d-0043-4de2-b37b-1bc590fc2de5', 'b576e638-c4e8-424b-81d6-47f664129762', '4de0c4b3-3f45-4dc5-bb2d-3d2b7cfe1a7b', 'dfcb92a3-1fea-4884-bb9b-f5b4386cd64e'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:47:05 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-c1781a7c-ff27-4e07-bdba-2a5c223ce93e req-94d4e30e-e4fd-4934-a5c3-afbb2552b981 tempest-VolumesSnapshotsTestJSON-1763905505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:05 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-c1781a7c-ff27-4e07-bdba-2a5c223ce93e req-94d4e30e-e4fd-4934-a5c3-afbb2552b981 tempest-VolumesSnapshotsTestJSON-1763905505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:05 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [req-c1781a7c-ff27-4e07-bdba-2a5c223ce93e req-94d4e30e-e4fd-4934-a5c3-afbb2552b981 tempest-VolumesSnapshotsTestJSON-1763905505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:47:05 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [req-c1781a7c-ff27-4e07-bdba-2a5c223ce93e req-94d4e30e-e4fd-4934-a5c3-afbb2552b981 tempest-VolumesSnapshotsTestJSON-1763905505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:47:05 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-c1781a7c-ff27-4e07-bdba-2a5c223ce93e req-94d4e30e-e4fd-4934-a5c3-afbb2552b981 tempest-VolumesSnapshotsTestJSON-1763905505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:05 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-c1781a7c-ff27-4e07-bdba-2a5c223ce93e req-94d4e30e-e4fd-4934-a5c3-afbb2552b981 tempest-VolumesSnapshotsTestJSON-1763905505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:05 devstack sudo[94141]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:05 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c46c94f1-85c0-44c1-9167-9d1cc3e042eb tempest-SnapshotsActionsTest-973068087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.ab8bd802-51dd-484c-bacb-9f648efe682d" returned: 0 in 1.291s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:05 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c46c94f1-85c0-44c1-9167-9d1cc3e042eb tempest-SnapshotsActionsTest-973068087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.ab8bd802-51dd-484c-bacb-9f648efe682d {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:05 devstack sudo[94151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:47:05 devstack sudo[94151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:05 devstack sudo[94152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.ab8bd802-51dd-484c-bacb-9f648efe682d Jul 08 01:47:05 devstack sudo[94152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:05 devstack sudo[94143]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:05 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e0da4e16-8bc5-46b8-9d4c-60a0b75388e0 tempest-GroupSnapshotsTest-1290797889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-fbd8ea42-95d7-440a-8d2a-193729481368.6069af2e-9858-4588-9e4e-da357e0e94f2" returned: 0 in 1.285s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:05 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e0da4e16-8bc5-46b8-9d4c-60a0b75388e0 tempest-GroupSnapshotsTest-1290797889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-fbd8ea42-95d7-440a-8d2a-193729481368.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:05 devstack sudo[94155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-fbd8ea42-95d7-440a-8d2a-193729481368.info Jul 08 01:47:05 devstack sudo[94155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:06 devstack sudo[94155]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:06 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e0da4e16-8bc5-46b8-9d4c-60a0b75388e0 tempest-GroupSnapshotsTest-1290797889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-fbd8ea42-95d7-440a-8d2a-193729481368.info" returned: 0 in 1.141s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:06 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-e0da4e16-8bc5-46b8-9d4c-60a0b75388e0 tempest-GroupSnapshotsTest-1290797889 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-fbd8ea42-95d7-440a-8d2a-193729481368.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 01:47:06 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e0da4e16-8bc5-46b8-9d4c-60a0b75388e0 tempest-GroupSnapshotsTest-1290797889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-fbd8ea42-95d7-440a-8d2a-193729481368.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:06 devstack sudo[94152]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:06 devstack sudo[94151]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:06 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c46c94f1-85c0-44c1-9167-9d1cc3e042eb tempest-SnapshotsActionsTest-973068087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.ab8bd802-51dd-484c-bacb-9f648efe682d" returned: 0 in 1.319s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:06 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-c1781a7c-ff27-4e07-bdba-2a5c223ce93e req-94d4e30e-e4fd-4934-a5c3-afbb2552b981 tempest-VolumesSnapshotsTestJSON-1763905505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 1.339s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:06 devstack sudo[94160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-fbd8ea42-95d7-440a-8d2a-193729481368.info Jul 08 01:47:06 devstack sudo[94160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:06 devstack cinder-volume[87134]: DEBUG cinder.manager [req-c1781a7c-ff27-4e07-bdba-2a5c223ce93e req-94d4e30e-e4fd-4934-a5c3-afbb2552b981 tempest-VolumesSnapshotsTestJSON-1763905505 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:47:06 devstack cinder-volume[87134]: INFO cinder.volume.manager [req-c1781a7c-ff27-4e07-bdba-2a5c223ce93e req-94d4e30e-e4fd-4934-a5c3-afbb2552b981 tempest-VolumesSnapshotsTestJSON-1763905505 None] Deleted volume successfully. Jul 08 01:47:06 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-c46c94f1-85c0-44c1-9167-9d1cc3e042eb tempest-SnapshotsActionsTest-973068087 None] Lock "cinder-quobyte-ab8bd802-51dd-484c-bacb-9f648efe682d" released by "_delete_snapshot" :: held 5.041s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:06 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-c46c94f1-85c0-44c1-9167-9d1cc3e042eb tempest-SnapshotsActionsTest-973068087 None] Lock "cinder-quobyte-41e27e51-647a-4db5-a8d7-8e510c819658" released by "delete_snapshot" :: held 5.087s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:06 devstack cinder-volume[87134]: DEBUG cinder.coordination [req-c1781a7c-ff27-4e07-bdba-2a5c223ce93e req-94d4e30e-e4fd-4934-a5c3-afbb2552b981 tempest-VolumesSnapshotsTestJSON-1763905505 None] Lock "cinder-34e139f7-b1f0-420f-bce6-2b13b9d3f019-delete_volume" released by "delete_volume" :: held 4.366s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:06 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-c46c94f1-85c0-44c1-9167-9d1cc3e042eb tempest-SnapshotsActionsTest-973068087 None] Created reservations ['f1baffc9-634b-475d-8006-a628e0f29ad6', 'ad49edee-47c9-4d1f-ab53-d8f6be0dccef', '3d5bcadb-852a-4436-aec0-38cd32d47e92', '0de84efb-23e6-4cf7-8e38-616eb2db6bdd'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:47:06 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-c46c94f1-85c0-44c1-9167-9d1cc3e042eb tempest-SnapshotsActionsTest-973068087 None] Delete snapshot completed successfully. Jul 08 01:47:06 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-c46c94f1-85c0-44c1-9167-9d1cc3e042eb tempest-SnapshotsActionsTest-973068087 None] Lock "cinder-ab8bd802-51dd-484c-bacb-9f648efe682d-delete_snapshot" released by "delete_snapshot" :: held 5.385s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:07 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-04e8056a-f8e2-4c37-b2f6-d46b8372f010 tempest-SnapshotsActionsTest-1208726570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:07 devstack sudo[94160]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:07 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e0da4e16-8bc5-46b8-9d4c-60a0b75388e0 tempest-GroupSnapshotsTest-1290797889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-fbd8ea42-95d7-440a-8d2a-193729481368.info" returned: 0 in 1.127s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:07 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e0da4e16-8bc5-46b8-9d4c-60a0b75388e0 tempest-GroupSnapshotsTest-1290797889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.425s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:07 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e0da4e16-8bc5-46b8-9d4c-60a0b75388e0 tempest-GroupSnapshotsTest-1290797889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:07 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e0da4e16-8bc5-46b8-9d4c-60a0b75388e0 tempest-GroupSnapshotsTest-1290797889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:07 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-e0da4e16-8bc5-46b8-9d4c-60a0b75388e0 tempest-GroupSnapshotsTest-1290797889 None] Creating offline snapshot b6fb16a4-e50d-4cad-af97-89f719bfcfca of volume a2cdf661-d32a-49d5-8fe8-78cd456896d2 {{(pid=87134) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:47:07 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7dcef4-2c2f-4ed7-b332-e00540c075a6]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:07 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e0da4e16-8bc5-46b8-9d4c-60a0b75388e0 tempest-GroupSnapshotsTest-1290797889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a2cdf661-d32a-49d5-8fe8-78cd456896d2 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:07 devstack sudo[94164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a2cdf661-d32a-49d5-8fe8-78cd456896d2 Jul 08 01:47:07 devstack sudo[94164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:08 devstack sudo[94164]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:08 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e0da4e16-8bc5-46b8-9d4c-60a0b75388e0 tempest-GroupSnapshotsTest-1290797889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a2cdf661-d32a-49d5-8fe8-78cd456896d2" returned: 0 in 1.069s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:08 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e0da4e16-8bc5-46b8-9d4c-60a0b75388e0 tempest-GroupSnapshotsTest-1290797889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a2cdf661-d32a-49d5-8fe8-78cd456896d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a2cdf661-d32a-49d5-8fe8-78cd456896d2.b6fb16a4-e50d-4cad-af97-89f719bfcfca 1G {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:08 devstack sudo[94171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a2cdf661-d32a-49d5-8fe8-78cd456896d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a2cdf661-d32a-49d5-8fe8-78cd456896d2.b6fb16a4-e50d-4cad-af97-89f719bfcfca 1G Jul 08 01:47:08 devstack sudo[94171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:09 devstack sudo[94171]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:09 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e0da4e16-8bc5-46b8-9d4c-60a0b75388e0 tempest-GroupSnapshotsTest-1290797889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a2cdf661-d32a-49d5-8fe8-78cd456896d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a2cdf661-d32a-49d5-8fe8-78cd456896d2.b6fb16a4-e50d-4cad-af97-89f719bfcfca 1G" returned: 0 in 0.996s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:09 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e0da4e16-8bc5-46b8-9d4c-60a0b75388e0 tempest-GroupSnapshotsTest-1290797889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2cdf661-d32a-49d5-8fe8-78cd456896d2 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a2cdf661-d32a-49d5-8fe8-78cd456896d2.b6fb16a4-e50d-4cad-af97-89f719bfcfca {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:09 devstack sudo[94177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2cdf661-d32a-49d5-8fe8-78cd456896d2 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a2cdf661-d32a-49d5-8fe8-78cd456896d2.b6fb16a4-e50d-4cad-af97-89f719bfcfca Jul 08 01:47:09 devstack sudo[94177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:10 devstack sudo[94177]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:10 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e0da4e16-8bc5-46b8-9d4c-60a0b75388e0 tempest-GroupSnapshotsTest-1290797889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2cdf661-d32a-49d5-8fe8-78cd456896d2 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a2cdf661-d32a-49d5-8fe8-78cd456896d2.b6fb16a4-e50d-4cad-af97-89f719bfcfca" returned: 0 in 0.837s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:10 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-e0da4e16-8bc5-46b8-9d4c-60a0b75388e0 tempest-GroupSnapshotsTest-1290797889 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a2cdf661-d32a-49d5-8fe8-78cd456896d2.b6fb16a4-e50d-4cad-af97-89f719bfcfca is being set with open permissions: ugo+rw: NotImplementedError Jul 08 01:47:10 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e0da4e16-8bc5-46b8-9d4c-60a0b75388e0 tempest-GroupSnapshotsTest-1290797889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a2cdf661-d32a-49d5-8fe8-78cd456896d2.b6fb16a4-e50d-4cad-af97-89f719bfcfca {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:10 devstack sudo[94182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a2cdf661-d32a-49d5-8fe8-78cd456896d2.b6fb16a4-e50d-4cad-af97-89f719bfcfca Jul 08 01:47:10 devstack sudo[94182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:11 devstack sudo[94182]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:11 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e0da4e16-8bc5-46b8-9d4c-60a0b75388e0 tempest-GroupSnapshotsTest-1290797889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a2cdf661-d32a-49d5-8fe8-78cd456896d2.b6fb16a4-e50d-4cad-af97-89f719bfcfca" returned: 0 in 0.748s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:11 devstack cinder-volume[87134]: DEBUG dbcounter [-] [87134] Writing DB stats cinder:UPDATE=113,cinder:INSERT=26,cinder:DELETE=6,cinder:SELECT=111 {{(pid=87134) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:47:11 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e0da4e16-8bc5-46b8-9d4c-60a0b75388e0 tempest-GroupSnapshotsTest-1290797889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a2cdf661-d32a-49d5-8fe8-78cd456896d2.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:11 devstack sudo[94187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a2cdf661-d32a-49d5-8fe8-78cd456896d2.info Jul 08 01:47:11 devstack sudo[94187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:12 devstack sudo[94187]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:12 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e0da4e16-8bc5-46b8-9d4c-60a0b75388e0 tempest-GroupSnapshotsTest-1290797889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a2cdf661-d32a-49d5-8fe8-78cd456896d2.info" returned: 0 in 0.768s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:12 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-e0da4e16-8bc5-46b8-9d4c-60a0b75388e0 tempest-GroupSnapshotsTest-1290797889 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a2cdf661-d32a-49d5-8fe8-78cd456896d2.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 01:47:12 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e0da4e16-8bc5-46b8-9d4c-60a0b75388e0 tempest-GroupSnapshotsTest-1290797889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a2cdf661-d32a-49d5-8fe8-78cd456896d2.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:12 devstack sudo[94191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a2cdf661-d32a-49d5-8fe8-78cd456896d2.info Jul 08 01:47:12 devstack sudo[94191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:12 devstack sudo[94191]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e0da4e16-8bc5-46b8-9d4c-60a0b75388e0 tempest-GroupSnapshotsTest-1290797889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a2cdf661-d32a-49d5-8fe8-78cd456896d2.info" returned: 0 in 0.741s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e0da4e16-8bc5-46b8-9d4c-60a0b75388e0 tempest-GroupSnapshotsTest-1290797889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.327s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-04e8056a-f8e2-4c37-b2f6-d46b8372f010 tempest-SnapshotsActionsTest-1208726570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.445s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:13 devstack cinder-volume[87134]: DEBUG dbcounter [-] [87134] Writing DB stats cinder:SELECT=114,cinder:INSERT=27,cinder:UPDATE=105,cinder:DELETE=8 {{(pid=87134) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:47:13 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-04e8056a-f8e2-4c37-b2f6-d46b8372f010 tempest-SnapshotsActionsTest-1208726570 None] Creating offline snapshot 465afca1-1d4e-41f6-b72f-2c8ee1d1a9e1 of volume 41e27e51-647a-4db5-a8d7-8e510c819658 {{(pid=87134) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:47:13 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf300e1f-44b9-47fa-9e63-12bb8931024d]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-04e8056a-f8e2-4c37-b2f6-d46b8372f010 tempest-SnapshotsActionsTest-1208726570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.1432a5c9-0a9f-46a6-a0b9-57de9ecf375e {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:13 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-e0da4e16-8bc5-46b8-9d4c-60a0b75388e0 tempest-GroupSnapshotsTest-1290797889 None] group_snapshot b7076e42-7d8d-4d9d-be84-75570c38e82b: created successfully Jul 08 01:47:13 devstack sudo[94194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.1432a5c9-0a9f-46a6-a0b9-57de9ecf375e Jul 08 01:47:13 devstack sudo[94194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:13 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-8bdd55bd-481f-4591-9814-c95b940003e2 tempest-GroupSnapshotsTest-1290797889 None] group_snapshot b7076e42-7d8d-4d9d-be84-75570c38e82b: deleting Jul 08 01:47:13 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8bdd55bd-481f-4591-9814-c95b940003e2 tempest-GroupSnapshotsTest-1290797889 None] group_snapshot b7076e42-7d8d-4d9d-be84-75570c38e82b: deleting {{(pid=87134) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 08 01:47:13 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-8bdd55bd-481f-4591-9814-c95b940003e2 tempest-GroupSnapshotsTest-1290797889 None] Acquiring lock "cinder-quobyte-fbd8ea42-95d7-440a-8d2a-193729481368" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:13 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-8bdd55bd-481f-4591-9814-c95b940003e2 tempest-GroupSnapshotsTest-1290797889 None] Lock "cinder-quobyte-fbd8ea42-95d7-440a-8d2a-193729481368" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:13 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-8bdd55bd-481f-4591-9814-c95b940003e2 tempest-GroupSnapshotsTest-1290797889 None] Acquiring lock "cinder-quobyte-6069af2e-9858-4588-9e4e-da357e0e94f2" by "_delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:13 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-8bdd55bd-481f-4591-9814-c95b940003e2 tempest-GroupSnapshotsTest-1290797889 None] Lock "cinder-quobyte-6069af2e-9858-4588-9e4e-da357e0e94f2" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:13 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-8bdd55bd-481f-4591-9814-c95b940003e2 tempest-GroupSnapshotsTest-1290797889 None] Deleting offline snapshot 6069af2e-9858-4588-9e4e-da357e0e94f2 of volume fbd8ea42-95d7-440a-8d2a-193729481368 {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:47:13 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-8bdd55bd-481f-4591-9814-c95b940003e2 tempest-GroupSnapshotsTest-1290797889 None] snapshot_file for this snap is: volume-fbd8ea42-95d7-440a-8d2a-193729481368.6069af2e-9858-4588-9e4e-da357e0e94f2 {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:47:13 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1288461-9a4b-4283-8607-529e89803095]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8bdd55bd-481f-4591-9814-c95b940003e2 tempest-GroupSnapshotsTest-1290797889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-fbd8ea42-95d7-440a-8d2a-193729481368.6069af2e-9858-4588-9e4e-da357e0e94f2 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:13 devstack sudo[94196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-fbd8ea42-95d7-440a-8d2a-193729481368.6069af2e-9858-4588-9e4e-da357e0e94f2 Jul 08 01:47:13 devstack sudo[94196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:14 devstack sudo[94194]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:14 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-04e8056a-f8e2-4c37-b2f6-d46b8372f010 tempest-SnapshotsActionsTest-1208726570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.1432a5c9-0a9f-46a6-a0b9-57de9ecf375e" returned: 0 in 1.248s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:14 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-04e8056a-f8e2-4c37-b2f6-d46b8372f010 tempest-SnapshotsActionsTest-1208726570 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41e27e51-647a-4db5-a8d7-8e510c819658(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:47:14 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-04e8056a-f8e2-4c37-b2f6-d46b8372f010 tempest-SnapshotsActionsTest-1208726570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.1432a5c9-0a9f-46a6-a0b9-57de9ecf375e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.465afca1-1d4e-41f6-b72f-2c8ee1d1a9e1 1G {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:14 devstack sudo[94201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.1432a5c9-0a9f-46a6-a0b9-57de9ecf375e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.465afca1-1d4e-41f6-b72f-2c8ee1d1a9e1 1G Jul 08 01:47:14 devstack sudo[94201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:14 devstack sudo[94196]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:14 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8bdd55bd-481f-4591-9814-c95b940003e2 tempest-GroupSnapshotsTest-1290797889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-fbd8ea42-95d7-440a-8d2a-193729481368.6069af2e-9858-4588-9e4e-da357e0e94f2" returned: 0 in 0.973s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:14 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-8bdd55bd-481f-4591-9814-c95b940003e2 tempest-GroupSnapshotsTest-1290797889 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fbd8ea42-95d7-440a-8d2a-193729481368(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:47:14 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5435d5c-2c5a-470f-8541-4a67af3b109d]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:14 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8bdd55bd-481f-4591-9814-c95b940003e2 tempest-GroupSnapshotsTest-1290797889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-fbd8ea42-95d7-440a-8d2a-193729481368 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:14 devstack sudo[94207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-fbd8ea42-95d7-440a-8d2a-193729481368 Jul 08 01:47:14 devstack sudo[94207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:15 devstack sudo[94201]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-04e8056a-f8e2-4c37-b2f6-d46b8372f010 tempest-SnapshotsActionsTest-1208726570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.1432a5c9-0a9f-46a6-a0b9-57de9ecf375e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.465afca1-1d4e-41f6-b72f-2c8ee1d1a9e1 1G" returned: 0 in 1.398s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-04e8056a-f8e2-4c37-b2f6-d46b8372f010 tempest-SnapshotsActionsTest-1208726570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41e27e51-647a-4db5-a8d7-8e510c819658.1432a5c9-0a9f-46a6-a0b9-57de9ecf375e -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.465afca1-1d4e-41f6-b72f-2c8ee1d1a9e1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:15 devstack sudo[94216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41e27e51-647a-4db5-a8d7-8e510c819658.1432a5c9-0a9f-46a6-a0b9-57de9ecf375e -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.465afca1-1d4e-41f6-b72f-2c8ee1d1a9e1 Jul 08 01:47:15 devstack sudo[94216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:15 devstack sudo[94207]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8bdd55bd-481f-4591-9814-c95b940003e2 tempest-GroupSnapshotsTest-1290797889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-fbd8ea42-95d7-440a-8d2a-193729481368" returned: 0 in 1.033s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8bdd55bd-481f-4591-9814-c95b940003e2 tempest-GroupSnapshotsTest-1290797889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-fbd8ea42-95d7-440a-8d2a-193729481368.6069af2e-9858-4588-9e4e-da357e0e94f2 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:15 devstack sudo[94218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-fbd8ea42-95d7-440a-8d2a-193729481368.6069af2e-9858-4588-9e4e-da357e0e94f2 Jul 08 01:47:15 devstack sudo[94218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:16 devstack sudo[94216]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-04e8056a-f8e2-4c37-b2f6-d46b8372f010 tempest-SnapshotsActionsTest-1208726570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41e27e51-647a-4db5-a8d7-8e510c819658.1432a5c9-0a9f-46a6-a0b9-57de9ecf375e -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.465afca1-1d4e-41f6-b72f-2c8ee1d1a9e1" returned: 0 in 0.905s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:16 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-04e8056a-f8e2-4c37-b2f6-d46b8372f010 tempest-SnapshotsActionsTest-1208726570 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.465afca1-1d4e-41f6-b72f-2c8ee1d1a9e1 is being set with open permissions: ugo+rw Jul 08 01:47:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-04e8056a-f8e2-4c37-b2f6-d46b8372f010 tempest-SnapshotsActionsTest-1208726570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.465afca1-1d4e-41f6-b72f-2c8ee1d1a9e1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:16 devstack sudo[94243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.465afca1-1d4e-41f6-b72f-2c8ee1d1a9e1 Jul 08 01:47:16 devstack sudo[94243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:16 devstack sudo[94218]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8bdd55bd-481f-4591-9814-c95b940003e2 tempest-GroupSnapshotsTest-1290797889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-fbd8ea42-95d7-440a-8d2a-193729481368.6069af2e-9858-4588-9e4e-da357e0e94f2" returned: 0 in 0.923s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8bdd55bd-481f-4591-9814-c95b940003e2 tempest-GroupSnapshotsTest-1290797889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-fbd8ea42-95d7-440a-8d2a-193729481368.6069af2e-9858-4588-9e4e-da357e0e94f2 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:16 devstack sudo[94245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-fbd8ea42-95d7-440a-8d2a-193729481368.6069af2e-9858-4588-9e4e-da357e0e94f2 Jul 08 01:47:16 devstack sudo[94245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:16 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-03fa4155-cdd9-4d8b-a0e8-1537af9e7fbc tempest-BackendsCapabilitiesAdminTestsJSON-637149002 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6598472595215, 'free_capacity_gb': 1775.6598472595215, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87134) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 08 01:47:17 devstack sudo[94243]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-04e8056a-f8e2-4c37-b2f6-d46b8372f010 tempest-SnapshotsActionsTest-1208726570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.465afca1-1d4e-41f6-b72f-2c8ee1d1a9e1" returned: 0 in 0.700s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-04e8056a-f8e2-4c37-b2f6-d46b8372f010 tempest-SnapshotsActionsTest-1208726570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.377s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:17 devstack sudo[94245]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8bdd55bd-481f-4591-9814-c95b940003e2 tempest-GroupSnapshotsTest-1290797889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-fbd8ea42-95d7-440a-8d2a-193729481368.6069af2e-9858-4588-9e4e-da357e0e94f2" returned: 0 in 0.691s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:17 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-04e8056a-f8e2-4c37-b2f6-d46b8372f010 tempest-SnapshotsActionsTest-1208726570 None] Create snapshot completed successfully Jul 08 01:47:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e7f8dcdb-a6f3-4423-b488-bd4fbf9a7391 tempest-BackendsCapabilitiesAdminTestsJSON-637149002 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6598472595215, 'free_capacity_gb': 1775.6598472595215, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87134) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 08 01:47:17 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-8bdd55bd-481f-4591-9814-c95b940003e2 tempest-GroupSnapshotsTest-1290797889 None] Lock "cinder-quobyte-6069af2e-9858-4588-9e4e-da357e0e94f2" released by "_delete_snapshot" :: held 3.805s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:17 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-8bdd55bd-481f-4591-9814-c95b940003e2 tempest-GroupSnapshotsTest-1290797889 None] Lock "cinder-quobyte-fbd8ea42-95d7-440a-8d2a-193729481368" released by "delete_snapshot" :: held 3.838s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:17 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-8bdd55bd-481f-4591-9814-c95b940003e2 tempest-GroupSnapshotsTest-1290797889 None] Acquiring lock "cinder-quobyte-a2cdf661-d32a-49d5-8fe8-78cd456896d2" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:17 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-8bdd55bd-481f-4591-9814-c95b940003e2 tempest-GroupSnapshotsTest-1290797889 None] Lock "cinder-quobyte-a2cdf661-d32a-49d5-8fe8-78cd456896d2" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:17 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-8bdd55bd-481f-4591-9814-c95b940003e2 tempest-GroupSnapshotsTest-1290797889 None] Acquiring lock "cinder-quobyte-b6fb16a4-e50d-4cad-af97-89f719bfcfca" by "_delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:17 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-8bdd55bd-481f-4591-9814-c95b940003e2 tempest-GroupSnapshotsTest-1290797889 None] Lock "cinder-quobyte-b6fb16a4-e50d-4cad-af97-89f719bfcfca" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:17 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-8bdd55bd-481f-4591-9814-c95b940003e2 tempest-GroupSnapshotsTest-1290797889 None] Deleting offline snapshot b6fb16a4-e50d-4cad-af97-89f719bfcfca of volume a2cdf661-d32a-49d5-8fe8-78cd456896d2 {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:47:17 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-8bdd55bd-481f-4591-9814-c95b940003e2 tempest-GroupSnapshotsTest-1290797889 None] snapshot_file for this snap is: volume-a2cdf661-d32a-49d5-8fe8-78cd456896d2.b6fb16a4-e50d-4cad-af97-89f719bfcfca {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:47:17 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[933ce80f-ea74-4780-931a-82065438db29]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8bdd55bd-481f-4591-9814-c95b940003e2 tempest-GroupSnapshotsTest-1290797889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a2cdf661-d32a-49d5-8fe8-78cd456896d2.b6fb16a4-e50d-4cad-af97-89f719bfcfca {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:17 devstack sudo[94249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a2cdf661-d32a-49d5-8fe8-78cd456896d2.b6fb16a4-e50d-4cad-af97-89f719bfcfca Jul 08 01:47:17 devstack sudo[94249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:18 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a3f46948-e251-469b-9346-7bc25ab15162 tempest-SnapshotsActionsTest-973068087 None] Acquiring lock "cinder-465afca1-1d4e-41f6-b72f-2c8ee1d1a9e1-delete_snapshot" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:18 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a3f46948-e251-469b-9346-7bc25ab15162 tempest-SnapshotsActionsTest-973068087 None] Lock "cinder-465afca1-1d4e-41f6-b72f-2c8ee1d1a9e1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:18 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a3f46948-e251-469b-9346-7bc25ab15162 tempest-SnapshotsActionsTest-973068087 None] Acquiring lock "cinder-quobyte-41e27e51-647a-4db5-a8d7-8e510c819658" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:18 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a3f46948-e251-469b-9346-7bc25ab15162 tempest-SnapshotsActionsTest-973068087 None] Lock "cinder-quobyte-41e27e51-647a-4db5-a8d7-8e510c819658" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:18 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a3f46948-e251-469b-9346-7bc25ab15162 tempest-SnapshotsActionsTest-973068087 None] Acquiring lock "cinder-quobyte-465afca1-1d4e-41f6-b72f-2c8ee1d1a9e1" by "_delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:18 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a3f46948-e251-469b-9346-7bc25ab15162 tempest-SnapshotsActionsTest-973068087 None] Lock "cinder-quobyte-465afca1-1d4e-41f6-b72f-2c8ee1d1a9e1" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:18 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-a3f46948-e251-469b-9346-7bc25ab15162 tempest-SnapshotsActionsTest-973068087 None] Deleting offline snapshot 465afca1-1d4e-41f6-b72f-2c8ee1d1a9e1 of volume 41e27e51-647a-4db5-a8d7-8e510c819658 {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:47:18 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-a3f46948-e251-469b-9346-7bc25ab15162 tempest-SnapshotsActionsTest-973068087 None] snapshot_file for this snap is: volume-41e27e51-647a-4db5-a8d7-8e510c819658.465afca1-1d4e-41f6-b72f-2c8ee1d1a9e1 {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:47:18 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[d10c4828-f2fd-4118-8cc6-120b0223ca88]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a3f46948-e251-469b-9346-7bc25ab15162 tempest-SnapshotsActionsTest-973068087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.465afca1-1d4e-41f6-b72f-2c8ee1d1a9e1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:18 devstack sudo[94249]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8bdd55bd-481f-4591-9814-c95b940003e2 tempest-GroupSnapshotsTest-1290797889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a2cdf661-d32a-49d5-8fe8-78cd456896d2.b6fb16a4-e50d-4cad-af97-89f719bfcfca" returned: 0 in 0.857s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:18 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-8bdd55bd-481f-4591-9814-c95b940003e2 tempest-GroupSnapshotsTest-1290797889 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2cdf661-d32a-49d5-8fe8-78cd456896d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:47:18 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61b754b-c3f2-49ae-aceb-f41efdf003cc]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8bdd55bd-481f-4591-9814-c95b940003e2 tempest-GroupSnapshotsTest-1290797889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a2cdf661-d32a-49d5-8fe8-78cd456896d2 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:18 devstack sudo[94254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.465afca1-1d4e-41f6-b72f-2c8ee1d1a9e1 Jul 08 01:47:18 devstack sudo[94254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:18 devstack sudo[94255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a2cdf661-d32a-49d5-8fe8-78cd456896d2 Jul 08 01:47:18 devstack sudo[94255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:19 devstack sudo[94254]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a3f46948-e251-469b-9346-7bc25ab15162 tempest-SnapshotsActionsTest-973068087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.465afca1-1d4e-41f6-b72f-2c8ee1d1a9e1" returned: 0 in 0.984s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:19 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-a3f46948-e251-469b-9346-7bc25ab15162 tempest-SnapshotsActionsTest-973068087 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41e27e51-647a-4db5-a8d7-8e510c819658(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:47:19 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc66889e-b9df-4972-b9ca-5bc91d86b5d2]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:19 devstack sudo[94255]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a3f46948-e251-469b-9346-7bc25ab15162 tempest-SnapshotsActionsTest-973068087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.1432a5c9-0a9f-46a6-a0b9-57de9ecf375e {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8bdd55bd-481f-4591-9814-c95b940003e2 tempest-GroupSnapshotsTest-1290797889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a2cdf661-d32a-49d5-8fe8-78cd456896d2" returned: 0 in 0.937s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8bdd55bd-481f-4591-9814-c95b940003e2 tempest-GroupSnapshotsTest-1290797889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a2cdf661-d32a-49d5-8fe8-78cd456896d2.b6fb16a4-e50d-4cad-af97-89f719bfcfca {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:19 devstack sudo[94266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a2cdf661-d32a-49d5-8fe8-78cd456896d2.b6fb16a4-e50d-4cad-af97-89f719bfcfca Jul 08 01:47:19 devstack sudo[94266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:19 devstack sudo[94265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.1432a5c9-0a9f-46a6-a0b9-57de9ecf375e Jul 08 01:47:19 devstack sudo[94265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:20 devstack sudo[94266]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8bdd55bd-481f-4591-9814-c95b940003e2 tempest-GroupSnapshotsTest-1290797889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a2cdf661-d32a-49d5-8fe8-78cd456896d2.b6fb16a4-e50d-4cad-af97-89f719bfcfca" returned: 0 in 0.910s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8bdd55bd-481f-4591-9814-c95b940003e2 tempest-GroupSnapshotsTest-1290797889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a2cdf661-d32a-49d5-8fe8-78cd456896d2.b6fb16a4-e50d-4cad-af97-89f719bfcfca {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:20 devstack sudo[94276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a2cdf661-d32a-49d5-8fe8-78cd456896d2.b6fb16a4-e50d-4cad-af97-89f719bfcfca Jul 08 01:47:20 devstack sudo[94276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:20 devstack sudo[94265]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a3f46948-e251-469b-9346-7bc25ab15162 tempest-SnapshotsActionsTest-973068087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.1432a5c9-0a9f-46a6-a0b9-57de9ecf375e" returned: 0 in 0.965s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:20 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-a3f46948-e251-469b-9346-7bc25ab15162 tempest-SnapshotsActionsTest-973068087 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41e27e51-647a-4db5-a8d7-8e510c819658(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:47:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a3f46948-e251-469b-9346-7bc25ab15162 tempest-SnapshotsActionsTest-973068087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.465afca1-1d4e-41f6-b72f-2c8ee1d1a9e1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:20 devstack sudo[94278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.465afca1-1d4e-41f6-b72f-2c8ee1d1a9e1 Jul 08 01:47:20 devstack sudo[94278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:20 devstack cinder-volume[87134]: DEBUG oslo_service.periodic_task [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87134) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:47:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:20 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:47:20 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:47:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:20 devstack sudo[94314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:47:20 devstack sudo[94314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:21 devstack sudo[94276]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8bdd55bd-481f-4591-9814-c95b940003e2 tempest-GroupSnapshotsTest-1290797889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a2cdf661-d32a-49d5-8fe8-78cd456896d2.b6fb16a4-e50d-4cad-af97-89f719bfcfca" returned: 0 in 0.943s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:21 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-8bdd55bd-481f-4591-9814-c95b940003e2 tempest-GroupSnapshotsTest-1290797889 None] Lock "cinder-quobyte-b6fb16a4-e50d-4cad-af97-89f719bfcfca" released by "_delete_snapshot" :: held 3.767s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:21 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-8bdd55bd-481f-4591-9814-c95b940003e2 tempest-GroupSnapshotsTest-1290797889 None] Lock "cinder-quobyte-a2cdf661-d32a-49d5-8fe8-78cd456896d2" released by "delete_snapshot" :: held 3.793s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:21 devstack cinder-volume[87134]: WARNING cinder.quota [None req-8bdd55bd-481f-4591-9814-c95b940003e2 tempest-GroupSnapshotsTest-1290797889 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1607158817 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1607158817, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:47:21 devstack cinder-volume[87134]: WARNING cinder.quota [None req-8bdd55bd-481f-4591-9814-c95b940003e2 tempest-GroupSnapshotsTest-1290797889 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1607158817 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1607158817, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:47:21 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-8bdd55bd-481f-4591-9814-c95b940003e2 tempest-GroupSnapshotsTest-1290797889 None] Created reservations ['dd0ed593-1dbd-4e9d-9c07-fe9846499ee5', '8f839919-0c30-4cd0-9ac7-1fdd7748e895', 'c175aa84-0653-4795-8409-7196322c7536', '21929dfe-85ae-4b55-a88d-a624d1fa7e63'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:47:21 devstack sudo[94278]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a3f46948-e251-469b-9346-7bc25ab15162 tempest-SnapshotsActionsTest-973068087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.465afca1-1d4e-41f6-b72f-2c8ee1d1a9e1" returned: 0 in 1.094s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a3f46948-e251-469b-9346-7bc25ab15162 tempest-SnapshotsActionsTest-973068087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.465afca1-1d4e-41f6-b72f-2c8ee1d1a9e1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:21 devstack sudo[94324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.465afca1-1d4e-41f6-b72f-2c8ee1d1a9e1 Jul 08 01:47:21 devstack sudo[94324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:21 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-8bdd55bd-481f-4591-9814-c95b940003e2 tempest-GroupSnapshotsTest-1290797889 None] Created reservations ['febb31c9-9bb5-480e-9eaa-14d1e39dd3c0', '5557d6ac-4fae-410e-963f-7661764fd174', '4295831b-62ee-492e-9c52-bebbb6cd05a9', '9e319952-11f5-484d-8b3c-fdfe39749f95'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:47:21 devstack sudo[94314]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.897s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:21 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:47:21 devstack cinder-volume[87134]: DEBUG oslo_service.periodic_task [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running periodic task VolumeManager._thread_info {{(pid=87134) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:47:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] thread count: 8 {{(pid=87134) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:47:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] thread info: [<_MainThread(MainThread, started 129378964615296)>, , , , , , , ] {{(pid=87134) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:47:21 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-8bdd55bd-481f-4591-9814-c95b940003e2 tempest-GroupSnapshotsTest-1290797889 None] group_snapshot b7076e42-7d8d-4d9d-be84-75570c38e82b: deleted successfully Jul 08 01:47:22 devstack sudo[94324]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a3f46948-e251-469b-9346-7bc25ab15162 tempest-SnapshotsActionsTest-973068087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.465afca1-1d4e-41f6-b72f-2c8ee1d1a9e1" returned: 0 in 0.742s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:22 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a3f46948-e251-469b-9346-7bc25ab15162 tempest-SnapshotsActionsTest-973068087 None] Lock "cinder-quobyte-465afca1-1d4e-41f6-b72f-2c8ee1d1a9e1" released by "_delete_snapshot" :: held 3.923s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:22 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a3f46948-e251-469b-9346-7bc25ab15162 tempest-SnapshotsActionsTest-973068087 None] Lock "cinder-quobyte-41e27e51-647a-4db5-a8d7-8e510c819658" released by "delete_snapshot" :: held 3.946s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:22 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-a3f46948-e251-469b-9346-7bc25ab15162 tempest-SnapshotsActionsTest-973068087 None] Created reservations ['745c45d3-a283-4a51-8035-2a3d9cd75068', '4cdcb852-0c7d-403c-8be4-6127b5c7441f', 'b6c2ef39-c6e7-463d-b5cd-d34ebf04f016', '88ea8e76-0cd8-4330-b8c6-709be8798624'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:47:22 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-a3f46948-e251-469b-9346-7bc25ab15162 tempest-SnapshotsActionsTest-973068087 None] Delete snapshot completed successfully. Jul 08 01:47:22 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a3f46948-e251-469b-9346-7bc25ab15162 tempest-SnapshotsActionsTest-973068087 None] Lock "cinder-465afca1-1d4e-41f6-b72f-2c8ee1d1a9e1-delete_snapshot" released by "delete_snapshot" :: held 4.087s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-27b10a8e-89b3-487b-bfd8-c6759d7b9229 tempest-SnapshotsActionsTest-1208726570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-27b10a8e-89b3-487b-bfd8-c6759d7b9229 tempest-SnapshotsActionsTest-1208726570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:22 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-27b10a8e-89b3-487b-bfd8-c6759d7b9229 tempest-SnapshotsActionsTest-1208726570 None] Creating offline snapshot 98035b43-4c38-4b7d-bd0d-4861f9ab3aca of volume 41e27e51-647a-4db5-a8d7-8e510c819658 {{(pid=87134) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:47:22 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e7e5d6-4c78-47d6-b7db-2310afc14160]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:23 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-27b10a8e-89b3-487b-bfd8-c6759d7b9229 tempest-SnapshotsActionsTest-1208726570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.1432a5c9-0a9f-46a6-a0b9-57de9ecf375e {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:23 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-58c95860-3bfb-46f1-aacf-c1919e7a3fec tempest-GroupSnapshotsTest-1290797889 None] Acquiring lock "cinder-quobyte-a2cdf661-d32a-49d5-8fe8-78cd456896d2" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:23 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-58c95860-3bfb-46f1-aacf-c1919e7a3fec tempest-GroupSnapshotsTest-1290797889 None] Lock "cinder-quobyte-a2cdf661-d32a-49d5-8fe8-78cd456896d2" acquired by "delete_volume" :: waited 0.028s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:23 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[142cfb3d-97f2-4186-99ab-e8eeca86f288]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:23 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-58c95860-3bfb-46f1-aacf-c1919e7a3fec tempest-GroupSnapshotsTest-1290797889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a2cdf661-d32a-49d5-8fe8-78cd456896d2 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:23 devstack sudo[94329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.1432a5c9-0a9f-46a6-a0b9-57de9ecf375e Jul 08 01:47:23 devstack sudo[94329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:23 devstack sudo[94330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a2cdf661-d32a-49d5-8fe8-78cd456896d2 Jul 08 01:47:23 devstack sudo[94330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:24 devstack sudo[94329]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-27b10a8e-89b3-487b-bfd8-c6759d7b9229 tempest-SnapshotsActionsTest-1208726570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.1432a5c9-0a9f-46a6-a0b9-57de9ecf375e" returned: 0 in 1.013s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:24 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-27b10a8e-89b3-487b-bfd8-c6759d7b9229 tempest-SnapshotsActionsTest-1208726570 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41e27e51-647a-4db5-a8d7-8e510c819658(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:47:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-27b10a8e-89b3-487b-bfd8-c6759d7b9229 tempest-SnapshotsActionsTest-1208726570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.1432a5c9-0a9f-46a6-a0b9-57de9ecf375e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.98035b43-4c38-4b7d-bd0d-4861f9ab3aca 1G {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:24 devstack sudo[94339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.1432a5c9-0a9f-46a6-a0b9-57de9ecf375e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.98035b43-4c38-4b7d-bd0d-4861f9ab3aca 1G Jul 08 01:47:24 devstack sudo[94339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:24 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-5bf2a28f-f044-4de8-8942-9285f69e16c3 tempest-GroupSnapshotsV319Test-1019268315 None] Group tempest-GroupSnapshotsV319Test-Group-397184601: creating Jul 08 01:47:24 devstack sudo[94330]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-58c95860-3bfb-46f1-aacf-c1919e7a3fec tempest-GroupSnapshotsTest-1290797889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a2cdf661-d32a-49d5-8fe8-78cd456896d2" returned: 0 in 0.980s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-58c95860-3bfb-46f1-aacf-c1919e7a3fec tempest-GroupSnapshotsTest-1290797889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a2cdf661-d32a-49d5-8fe8-78cd456896d2 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:24 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-5bf2a28f-f044-4de8-8942-9285f69e16c3 tempest-GroupSnapshotsV319Test-1019268315 None] Group tempest-GroupSnapshotsV319Test-Group-397184601: created successfully Jul 08 01:47:24 devstack sudo[94341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a2cdf661-d32a-49d5-8fe8-78cd456896d2 Jul 08 01:47:24 devstack sudo[94341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:24 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-5bf2a28f-f044-4de8-8942-9285f69e16c3 tempest-GroupSnapshotsV319Test-1019268315 None] Create group completed successfully. Jul 08 01:47:24 devstack sudo[94341]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-58c95860-3bfb-46f1-aacf-c1919e7a3fec tempest-GroupSnapshotsTest-1290797889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a2cdf661-d32a-49d5-8fe8-78cd456896d2" returned: 0 in 0.727s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:24 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-58c95860-3bfb-46f1-aacf-c1919e7a3fec tempest-GroupSnapshotsTest-1290797889 None] Lock "cinder-quobyte-a2cdf661-d32a-49d5-8fe8-78cd456896d2" released by "delete_volume" :: held 1.790s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:24 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-58c95860-3bfb-46f1-aacf-c1919e7a3fec tempest-GroupSnapshotsTest-1290797889 None] Acquiring lock "cinder-quobyte-fbd8ea42-95d7-440a-8d2a-193729481368" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:24 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-58c95860-3bfb-46f1-aacf-c1919e7a3fec tempest-GroupSnapshotsTest-1290797889 None] Lock "cinder-quobyte-fbd8ea42-95d7-440a-8d2a-193729481368" acquired by "delete_volume" :: waited 0.020s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:24 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca4b994-8788-454c-a5fd-a1892cc47077]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-58c95860-3bfb-46f1-aacf-c1919e7a3fec tempest-GroupSnapshotsTest-1290797889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-fbd8ea42-95d7-440a-8d2a-193729481368 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:25 devstack sudo[94339]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:25 devstack sudo[94347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-fbd8ea42-95d7-440a-8d2a-193729481368 Jul 08 01:47:25 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-27b10a8e-89b3-487b-bfd8-c6759d7b9229 tempest-SnapshotsActionsTest-1208726570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.1432a5c9-0a9f-46a6-a0b9-57de9ecf375e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.98035b43-4c38-4b7d-bd0d-4861f9ab3aca 1G" returned: 0 in 1.011s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:25 devstack sudo[94347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:25 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-27b10a8e-89b3-487b-bfd8-c6759d7b9229 tempest-SnapshotsActionsTest-1208726570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41e27e51-647a-4db5-a8d7-8e510c819658.1432a5c9-0a9f-46a6-a0b9-57de9ecf375e -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.98035b43-4c38-4b7d-bd0d-4861f9ab3aca {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:25 devstack sudo[94349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41e27e51-647a-4db5-a8d7-8e510c819658.1432a5c9-0a9f-46a6-a0b9-57de9ecf375e -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.98035b43-4c38-4b7d-bd0d-4861f9ab3aca Jul 08 01:47:25 devstack sudo[94349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:25 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c215e4d-3a4f-4cff-9a1d-5e3c63c0fdd2 tempest-GroupSnapshotsV319Test-1019268315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:47:25 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5c215e4d-3a4f-4cff-9a1d-5e3c63c0fdd2 tempest-GroupSnapshotsV319Test-1019268315 None] Flow 'volume_create_manager' (77fdf590-52a1-4518-9b3f-dca969efc528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:47:25 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5c215e4d-3a4f-4cff-9a1d-5e3c63c0fdd2 tempest-GroupSnapshotsV319Test-1019268315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9126c0ba-20b9-41e9-afe7-36861cce7c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:25 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5c215e4d-3a4f-4cff-9a1d-5e3c63c0fdd2 tempest-GroupSnapshotsV319Test-1019268315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9126c0ba-20b9-41e9-afe7-36861cce7c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:47:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1918639842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7b8dc42d-f038-444f-b7bc-3818b0ba526f,host='devstack@QuobyteHD#QuobyteHD',id=33132111-d7fd-4e28-90ce-37e6dab2a5b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0680c181b6f84fc3ac282db271bbe525',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:47:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:47:26Z,use_quota=True,user_id='0f915cdcbf60422c9e28f9db30e27d41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(403d4910-7674-44a5-b29e-108f64f25a1b),volume_type_id=403d4910-7674-44a5-b29e-108f64f25a1b)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:25 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5c215e4d-3a4f-4cff-9a1d-5e3c63c0fdd2 tempest-GroupSnapshotsV319Test-1019268315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4615d46e-d5c5-4b23-ad9e-68b2efc86bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:25 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5c215e4d-3a4f-4cff-9a1d-5e3c63c0fdd2 tempest-GroupSnapshotsV319Test-1019268315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4615d46e-d5c5-4b23-ad9e-68b2efc86bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:25 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5c215e4d-3a4f-4cff-9a1d-5e3c63c0fdd2 tempest-GroupSnapshotsV319Test-1019268315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52178128-e1f6-41e0-9a63-f9d116486a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:25 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5c215e4d-3a4f-4cff-9a1d-5e3c63c0fdd2 tempest-GroupSnapshotsV319Test-1019268315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52178128-e1f6-41e0-9a63-f9d116486a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33132111-d7fd-4e28-90ce-37e6dab2a5b6', 'volume_name': 'volume-33132111-d7fd-4e28-90ce-37e6dab2a5b6', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:25 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5c215e4d-3a4f-4cff-9a1d-5e3c63c0fdd2 tempest-GroupSnapshotsV319Test-1019268315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28183cbc-fdf1-4f9d-bdbf-1b1eed5907e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:25 devstack sudo[94347]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:25 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5c215e4d-3a4f-4cff-9a1d-5e3c63c0fdd2 tempest-GroupSnapshotsV319Test-1019268315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28183cbc-fdf1-4f9d-bdbf-1b1eed5907e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:25 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5c215e4d-3a4f-4cff-9a1d-5e3c63c0fdd2 tempest-GroupSnapshotsV319Test-1019268315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cd40d29-4713-45c9-854c-af810be6a328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:25 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-5c215e4d-3a4f-4cff-9a1d-5e3c63c0fdd2 tempest-GroupSnapshotsV319Test-1019268315 None] Volume 33132111-d7fd-4e28-90ce-37e6dab2a5b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33132111-d7fd-4e28-90ce-37e6dab2a5b6', 'volume_size': 1} Jul 08 01:47:25 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5c215e4d-3a4f-4cff-9a1d-5e3c63c0fdd2 tempest-GroupSnapshotsV319Test-1019268315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:25 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-58c95860-3bfb-46f1-aacf-c1919e7a3fec tempest-GroupSnapshotsTest-1290797889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-fbd8ea42-95d7-440a-8d2a-193729481368" returned: 0 in 0.998s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:25 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-58c95860-3bfb-46f1-aacf-c1919e7a3fec tempest-GroupSnapshotsTest-1290797889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-fbd8ea42-95d7-440a-8d2a-193729481368 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:25 devstack sudo[94360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-fbd8ea42-95d7-440a-8d2a-193729481368 Jul 08 01:47:25 devstack sudo[94360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:26 devstack sudo[94349]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:26 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-27b10a8e-89b3-487b-bfd8-c6759d7b9229 tempest-SnapshotsActionsTest-1208726570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41e27e51-647a-4db5-a8d7-8e510c819658.1432a5c9-0a9f-46a6-a0b9-57de9ecf375e -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.98035b43-4c38-4b7d-bd0d-4861f9ab3aca" returned: 0 in 1.006s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:26 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-27b10a8e-89b3-487b-bfd8-c6759d7b9229 tempest-SnapshotsActionsTest-1208726570 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.98035b43-4c38-4b7d-bd0d-4861f9ab3aca is being set with open permissions: ugo+rw Jul 08 01:47:26 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-27b10a8e-89b3-487b-bfd8-c6759d7b9229 tempest-SnapshotsActionsTest-1208726570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.98035b43-4c38-4b7d-bd0d-4861f9ab3aca {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:26 devstack sudo[94362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.98035b43-4c38-4b7d-bd0d-4861f9ab3aca Jul 08 01:47:26 devstack sudo[94362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:26 devstack sudo[94360]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:26 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-58c95860-3bfb-46f1-aacf-c1919e7a3fec tempest-GroupSnapshotsTest-1290797889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-fbd8ea42-95d7-440a-8d2a-193729481368" returned: 0 in 0.692s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:26 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-58c95860-3bfb-46f1-aacf-c1919e7a3fec tempest-GroupSnapshotsTest-1290797889 None] Lock "cinder-quobyte-fbd8ea42-95d7-440a-8d2a-193729481368" released by "delete_volume" :: held 1.760s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:26 devstack sudo[94362]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:26 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-58c95860-3bfb-46f1-aacf-c1919e7a3fec tempest-GroupSnapshotsTest-1290797889 None] Created reservations ['84c1cb14-4ff2-4e2c-b361-38e10ee0a6ea'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:47:26 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-27b10a8e-89b3-487b-bfd8-c6759d7b9229 tempest-SnapshotsActionsTest-1208726570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.98035b43-4c38-4b7d-bd0d-4861f9ab3aca" returned: 0 in 0.690s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:26 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-27b10a8e-89b3-487b-bfd8-c6759d7b9229 tempest-SnapshotsActionsTest-1208726570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.863s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:26 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5c215e4d-3a4f-4cff-9a1d-5e3c63c0fdd2 tempest-GroupSnapshotsV319Test-1019268315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.859s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:26 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-5c215e4d-3a4f-4cff-9a1d-5e3c63c0fdd2 tempest-GroupSnapshotsV319Test-1019268315 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7b8dc42d-f038-444f-b7bc-3818b0ba526f,created_at=2026-07-07T23:47:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1918639842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7b8dc42d-f038-444f-b7bc-3818b0ba526f,host='devstack@QuobyteHD#QuobyteHD',id=33132111-d7fd-4e28-90ce-37e6dab2a5b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0680c181b6f84fc3ac282db271bbe525',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:47:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:47:26Z,use_quota=True,user_id='0f915cdcbf60422c9e28f9db30e27d41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(403d4910-7674-44a5-b29e-108f64f25a1b),volume_type_id=403d4910-7674-44a5-b29e-108f64f25a1b)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:47:26 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-5c215e4d-3a4f-4cff-9a1d-5e3c63c0fdd2 tempest-GroupSnapshotsV319Test-1019268315 None] Creating volume 33132111-d7fd-4e28-90ce-37e6dab2a5b6 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:47:26 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5c215e4d-3a4f-4cff-9a1d-5e3c63c0fdd2 tempest-GroupSnapshotsV319Test-1019268315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:26 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5c215e4d-3a4f-4cff-9a1d-5e3c63c0fdd2 tempest-GroupSnapshotsV319Test-1019268315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:26 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-5c215e4d-3a4f-4cff-9a1d-5e3c63c0fdd2 tempest-GroupSnapshotsV319Test-1019268315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:47:26 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-5c215e4d-3a4f-4cff-9a1d-5e3c63c0fdd2 tempest-GroupSnapshotsV319Test-1019268315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:47:26 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5c215e4d-3a4f-4cff-9a1d-5e3c63c0fdd2 tempest-GroupSnapshotsV319Test-1019268315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:26 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-5c215e4d-3a4f-4cff-9a1d-5e3c63c0fdd2 tempest-GroupSnapshotsV319Test-1019268315 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:47:26 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-5c215e4d-3a4f-4cff-9a1d-5e3c63c0fdd2 tempest-GroupSnapshotsV319Test-1019268315 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:47:26 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5c215e4d-3a4f-4cff-9a1d-5e3c63c0fdd2 tempest-GroupSnapshotsV319Test-1019268315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-33132111-d7fd-4e28-90ce-37e6dab2a5b6 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:26 devstack sudo[94366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-33132111-d7fd-4e28-90ce-37e6dab2a5b6 1073741824 Jul 08 01:47:26 devstack sudo[94366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:26 devstack cinder-volume[87134]: WARNING cinder.quota [None req-58c95860-3bfb-46f1-aacf-c1919e7a3fec tempest-GroupSnapshotsTest-1290797889 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1607158817 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1607158817, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:47:26 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-27b10a8e-89b3-487b-bfd8-c6759d7b9229 tempest-SnapshotsActionsTest-1208726570 None] Create snapshot completed successfully Jul 08 01:47:26 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-58c95860-3bfb-46f1-aacf-c1919e7a3fec tempest-GroupSnapshotsTest-1290797889 None] Created reservations ['72b39915-6fa2-4619-bf52-08733d8e2fee', '9e5f636b-f301-4555-8be8-249ea05c4b8e', '054a52d3-68d7-4069-a3b3-f9c6222f2bda', '47dafe76-5bb9-43fa-98fe-d603abf0395f'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:47:26 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-58c95860-3bfb-46f1-aacf-c1919e7a3fec tempest-GroupSnapshotsTest-1290797889 None] Created reservations ['1b233397-c0d2-49a7-819d-c248bbc8817a', '4a9d9b38-cb2a-4d32-ab2c-ab77b5a4dfc3', '5e867001-cb78-4fca-a2cb-c7883e3a4d5b', 'bf44cb46-7805-40ad-b11c-945dea37c91b'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:47:27 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-58c95860-3bfb-46f1-aacf-c1919e7a3fec tempest-GroupSnapshotsTest-1290797889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:27 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-58c95860-3bfb-46f1-aacf-c1919e7a3fec tempest-GroupSnapshotsTest-1290797889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:27 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-58c95860-3bfb-46f1-aacf-c1919e7a3fec tempest-GroupSnapshotsTest-1290797889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:47:27 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-58c95860-3bfb-46f1-aacf-c1919e7a3fec tempest-GroupSnapshotsTest-1290797889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:47:27 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-58c95860-3bfb-46f1-aacf-c1919e7a3fec tempest-GroupSnapshotsTest-1290797889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:27 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-58c95860-3bfb-46f1-aacf-c1919e7a3fec tempest-GroupSnapshotsTest-1290797889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:27 devstack sudo[94368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:47:27 devstack sudo[94368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:27 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-1593ab9b-4008-44e8-a9ad-0f41273d2edb tempest-SnapshotsActionsTest-973068087 None] Acquiring lock "cinder-98035b43-4c38-4b7d-bd0d-4861f9ab3aca-delete_snapshot" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:27 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-1593ab9b-4008-44e8-a9ad-0f41273d2edb tempest-SnapshotsActionsTest-973068087 None] Lock "cinder-98035b43-4c38-4b7d-bd0d-4861f9ab3aca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:27 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-1593ab9b-4008-44e8-a9ad-0f41273d2edb tempest-SnapshotsActionsTest-973068087 None] Acquiring lock "cinder-quobyte-41e27e51-647a-4db5-a8d7-8e510c819658" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:27 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-1593ab9b-4008-44e8-a9ad-0f41273d2edb tempest-SnapshotsActionsTest-973068087 None] Lock "cinder-quobyte-41e27e51-647a-4db5-a8d7-8e510c819658" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:27 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-1593ab9b-4008-44e8-a9ad-0f41273d2edb tempest-SnapshotsActionsTest-973068087 None] Acquiring lock "cinder-quobyte-98035b43-4c38-4b7d-bd0d-4861f9ab3aca" by "_delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:27 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-1593ab9b-4008-44e8-a9ad-0f41273d2edb tempest-SnapshotsActionsTest-973068087 None] Lock "cinder-quobyte-98035b43-4c38-4b7d-bd0d-4861f9ab3aca" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:27 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-1593ab9b-4008-44e8-a9ad-0f41273d2edb tempest-SnapshotsActionsTest-973068087 None] Deleting offline snapshot 98035b43-4c38-4b7d-bd0d-4861f9ab3aca of volume 41e27e51-647a-4db5-a8d7-8e510c819658 {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:47:27 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-1593ab9b-4008-44e8-a9ad-0f41273d2edb tempest-SnapshotsActionsTest-973068087 None] snapshot_file for this snap is: volume-41e27e51-647a-4db5-a8d7-8e510c819658.98035b43-4c38-4b7d-bd0d-4861f9ab3aca {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:47:27 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b89102-1ff0-4e0f-865f-8b5ed6e788a4]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:27 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1593ab9b-4008-44e8-a9ad-0f41273d2edb tempest-SnapshotsActionsTest-973068087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.98035b43-4c38-4b7d-bd0d-4861f9ab3aca {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:27 devstack sudo[94370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.98035b43-4c38-4b7d-bd0d-4861f9ab3aca Jul 08 01:47:27 devstack sudo[94370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:27 devstack sudo[94368]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:27 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-58c95860-3bfb-46f1-aacf-c1919e7a3fec tempest-GroupSnapshotsTest-1290797889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.742s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:27 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-58c95860-3bfb-46f1-aacf-c1919e7a3fec tempest-GroupSnapshotsTest-1290797889 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:47:27 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-58c95860-3bfb-46f1-aacf-c1919e7a3fec tempest-GroupSnapshotsTest-1290797889 None] Delete group completed successfully. Jul 08 01:47:27 devstack sudo[94366]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:27 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5c215e4d-3a4f-4cff-9a1d-5e3c63c0fdd2 tempest-GroupSnapshotsV319Test-1019268315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-33132111-d7fd-4e28-90ce-37e6dab2a5b6 1073741824" returned: 0 in 1.069s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:27 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5c215e4d-3a4f-4cff-9a1d-5e3c63c0fdd2 tempest-GroupSnapshotsV319Test-1019268315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-33132111-d7fd-4e28-90ce-37e6dab2a5b6 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:27 devstack sudo[94379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-33132111-d7fd-4e28-90ce-37e6dab2a5b6 Jul 08 01:47:27 devstack sudo[94379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:28 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-5d2a32c4-cd44-4f8b-b363-1a67c3be7390 tempest-GroupSnapshotsTest-1290797889 None] Group tempest-GroupSnapshotsTest-Group-1190014873: creating Jul 08 01:47:28 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-5d2a32c4-cd44-4f8b-b363-1a67c3be7390 tempest-GroupSnapshotsTest-1290797889 None] Group tempest-GroupSnapshotsTest-Group-1190014873: created successfully Jul 08 01:47:28 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-5d2a32c4-cd44-4f8b-b363-1a67c3be7390 tempest-GroupSnapshotsTest-1290797889 None] Create group completed successfully. Jul 08 01:47:28 devstack sudo[94370]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:28 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1593ab9b-4008-44e8-a9ad-0f41273d2edb tempest-SnapshotsActionsTest-973068087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.98035b43-4c38-4b7d-bd0d-4861f9ab3aca" returned: 0 in 1.138s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:28 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-1593ab9b-4008-44e8-a9ad-0f41273d2edb tempest-SnapshotsActionsTest-973068087 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41e27e51-647a-4db5-a8d7-8e510c819658(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:47:28 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0cd2ad-d72e-4554-af36-5ccf7a68e6ae]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:28 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1593ab9b-4008-44e8-a9ad-0f41273d2edb tempest-SnapshotsActionsTest-973068087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.1432a5c9-0a9f-46a6-a0b9-57de9ecf375e {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:28 devstack sudo[94385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.1432a5c9-0a9f-46a6-a0b9-57de9ecf375e Jul 08 01:47:28 devstack sudo[94385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:28 devstack sudo[94379]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:28 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5c215e4d-3a4f-4cff-9a1d-5e3c63c0fdd2 tempest-GroupSnapshotsV319Test-1019268315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-33132111-d7fd-4e28-90ce-37e6dab2a5b6" returned: 0 in 0.874s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:28 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-5c215e4d-3a4f-4cff-9a1d-5e3c63c0fdd2 tempest-GroupSnapshotsV319Test-1019268315 None] <== create_volume: return (1991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:47:28 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5c215e4d-3a4f-4cff-9a1d-5e3c63c0fdd2 tempest-GroupSnapshotsV319Test-1019268315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.994s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:28 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5c215e4d-3a4f-4cff-9a1d-5e3c63c0fdd2 tempest-GroupSnapshotsV319Test-1019268315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cd40d29-4713-45c9-854c-af810be6a328) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33132111-d7fd-4e28-90ce-37e6dab2a5b6', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:28 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5c215e4d-3a4f-4cff-9a1d-5e3c63c0fdd2 tempest-GroupSnapshotsV319Test-1019268315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa8b7123-0bdd-4857-9825-08c5b56e22ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:28 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-5c215e4d-3a4f-4cff-9a1d-5e3c63c0fdd2 tempest-GroupSnapshotsV319Test-1019268315 None] Volume volume-33132111-d7fd-4e28-90ce-37e6dab2a5b6 (33132111-d7fd-4e28-90ce-37e6dab2a5b6): created successfully Jul 08 01:47:28 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5c215e4d-3a4f-4cff-9a1d-5e3c63c0fdd2 tempest-GroupSnapshotsV319Test-1019268315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa8b7123-0bdd-4857-9825-08c5b56e22ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:28 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5c215e4d-3a4f-4cff-9a1d-5e3c63c0fdd2 tempest-GroupSnapshotsV319Test-1019268315 None] Flow 'volume_create_manager' (77fdf590-52a1-4518-9b3f-dca969efc528) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:47:28 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-5c215e4d-3a4f-4cff-9a1d-5e3c63c0fdd2 tempest-GroupSnapshotsV319Test-1019268315 None] Created volume successfully. Jul 08 01:47:29 devstack sudo[94385]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1593ab9b-4008-44e8-a9ad-0f41273d2edb tempest-SnapshotsActionsTest-973068087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.1432a5c9-0a9f-46a6-a0b9-57de9ecf375e" returned: 0 in 0.753s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:29 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-1593ab9b-4008-44e8-a9ad-0f41273d2edb tempest-SnapshotsActionsTest-973068087 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41e27e51-647a-4db5-a8d7-8e510c819658(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:47:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1593ab9b-4008-44e8-a9ad-0f41273d2edb tempest-SnapshotsActionsTest-973068087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.98035b43-4c38-4b7d-bd0d-4861f9ab3aca {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:29 devstack sudo[94410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.98035b43-4c38-4b7d-bd0d-4861f9ab3aca Jul 08 01:47:29 devstack sudo[94410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:29 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-04c6b67e-c12a-4016-ba5f-10d6f5d5ee50 tempest-GroupSnapshotsV319Test-1019268315 None] GroupSnapshot ddd82ba6-c4b8-447d-98e7-e3bda052edf6: creating. Jul 08 01:47:29 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-04c6b67e-c12a-4016-ba5f-10d6f5d5ee50 tempest-GroupSnapshotsV319Test-1019268315 None] Group snapshot ddd82ba6-c4b8-447d-98e7-e3bda052edf6: creating. {{(pid=87134) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 08 01:47:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-04c6b67e-c12a-4016-ba5f-10d6f5d5ee50 tempest-GroupSnapshotsV319Test-1019268315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-04c6b67e-c12a-4016-ba5f-10d6f5d5ee50 tempest-GroupSnapshotsV319Test-1019268315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:30 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-04c6b67e-c12a-4016-ba5f-10d6f5d5ee50 tempest-GroupSnapshotsV319Test-1019268315 None] Creating offline snapshot 1ad1d15a-222f-447e-af25-5d90dd2a36fb of volume 33132111-d7fd-4e28-90ce-37e6dab2a5b6 {{(pid=87134) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:47:30 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[864c1194-7190-4f6f-82f5-11beb1f79c67]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-04c6b67e-c12a-4016-ba5f-10d6f5d5ee50 tempest-GroupSnapshotsV319Test-1019268315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-33132111-d7fd-4e28-90ce-37e6dab2a5b6 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:30 devstack sudo[94431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-33132111-d7fd-4e28-90ce-37e6dab2a5b6 Jul 08 01:47:30 devstack sudo[94431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:30 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-581963f6-ba6a-4f91-bccd-cb90ced3320d tempest-GroupSnapshotsTest-1290797889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:47:30 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-581963f6-ba6a-4f91-bccd-cb90ced3320d tempest-GroupSnapshotsTest-1290797889 None] Flow 'volume_create_manager' (6c5972f3-3937-4860-9eca-cc32560044dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:47:30 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-581963f6-ba6a-4f91-bccd-cb90ced3320d tempest-GroupSnapshotsTest-1290797889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (279be296-bc74-41c6-bddc-27368c0fd000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:30 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-581963f6-ba6a-4f91-bccd-cb90ced3320d tempest-GroupSnapshotsTest-1290797889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (279be296-bc74-41c6-bddc-27368c0fd000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:47:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-757180225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=84fb7103-70aa-4720-a222-98c12f8688d4,host='devstack@QuobyteHD#QuobyteHD',id=ab6656d4-c1c8-4a79-a925-5975d322b77e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97c67429d4724bfc8f5a6fe449493946',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:47:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:47:30Z,use_quota=True,user_id='48d3a3ec668e45d9868f061cc6e1f0c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(350f70ef-1469-4f5a-9c68-cdbc5e93d4d8),volume_type_id=350f70ef-1469-4f5a-9c68-cdbc5e93d4d8)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:30 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-581963f6-ba6a-4f91-bccd-cb90ced3320d tempest-GroupSnapshotsTest-1290797889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be8ea950-1a9b-45e3-8bab-542c041bff1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:30 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-581963f6-ba6a-4f91-bccd-cb90ced3320d tempest-GroupSnapshotsTest-1290797889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be8ea950-1a9b-45e3-8bab-542c041bff1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:30 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-581963f6-ba6a-4f91-bccd-cb90ced3320d tempest-GroupSnapshotsTest-1290797889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b82cddae-5cc7-4d07-95de-6ae37b68b1f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:30 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-581963f6-ba6a-4f91-bccd-cb90ced3320d tempest-GroupSnapshotsTest-1290797889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b82cddae-5cc7-4d07-95de-6ae37b68b1f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab6656d4-c1c8-4a79-a925-5975d322b77e', 'volume_name': 'volume-ab6656d4-c1c8-4a79-a925-5975d322b77e', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:30 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-581963f6-ba6a-4f91-bccd-cb90ced3320d tempest-GroupSnapshotsTest-1290797889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd780fbc-8fec-4861-9b8a-073d006b3848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:30 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-581963f6-ba6a-4f91-bccd-cb90ced3320d tempest-GroupSnapshotsTest-1290797889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd780fbc-8fec-4861-9b8a-073d006b3848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:30 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-581963f6-ba6a-4f91-bccd-cb90ced3320d tempest-GroupSnapshotsTest-1290797889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0db5c031-e09c-4d89-a0f8-9dd2242bc5a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:30 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-581963f6-ba6a-4f91-bccd-cb90ced3320d tempest-GroupSnapshotsTest-1290797889 None] Volume ab6656d4-c1c8-4a79-a925-5975d322b77e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab6656d4-c1c8-4a79-a925-5975d322b77e', 'volume_size': 1} Jul 08 01:47:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-581963f6-ba6a-4f91-bccd-cb90ced3320d tempest-GroupSnapshotsTest-1290797889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:30 devstack sudo[94410]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1593ab9b-4008-44e8-a9ad-0f41273d2edb tempest-SnapshotsActionsTest-973068087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.98035b43-4c38-4b7d-bd0d-4861f9ab3aca" returned: 0 in 1.253s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1593ab9b-4008-44e8-a9ad-0f41273d2edb tempest-SnapshotsActionsTest-973068087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.98035b43-4c38-4b7d-bd0d-4861f9ab3aca {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:30 devstack sudo[94442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.98035b43-4c38-4b7d-bd0d-4861f9ab3aca Jul 08 01:47:30 devstack sudo[94442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:31 devstack sudo[94431]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-04c6b67e-c12a-4016-ba5f-10d6f5d5ee50 tempest-GroupSnapshotsV319Test-1019268315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-33132111-d7fd-4e28-90ce-37e6dab2a5b6" returned: 0 in 1.028s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-04c6b67e-c12a-4016-ba5f-10d6f5d5ee50 tempest-GroupSnapshotsV319Test-1019268315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-33132111-d7fd-4e28-90ce-37e6dab2a5b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-33132111-d7fd-4e28-90ce-37e6dab2a5b6.1ad1d15a-222f-447e-af25-5d90dd2a36fb 1G {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:31 devstack sudo[94448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-33132111-d7fd-4e28-90ce-37e6dab2a5b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-33132111-d7fd-4e28-90ce-37e6dab2a5b6.1ad1d15a-222f-447e-af25-5d90dd2a36fb 1G Jul 08 01:47:31 devstack sudo[94448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:31 devstack sudo[94442]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1593ab9b-4008-44e8-a9ad-0f41273d2edb tempest-SnapshotsActionsTest-973068087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.98035b43-4c38-4b7d-bd0d-4861f9ab3aca" returned: 0 in 0.834s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:31 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-1593ab9b-4008-44e8-a9ad-0f41273d2edb tempest-SnapshotsActionsTest-973068087 None] Lock "cinder-quobyte-98035b43-4c38-4b7d-bd0d-4861f9ab3aca" released by "_delete_snapshot" :: held 4.108s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:31 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-1593ab9b-4008-44e8-a9ad-0f41273d2edb tempest-SnapshotsActionsTest-973068087 None] Lock "cinder-quobyte-41e27e51-647a-4db5-a8d7-8e510c819658" released by "delete_snapshot" :: held 4.133s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:31 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-1593ab9b-4008-44e8-a9ad-0f41273d2edb tempest-SnapshotsActionsTest-973068087 None] Created reservations ['cb776232-4d20-42a2-bbde-bbb0b4c9163a', '8772234a-f475-4196-9652-edde7a39ebfb', 'a886cdcc-cc42-4eb8-8eee-f83f140d5cc0', 'f8f910cd-9e79-4166-aa63-7fa0338309ad'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:47:31 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-1593ab9b-4008-44e8-a9ad-0f41273d2edb tempest-SnapshotsActionsTest-973068087 None] Delete snapshot completed successfully. Jul 08 01:47:31 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-1593ab9b-4008-44e8-a9ad-0f41273d2edb tempest-SnapshotsActionsTest-973068087 None] Lock "cinder-98035b43-4c38-4b7d-bd0d-4861f9ab3aca-delete_snapshot" released by "delete_snapshot" :: held 4.385s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:32 devstack sudo[94448]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-04c6b67e-c12a-4016-ba5f-10d6f5d5ee50 tempest-GroupSnapshotsV319Test-1019268315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-33132111-d7fd-4e28-90ce-37e6dab2a5b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-33132111-d7fd-4e28-90ce-37e6dab2a5b6.1ad1d15a-222f-447e-af25-5d90dd2a36fb 1G" returned: 0 in 1.025s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-04c6b67e-c12a-4016-ba5f-10d6f5d5ee50 tempest-GroupSnapshotsV319Test-1019268315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33132111-d7fd-4e28-90ce-37e6dab2a5b6 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-33132111-d7fd-4e28-90ce-37e6dab2a5b6.1ad1d15a-222f-447e-af25-5d90dd2a36fb {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:32 devstack sudo[94457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33132111-d7fd-4e28-90ce-37e6dab2a5b6 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-33132111-d7fd-4e28-90ce-37e6dab2a5b6.1ad1d15a-222f-447e-af25-5d90dd2a36fb Jul 08 01:47:32 devstack sudo[94457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:32 devstack sudo[94457]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-04c6b67e-c12a-4016-ba5f-10d6f5d5ee50 tempest-GroupSnapshotsV319Test-1019268315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33132111-d7fd-4e28-90ce-37e6dab2a5b6 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-33132111-d7fd-4e28-90ce-37e6dab2a5b6.1ad1d15a-222f-447e-af25-5d90dd2a36fb" returned: 0 in 0.796s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:32 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-04c6b67e-c12a-4016-ba5f-10d6f5d5ee50 tempest-GroupSnapshotsV319Test-1019268315 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-33132111-d7fd-4e28-90ce-37e6dab2a5b6.1ad1d15a-222f-447e-af25-5d90dd2a36fb is being set with open permissions: ugo+rw: NotImplementedError Jul 08 01:47:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-04c6b67e-c12a-4016-ba5f-10d6f5d5ee50 tempest-GroupSnapshotsV319Test-1019268315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-33132111-d7fd-4e28-90ce-37e6dab2a5b6.1ad1d15a-222f-447e-af25-5d90dd2a36fb {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:32 devstack sudo[94464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-33132111-d7fd-4e28-90ce-37e6dab2a5b6.1ad1d15a-222f-447e-af25-5d90dd2a36fb Jul 08 01:47:32 devstack sudo[94464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:33 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-cfd33482-3e71-494f-adfa-1f6327a9791b tempest-SnapshotsActionsTest-1208726570 None] Acquiring lock "cinder-1432a5c9-0a9f-46a6-a0b9-57de9ecf375e-delete_snapshot" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:33 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-cfd33482-3e71-494f-adfa-1f6327a9791b tempest-SnapshotsActionsTest-1208726570 None] Lock "cinder-1432a5c9-0a9f-46a6-a0b9-57de9ecf375e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:33 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-cfd33482-3e71-494f-adfa-1f6327a9791b tempest-SnapshotsActionsTest-1208726570 None] Acquiring lock "cinder-quobyte-41e27e51-647a-4db5-a8d7-8e510c819658" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:33 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-cfd33482-3e71-494f-adfa-1f6327a9791b tempest-SnapshotsActionsTest-1208726570 None] Lock "cinder-quobyte-41e27e51-647a-4db5-a8d7-8e510c819658" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:33 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-cfd33482-3e71-494f-adfa-1f6327a9791b tempest-SnapshotsActionsTest-1208726570 None] Acquiring lock "cinder-quobyte-1432a5c9-0a9f-46a6-a0b9-57de9ecf375e" by "_delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:33 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-cfd33482-3e71-494f-adfa-1f6327a9791b tempest-SnapshotsActionsTest-1208726570 None] Lock "cinder-quobyte-1432a5c9-0a9f-46a6-a0b9-57de9ecf375e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:33 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-cfd33482-3e71-494f-adfa-1f6327a9791b tempest-SnapshotsActionsTest-1208726570 None] Deleting offline snapshot 1432a5c9-0a9f-46a6-a0b9-57de9ecf375e of volume 41e27e51-647a-4db5-a8d7-8e510c819658 {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:47:33 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-cfd33482-3e71-494f-adfa-1f6327a9791b tempest-SnapshotsActionsTest-1208726570 None] snapshot_file for this snap is: volume-41e27e51-647a-4db5-a8d7-8e510c819658.1432a5c9-0a9f-46a6-a0b9-57de9ecf375e {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:47:33 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c2bd0f-de10-42cb-b57d-d0226802a269]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-cfd33482-3e71-494f-adfa-1f6327a9791b tempest-SnapshotsActionsTest-1208726570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.1432a5c9-0a9f-46a6-a0b9-57de9ecf375e {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:33 devstack sudo[94466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.1432a5c9-0a9f-46a6-a0b9-57de9ecf375e Jul 08 01:47:33 devstack sudo[94466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:33 devstack sudo[94464]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-04c6b67e-c12a-4016-ba5f-10d6f5d5ee50 tempest-GroupSnapshotsV319Test-1019268315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-33132111-d7fd-4e28-90ce-37e6dab2a5b6.1ad1d15a-222f-447e-af25-5d90dd2a36fb" returned: 0 in 0.750s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-04c6b67e-c12a-4016-ba5f-10d6f5d5ee50 tempest-GroupSnapshotsV319Test-1019268315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-33132111-d7fd-4e28-90ce-37e6dab2a5b6.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:33 devstack sudo[94469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-33132111-d7fd-4e28-90ce-37e6dab2a5b6.info Jul 08 01:47:33 devstack sudo[94469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:34 devstack sudo[94466]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-cfd33482-3e71-494f-adfa-1f6327a9791b tempest-SnapshotsActionsTest-1208726570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.1432a5c9-0a9f-46a6-a0b9-57de9ecf375e" returned: 0 in 0.850s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:34 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-cfd33482-3e71-494f-adfa-1f6327a9791b tempest-SnapshotsActionsTest-1208726570 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41e27e51-647a-4db5-a8d7-8e510c819658(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:47:34 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a07865-a826-4d74-b89a-afe855ae19a6]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-cfd33482-3e71-494f-adfa-1f6327a9791b tempest-SnapshotsActionsTest-1208726570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:34 devstack sudo[94474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658 Jul 08 01:47:34 devstack sudo[94474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:34 devstack sudo[94469]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-04c6b67e-c12a-4016-ba5f-10d6f5d5ee50 tempest-GroupSnapshotsV319Test-1019268315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-33132111-d7fd-4e28-90ce-37e6dab2a5b6.info" returned: 0 in 0.706s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:34 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-04c6b67e-c12a-4016-ba5f-10d6f5d5ee50 tempest-GroupSnapshotsV319Test-1019268315 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-33132111-d7fd-4e28-90ce-37e6dab2a5b6.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 01:47:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-04c6b67e-c12a-4016-ba5f-10d6f5d5ee50 tempest-GroupSnapshotsV319Test-1019268315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-33132111-d7fd-4e28-90ce-37e6dab2a5b6.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:34 devstack sudo[94477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-33132111-d7fd-4e28-90ce-37e6dab2a5b6.info Jul 08 01:47:34 devstack sudo[94477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:34 devstack sudo[94474]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-cfd33482-3e71-494f-adfa-1f6327a9791b tempest-SnapshotsActionsTest-1208726570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658" returned: 0 in 0.842s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-cfd33482-3e71-494f-adfa-1f6327a9791b tempest-SnapshotsActionsTest-1208726570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.1432a5c9-0a9f-46a6-a0b9-57de9ecf375e {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:34 devstack sudo[94482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.1432a5c9-0a9f-46a6-a0b9-57de9ecf375e Jul 08 01:47:34 devstack sudo[94482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:35 devstack sudo[94477]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-04c6b67e-c12a-4016-ba5f-10d6f5d5ee50 tempest-GroupSnapshotsV319Test-1019268315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-33132111-d7fd-4e28-90ce-37e6dab2a5b6.info" returned: 0 in 0.671s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-04c6b67e-c12a-4016-ba5f-10d6f5d5ee50 tempest-GroupSnapshotsV319Test-1019268315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.109s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-581963f6-ba6a-4f91-bccd-cb90ced3320d tempest-GroupSnapshotsTest-1290797889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.669s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:35 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-581963f6-ba6a-4f91-bccd-cb90ced3320d tempest-GroupSnapshotsTest-1290797889 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=84fb7103-70aa-4720-a222-98c12f8688d4,created_at=2026-07-07T23:47:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-757180225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=84fb7103-70aa-4720-a222-98c12f8688d4,host='devstack@QuobyteHD#QuobyteHD',id=ab6656d4-c1c8-4a79-a925-5975d322b77e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97c67429d4724bfc8f5a6fe449493946',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:47:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:47:30Z,use_quota=True,user_id='48d3a3ec668e45d9868f061cc6e1f0c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(350f70ef-1469-4f5a-9c68-cdbc5e93d4d8),volume_type_id=350f70ef-1469-4f5a-9c68-cdbc5e93d4d8)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:47:35 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-581963f6-ba6a-4f91-bccd-cb90ced3320d tempest-GroupSnapshotsTest-1290797889 None] Creating volume ab6656d4-c1c8-4a79-a925-5975d322b77e {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:47:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-581963f6-ba6a-4f91-bccd-cb90ced3320d tempest-GroupSnapshotsTest-1290797889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-581963f6-ba6a-4f91-bccd-cb90ced3320d tempest-GroupSnapshotsTest-1290797889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:35 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-581963f6-ba6a-4f91-bccd-cb90ced3320d tempest-GroupSnapshotsTest-1290797889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:47:35 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-581963f6-ba6a-4f91-bccd-cb90ced3320d tempest-GroupSnapshotsTest-1290797889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:47:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-581963f6-ba6a-4f91-bccd-cb90ced3320d tempest-GroupSnapshotsTest-1290797889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:35 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-581963f6-ba6a-4f91-bccd-cb90ced3320d tempest-GroupSnapshotsTest-1290797889 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:47:35 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-581963f6-ba6a-4f91-bccd-cb90ced3320d tempest-GroupSnapshotsTest-1290797889 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:47:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-581963f6-ba6a-4f91-bccd-cb90ced3320d tempest-GroupSnapshotsTest-1290797889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ab6656d4-c1c8-4a79-a925-5975d322b77e 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:35 devstack sudo[94485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ab6656d4-c1c8-4a79-a925-5975d322b77e 1073741824 Jul 08 01:47:35 devstack sudo[94485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:35 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-04c6b67e-c12a-4016-ba5f-10d6f5d5ee50 tempest-GroupSnapshotsV319Test-1019268315 None] group_snapshot ddd82ba6-c4b8-447d-98e7-e3bda052edf6: created successfully Jul 08 01:47:35 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-38a1a718-20e8-422a-8219-058b5b178b40 tempest-GroupSnapshotsV319Test-1019268315 None] group_snapshot ddd82ba6-c4b8-447d-98e7-e3bda052edf6: deleting Jul 08 01:47:35 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-38a1a718-20e8-422a-8219-058b5b178b40 tempest-GroupSnapshotsV319Test-1019268315 None] group_snapshot ddd82ba6-c4b8-447d-98e7-e3bda052edf6: deleting {{(pid=87134) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 08 01:47:35 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-38a1a718-20e8-422a-8219-058b5b178b40 tempest-GroupSnapshotsV319Test-1019268315 None] Acquiring lock "cinder-quobyte-33132111-d7fd-4e28-90ce-37e6dab2a5b6" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:35 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-38a1a718-20e8-422a-8219-058b5b178b40 tempest-GroupSnapshotsV319Test-1019268315 None] Lock "cinder-quobyte-33132111-d7fd-4e28-90ce-37e6dab2a5b6" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:35 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-38a1a718-20e8-422a-8219-058b5b178b40 tempest-GroupSnapshotsV319Test-1019268315 None] Acquiring lock "cinder-quobyte-1ad1d15a-222f-447e-af25-5d90dd2a36fb" by "_delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:35 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-38a1a718-20e8-422a-8219-058b5b178b40 tempest-GroupSnapshotsV319Test-1019268315 None] Lock "cinder-quobyte-1ad1d15a-222f-447e-af25-5d90dd2a36fb" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:35 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-38a1a718-20e8-422a-8219-058b5b178b40 tempest-GroupSnapshotsV319Test-1019268315 None] Deleting offline snapshot 1ad1d15a-222f-447e-af25-5d90dd2a36fb of volume 33132111-d7fd-4e28-90ce-37e6dab2a5b6 {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:47:35 devstack sudo[94482]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:35 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-38a1a718-20e8-422a-8219-058b5b178b40 tempest-GroupSnapshotsV319Test-1019268315 None] snapshot_file for this snap is: volume-33132111-d7fd-4e28-90ce-37e6dab2a5b6.1ad1d15a-222f-447e-af25-5d90dd2a36fb {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:47:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-cfd33482-3e71-494f-adfa-1f6327a9791b tempest-SnapshotsActionsTest-1208726570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.1432a5c9-0a9f-46a6-a0b9-57de9ecf375e" returned: 0 in 0.959s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-cfd33482-3e71-494f-adfa-1f6327a9791b tempest-SnapshotsActionsTest-1208726570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.1432a5c9-0a9f-46a6-a0b9-57de9ecf375e {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:35 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b859e7-88f8-4a1d-9c08-53698d952662]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-38a1a718-20e8-422a-8219-058b5b178b40 tempest-GroupSnapshotsV319Test-1019268315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-33132111-d7fd-4e28-90ce-37e6dab2a5b6.1ad1d15a-222f-447e-af25-5d90dd2a36fb {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:35 devstack sudo[94493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.1432a5c9-0a9f-46a6-a0b9-57de9ecf375e Jul 08 01:47:35 devstack sudo[94493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:36 devstack sudo[94494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-33132111-d7fd-4e28-90ce-37e6dab2a5b6.1ad1d15a-222f-447e-af25-5d90dd2a36fb Jul 08 01:47:36 devstack sudo[94494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:36 devstack sudo[94485]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-581963f6-ba6a-4f91-bccd-cb90ced3320d tempest-GroupSnapshotsTest-1290797889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ab6656d4-c1c8-4a79-a925-5975d322b77e 1073741824" returned: 0 in 1.134s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-581963f6-ba6a-4f91-bccd-cb90ced3320d tempest-GroupSnapshotsTest-1290797889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ab6656d4-c1c8-4a79-a925-5975d322b77e {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:36 devstack sudo[94498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ab6656d4-c1c8-4a79-a925-5975d322b77e Jul 08 01:47:36 devstack sudo[94498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:36 devstack sudo[94493]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-cfd33482-3e71-494f-adfa-1f6327a9791b tempest-SnapshotsActionsTest-1208726570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658.1432a5c9-0a9f-46a6-a0b9-57de9ecf375e" returned: 0 in 0.856s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:36 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-cfd33482-3e71-494f-adfa-1f6327a9791b tempest-SnapshotsActionsTest-1208726570 None] Lock "cinder-quobyte-1432a5c9-0a9f-46a6-a0b9-57de9ecf375e" released by "_delete_snapshot" :: held 3.650s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:36 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-cfd33482-3e71-494f-adfa-1f6327a9791b tempest-SnapshotsActionsTest-1208726570 None] Lock "cinder-quobyte-41e27e51-647a-4db5-a8d7-8e510c819658" released by "delete_snapshot" :: held 3.677s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:36 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-cfd33482-3e71-494f-adfa-1f6327a9791b tempest-SnapshotsActionsTest-1208726570 None] Created reservations ['f6da4a69-8996-4db5-830f-849bc462724d', 'a71a6505-e79f-41b8-bc58-d638d6b593b2', '9b8afd56-797e-4ab2-a56b-a8fa9c4ed4a2', '22464417-7998-466d-b5ad-3cf7eef06a12'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:47:36 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-cfd33482-3e71-494f-adfa-1f6327a9791b tempest-SnapshotsActionsTest-1208726570 None] Delete snapshot completed successfully. Jul 08 01:47:36 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-cfd33482-3e71-494f-adfa-1f6327a9791b tempest-SnapshotsActionsTest-1208726570 None] Lock "cinder-1432a5c9-0a9f-46a6-a0b9-57de9ecf375e-delete_snapshot" released by "delete_snapshot" :: held 3.862s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:37 devstack sudo[94494]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-38a1a718-20e8-422a-8219-058b5b178b40 tempest-GroupSnapshotsV319Test-1019268315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-33132111-d7fd-4e28-90ce-37e6dab2a5b6.1ad1d15a-222f-447e-af25-5d90dd2a36fb" returned: 0 in 1.102s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:37 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-38a1a718-20e8-422a-8219-058b5b178b40 tempest-GroupSnapshotsV319Test-1019268315 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33132111-d7fd-4e28-90ce-37e6dab2a5b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:47:37 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ad1dc6-eb29-45e8-9d4d-c5acd785adf2]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-38a1a718-20e8-422a-8219-058b5b178b40 tempest-GroupSnapshotsV319Test-1019268315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-33132111-d7fd-4e28-90ce-37e6dab2a5b6 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:37 devstack sudo[94498]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-581963f6-ba6a-4f91-bccd-cb90ced3320d tempest-GroupSnapshotsTest-1290797889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ab6656d4-c1c8-4a79-a925-5975d322b77e" returned: 0 in 0.787s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:37 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-581963f6-ba6a-4f91-bccd-cb90ced3320d tempest-GroupSnapshotsTest-1290797889 None] <== create_volume: return (2004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:47:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-581963f6-ba6a-4f91-bccd-cb90ced3320d tempest-GroupSnapshotsTest-1290797889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.007s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:37 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-581963f6-ba6a-4f91-bccd-cb90ced3320d tempest-GroupSnapshotsTest-1290797889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0db5c031-e09c-4d89-a0f8-9dd2242bc5a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab6656d4-c1c8-4a79-a925-5975d322b77e', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:37 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-581963f6-ba6a-4f91-bccd-cb90ced3320d tempest-GroupSnapshotsTest-1290797889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3beeae89-3850-457b-a8c1-f09a53da71ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:37 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-581963f6-ba6a-4f91-bccd-cb90ced3320d tempest-GroupSnapshotsTest-1290797889 None] Volume volume-ab6656d4-c1c8-4a79-a925-5975d322b77e (ab6656d4-c1c8-4a79-a925-5975d322b77e): created successfully Jul 08 01:47:37 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-581963f6-ba6a-4f91-bccd-cb90ced3320d tempest-GroupSnapshotsTest-1290797889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3beeae89-3850-457b-a8c1-f09a53da71ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:37 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-581963f6-ba6a-4f91-bccd-cb90ced3320d tempest-GroupSnapshotsTest-1290797889 None] Flow 'volume_create_manager' (6c5972f3-3937-4860-9eca-cc32560044dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:47:37 devstack sudo[94505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-33132111-d7fd-4e28-90ce-37e6dab2a5b6 Jul 08 01:47:37 devstack sudo[94505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:37 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-581963f6-ba6a-4f91-bccd-cb90ced3320d tempest-GroupSnapshotsTest-1290797889 None] Created volume successfully. Jul 08 01:47:37 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a0a54fca-68e3-491f-bc59-6c560f33657e tempest-SnapshotsActionsTest-1208726570 None] Acquiring lock "cinder-41e27e51-647a-4db5-a8d7-8e510c819658-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:37 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a0a54fca-68e3-491f-bc59-6c560f33657e tempest-SnapshotsActionsTest-1208726570 None] Lock "cinder-41e27e51-647a-4db5-a8d7-8e510c819658-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:37 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a0a54fca-68e3-491f-bc59-6c560f33657e tempest-SnapshotsActionsTest-1208726570 None] Acquiring lock "cinder-quobyte-41e27e51-647a-4db5-a8d7-8e510c819658" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:37 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a0a54fca-68e3-491f-bc59-6c560f33657e tempest-SnapshotsActionsTest-1208726570 None] Lock "cinder-quobyte-41e27e51-647a-4db5-a8d7-8e510c819658" acquired by "delete_volume" :: waited 0.016s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:37 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[825de0a1-f8e2-4927-9444-2f6213d806fe]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a0a54fca-68e3-491f-bc59-6c560f33657e tempest-SnapshotsActionsTest-1208726570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:37 devstack sudo[94508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658 Jul 08 01:47:37 devstack sudo[94508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:37 devstack sudo[94505]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-38a1a718-20e8-422a-8219-058b5b178b40 tempest-GroupSnapshotsV319Test-1019268315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-33132111-d7fd-4e28-90ce-37e6dab2a5b6" returned: 0 in 0.876s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-38a1a718-20e8-422a-8219-058b5b178b40 tempest-GroupSnapshotsV319Test-1019268315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-33132111-d7fd-4e28-90ce-37e6dab2a5b6.1ad1d15a-222f-447e-af25-5d90dd2a36fb {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:37 devstack sudo[94513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-33132111-d7fd-4e28-90ce-37e6dab2a5b6.1ad1d15a-222f-447e-af25-5d90dd2a36fb Jul 08 01:47:37 devstack sudo[94513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:37 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-b1a1f26c-3456-494a-8369-340efebc3a9c tempest-GroupSnapshotsTest-1290797889 None] GroupSnapshot e90942b5-9117-4b25-b0b4-4ed36123199c: creating. Jul 08 01:47:38 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b1a1f26c-3456-494a-8369-340efebc3a9c tempest-GroupSnapshotsTest-1290797889 None] Group snapshot e90942b5-9117-4b25-b0b4-4ed36123199c: creating. {{(pid=87134) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 08 01:47:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b1a1f26c-3456-494a-8369-340efebc3a9c tempest-GroupSnapshotsTest-1290797889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b1a1f26c-3456-494a-8369-340efebc3a9c tempest-GroupSnapshotsTest-1290797889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:38 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-b1a1f26c-3456-494a-8369-340efebc3a9c tempest-GroupSnapshotsTest-1290797889 None] Creating offline snapshot 914f1968-112b-4994-9053-fa076c05198e of volume ab6656d4-c1c8-4a79-a925-5975d322b77e {{(pid=87134) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:47:38 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[22fb2d22-b579-45b3-bbcc-066e9a6c7faf]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b1a1f26c-3456-494a-8369-340efebc3a9c tempest-GroupSnapshotsTest-1290797889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ab6656d4-c1c8-4a79-a925-5975d322b77e {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:38 devstack sudo[94515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ab6656d4-c1c8-4a79-a925-5975d322b77e Jul 08 01:47:38 devstack sudo[94515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:38 devstack sudo[94508]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a0a54fca-68e3-491f-bc59-6c560f33657e tempest-SnapshotsActionsTest-1208726570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658" returned: 0 in 0.896s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a0a54fca-68e3-491f-bc59-6c560f33657e tempest-SnapshotsActionsTest-1208726570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:38 devstack sudo[94521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658 Jul 08 01:47:38 devstack sudo[94521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:38 devstack cinder-volume[87134]: INFO cinder.volume.manager [req-b5d06f52-f270-475c-92b8-13efa6bff0cf req-1100c910-23c9-492e-b42c-d04f7366f8c4 tempest-AttachVolumeNegativeTest-677114920 None] Terminate volume connection completed successfully. Jul 08 01:47:38 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [req-b5d06f52-f270-475c-92b8-13efa6bff0cf req-1100c910-23c9-492e-b42c-d04f7366f8c4 tempest-AttachVolumeNegativeTest-677114920 None] Deleting attachment dd0064f0-f031-469b-ac0d-01e97d901e64. {{(pid=87134) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:47:38 devstack sudo[94513]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-38a1a718-20e8-422a-8219-058b5b178b40 tempest-GroupSnapshotsV319Test-1019268315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-33132111-d7fd-4e28-90ce-37e6dab2a5b6.1ad1d15a-222f-447e-af25-5d90dd2a36fb" returned: 0 in 0.846s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-38a1a718-20e8-422a-8219-058b5b178b40 tempest-GroupSnapshotsV319Test-1019268315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-33132111-d7fd-4e28-90ce-37e6dab2a5b6.1ad1d15a-222f-447e-af25-5d90dd2a36fb {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:38 devstack sudo[94530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-33132111-d7fd-4e28-90ce-37e6dab2a5b6.1ad1d15a-222f-447e-af25-5d90dd2a36fb Jul 08 01:47:38 devstack sudo[94530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:39 devstack sudo[94515]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b1a1f26c-3456-494a-8369-340efebc3a9c tempest-GroupSnapshotsTest-1290797889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ab6656d4-c1c8-4a79-a925-5975d322b77e" returned: 0 in 0.966s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b1a1f26c-3456-494a-8369-340efebc3a9c tempest-GroupSnapshotsTest-1290797889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ab6656d4-c1c8-4a79-a925-5975d322b77e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ab6656d4-c1c8-4a79-a925-5975d322b77e.914f1968-112b-4994-9053-fa076c05198e 1G {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:39 devstack sudo[94535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ab6656d4-c1c8-4a79-a925-5975d322b77e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ab6656d4-c1c8-4a79-a925-5975d322b77e.914f1968-112b-4994-9053-fa076c05198e 1G Jul 08 01:47:39 devstack sudo[94535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:39 devstack sudo[94521]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a0a54fca-68e3-491f-bc59-6c560f33657e tempest-SnapshotsActionsTest-1208726570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41e27e51-647a-4db5-a8d7-8e510c819658" returned: 0 in 0.716s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:39 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a0a54fca-68e3-491f-bc59-6c560f33657e tempest-SnapshotsActionsTest-1208726570 None] Lock "cinder-quobyte-41e27e51-647a-4db5-a8d7-8e510c819658" released by "delete_volume" :: held 1.682s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:39 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-a0a54fca-68e3-491f-bc59-6c560f33657e tempest-SnapshotsActionsTest-1208726570 None] Created reservations ['868ae764-ec93-4c5f-a096-0936d9b1b42b', 'ad05c2f8-e230-425c-a6f1-3affbb8e2bb4', 'bd9051ac-46a9-4445-b281-23b65310bb52', '71d59a70-b6ac-4749-b184-d531879e1963'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:47:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-a0a54fca-68e3-491f-bc59-6c560f33657e tempest-SnapshotsActionsTest-1208726570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-a0a54fca-68e3-491f-bc59-6c560f33657e tempest-SnapshotsActionsTest-1208726570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:39 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-a0a54fca-68e3-491f-bc59-6c560f33657e tempest-SnapshotsActionsTest-1208726570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:47:39 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-a0a54fca-68e3-491f-bc59-6c560f33657e tempest-SnapshotsActionsTest-1208726570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:47:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-a0a54fca-68e3-491f-bc59-6c560f33657e tempest-SnapshotsActionsTest-1208726570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a0a54fca-68e3-491f-bc59-6c560f33657e tempest-SnapshotsActionsTest-1208726570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:39 devstack sudo[94539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:47:39 devstack sudo[94539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:39 devstack sudo[94530]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-38a1a718-20e8-422a-8219-058b5b178b40 tempest-GroupSnapshotsV319Test-1019268315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-33132111-d7fd-4e28-90ce-37e6dab2a5b6.1ad1d15a-222f-447e-af25-5d90dd2a36fb" returned: 0 in 0.654s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:39 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-38a1a718-20e8-422a-8219-058b5b178b40 tempest-GroupSnapshotsV319Test-1019268315 None] Lock "cinder-quobyte-1ad1d15a-222f-447e-af25-5d90dd2a36fb" released by "_delete_snapshot" :: held 3.616s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:39 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-38a1a718-20e8-422a-8219-058b5b178b40 tempest-GroupSnapshotsV319Test-1019268315 None] Lock "cinder-quobyte-33132111-d7fd-4e28-90ce-37e6dab2a5b6" released by "delete_snapshot" :: held 3.647s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:39 devstack cinder-volume[87134]: WARNING cinder.quota [None req-38a1a718-20e8-422a-8219-058b5b178b40 tempest-GroupSnapshotsV319Test-1019268315 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1263959883 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1263959883, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:47:39 devstack cinder-volume[87134]: WARNING cinder.quota [None req-38a1a718-20e8-422a-8219-058b5b178b40 tempest-GroupSnapshotsV319Test-1019268315 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1263959883 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1263959883, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:47:39 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-38a1a718-20e8-422a-8219-058b5b178b40 tempest-GroupSnapshotsV319Test-1019268315 None] Created reservations ['2b50ce08-2ea5-4916-85b1-e1c43dfdf876', '54462576-7d46-42e6-ae71-7cd285179b8f', 'f8e5c75a-7873-467d-be04-b70fca7199d9', '7fceff0a-e72a-482b-8bed-2cf0aeeafbcb'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:47:39 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-38a1a718-20e8-422a-8219-058b5b178b40 tempest-GroupSnapshotsV319Test-1019268315 None] group_snapshot ddd82ba6-c4b8-447d-98e7-e3bda052edf6: deleted successfully Jul 08 01:47:39 devstack sudo[94535]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b1a1f26c-3456-494a-8369-340efebc3a9c tempest-GroupSnapshotsTest-1290797889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ab6656d4-c1c8-4a79-a925-5975d322b77e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ab6656d4-c1c8-4a79-a925-5975d322b77e.914f1968-112b-4994-9053-fa076c05198e 1G" returned: 0 in 0.862s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b1a1f26c-3456-494a-8369-340efebc3a9c tempest-GroupSnapshotsTest-1290797889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab6656d4-c1c8-4a79-a925-5975d322b77e -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ab6656d4-c1c8-4a79-a925-5975d322b77e.914f1968-112b-4994-9053-fa076c05198e {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:39 devstack sudo[94545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab6656d4-c1c8-4a79-a925-5975d322b77e -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ab6656d4-c1c8-4a79-a925-5975d322b77e.914f1968-112b-4994-9053-fa076c05198e Jul 08 01:47:39 devstack sudo[94545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:40 devstack sudo[94539]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a0a54fca-68e3-491f-bc59-6c560f33657e tempest-SnapshotsActionsTest-1208726570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.702s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:40 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-a0a54fca-68e3-491f-bc59-6c560f33657e tempest-SnapshotsActionsTest-1208726570 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:47:40 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-a0a54fca-68e3-491f-bc59-6c560f33657e tempest-SnapshotsActionsTest-1208726570 None] Deleted volume successfully. Jul 08 01:47:40 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a0a54fca-68e3-491f-bc59-6c560f33657e tempest-SnapshotsActionsTest-1208726570 None] Lock "cinder-41e27e51-647a-4db5-a8d7-8e510c819658-delete_volume" released by "delete_volume" :: held 2.650s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:40 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7bf97952-5f43-4f75-86de-1e7c79de072d tempest-GroupSnapshotsV319Test-1019268315 None] Acquiring lock "cinder-quobyte-33132111-d7fd-4e28-90ce-37e6dab2a5b6" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:40 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7bf97952-5f43-4f75-86de-1e7c79de072d tempest-GroupSnapshotsV319Test-1019268315 None] Lock "cinder-quobyte-33132111-d7fd-4e28-90ce-37e6dab2a5b6" acquired by "delete_volume" :: waited 0.021s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:40 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[6485322f-b86a-4422-88cc-c611639c87ea]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7bf97952-5f43-4f75-86de-1e7c79de072d tempest-GroupSnapshotsV319Test-1019268315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-33132111-d7fd-4e28-90ce-37e6dab2a5b6 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:40 devstack sudo[94551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-33132111-d7fd-4e28-90ce-37e6dab2a5b6 Jul 08 01:47:40 devstack sudo[94551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:40 devstack sudo[94545]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b1a1f26c-3456-494a-8369-340efebc3a9c tempest-GroupSnapshotsTest-1290797889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab6656d4-c1c8-4a79-a925-5975d322b77e -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ab6656d4-c1c8-4a79-a925-5975d322b77e.914f1968-112b-4994-9053-fa076c05198e" returned: 0 in 0.858s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:40 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-b1a1f26c-3456-494a-8369-340efebc3a9c tempest-GroupSnapshotsTest-1290797889 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ab6656d4-c1c8-4a79-a925-5975d322b77e.914f1968-112b-4994-9053-fa076c05198e is being set with open permissions: ugo+rw: NotImplementedError Jul 08 01:47:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b1a1f26c-3456-494a-8369-340efebc3a9c tempest-GroupSnapshotsTest-1290797889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ab6656d4-c1c8-4a79-a925-5975d322b77e.914f1968-112b-4994-9053-fa076c05198e {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:40 devstack sudo[94553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ab6656d4-c1c8-4a79-a925-5975d322b77e.914f1968-112b-4994-9053-fa076c05198e Jul 08 01:47:40 devstack sudo[94553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:41 devstack sudo[94551]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7bf97952-5f43-4f75-86de-1e7c79de072d tempest-GroupSnapshotsV319Test-1019268315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-33132111-d7fd-4e28-90ce-37e6dab2a5b6" returned: 0 in 0.959s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7bf97952-5f43-4f75-86de-1e7c79de072d tempest-GroupSnapshotsV319Test-1019268315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-33132111-d7fd-4e28-90ce-37e6dab2a5b6 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:41 devstack sudo[94561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-33132111-d7fd-4e28-90ce-37e6dab2a5b6 Jul 08 01:47:41 devstack sudo[94561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:41 devstack sudo[94553]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b1a1f26c-3456-494a-8369-340efebc3a9c tempest-GroupSnapshotsTest-1290797889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ab6656d4-c1c8-4a79-a925-5975d322b77e.914f1968-112b-4994-9053-fa076c05198e" returned: 0 in 0.848s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b1a1f26c-3456-494a-8369-340efebc3a9c tempest-GroupSnapshotsTest-1290797889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ab6656d4-c1c8-4a79-a925-5975d322b77e.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:41 devstack sudo[94563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ab6656d4-c1c8-4a79-a925-5975d322b77e.info Jul 08 01:47:41 devstack sudo[94563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:42 devstack sudo[94561]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7bf97952-5f43-4f75-86de-1e7c79de072d tempest-GroupSnapshotsV319Test-1019268315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-33132111-d7fd-4e28-90ce-37e6dab2a5b6" returned: 0 in 0.838s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:42 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7bf97952-5f43-4f75-86de-1e7c79de072d tempest-GroupSnapshotsV319Test-1019268315 None] Lock "cinder-quobyte-33132111-d7fd-4e28-90ce-37e6dab2a5b6" released by "delete_volume" :: held 1.888s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:42 devstack sudo[94563]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b1a1f26c-3456-494a-8369-340efebc3a9c tempest-GroupSnapshotsTest-1290797889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ab6656d4-c1c8-4a79-a925-5975d322b77e.info" returned: 0 in 0.807s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:42 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-b1a1f26c-3456-494a-8369-340efebc3a9c tempest-GroupSnapshotsTest-1290797889 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ab6656d4-c1c8-4a79-a925-5975d322b77e.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 01:47:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b1a1f26c-3456-494a-8369-340efebc3a9c tempest-GroupSnapshotsTest-1290797889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ab6656d4-c1c8-4a79-a925-5975d322b77e.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:42 devstack sudo[94573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ab6656d4-c1c8-4a79-a925-5975d322b77e.info Jul 08 01:47:42 devstack sudo[94573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:42 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-7bf97952-5f43-4f75-86de-1e7c79de072d tempest-GroupSnapshotsV319Test-1019268315 None] Created reservations ['0b336a24-aca7-445e-966c-06a0a27f76b0'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:47:42 devstack cinder-volume[87134]: WARNING cinder.quota [None req-7bf97952-5f43-4f75-86de-1e7c79de072d tempest-GroupSnapshotsV319Test-1019268315 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1263959883 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1263959883, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:47:42 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-7bf97952-5f43-4f75-86de-1e7c79de072d tempest-GroupSnapshotsV319Test-1019268315 None] Created reservations ['e01b0c4b-c189-4f3f-b56e-6f848ca38f6a', 'c47d5940-28e1-4757-b2f6-6e797d7cec6f', '18b4d0f9-af9d-4453-ad0f-dc167ca54433', 'b7b10610-f229-47c2-9dd3-11646f9bebbd'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:47:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7bf97952-5f43-4f75-86de-1e7c79de072d tempest-GroupSnapshotsV319Test-1019268315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7bf97952-5f43-4f75-86de-1e7c79de072d tempest-GroupSnapshotsV319Test-1019268315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:42 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-7bf97952-5f43-4f75-86de-1e7c79de072d tempest-GroupSnapshotsV319Test-1019268315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:47:42 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-7bf97952-5f43-4f75-86de-1e7c79de072d tempest-GroupSnapshotsV319Test-1019268315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:47:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7bf97952-5f43-4f75-86de-1e7c79de072d tempest-GroupSnapshotsV319Test-1019268315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7bf97952-5f43-4f75-86de-1e7c79de072d tempest-GroupSnapshotsV319Test-1019268315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:43 devstack sudo[94585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:47:43 devstack sudo[94585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:43 devstack sudo[94573]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b1a1f26c-3456-494a-8369-340efebc3a9c tempest-GroupSnapshotsTest-1290797889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ab6656d4-c1c8-4a79-a925-5975d322b77e.info" returned: 0 in 0.938s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b1a1f26c-3456-494a-8369-340efebc3a9c tempest-GroupSnapshotsTest-1290797889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.407s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:43 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-b1a1f26c-3456-494a-8369-340efebc3a9c tempest-GroupSnapshotsTest-1290797889 None] group_snapshot e90942b5-9117-4b25-b0b4-4ed36123199c: created successfully Jul 08 01:47:43 devstack sudo[94585]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7bf97952-5f43-4f75-86de-1e7c79de072d tempest-GroupSnapshotsV319Test-1019268315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 1.031s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:44 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-7bf97952-5f43-4f75-86de-1e7c79de072d tempest-GroupSnapshotsV319Test-1019268315 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:47:44 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-7bf97952-5f43-4f75-86de-1e7c79de072d tempest-GroupSnapshotsV319Test-1019268315 None] Delete group completed successfully. Jul 08 01:47:44 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-7a1ec131-aeca-4e74-884f-1489a355df3b tempest-GroupSnapshotsTest-1290797889 None] group_snapshot e90942b5-9117-4b25-b0b4-4ed36123199c: deleting Jul 08 01:47:44 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-7a1ec131-aeca-4e74-884f-1489a355df3b tempest-GroupSnapshotsTest-1290797889 None] group_snapshot e90942b5-9117-4b25-b0b4-4ed36123199c: deleting {{(pid=87134) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 08 01:47:44 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7a1ec131-aeca-4e74-884f-1489a355df3b tempest-GroupSnapshotsTest-1290797889 None] Acquiring lock "cinder-quobyte-ab6656d4-c1c8-4a79-a925-5975d322b77e" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:44 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7a1ec131-aeca-4e74-884f-1489a355df3b tempest-GroupSnapshotsTest-1290797889 None] Lock "cinder-quobyte-ab6656d4-c1c8-4a79-a925-5975d322b77e" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:44 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7a1ec131-aeca-4e74-884f-1489a355df3b tempest-GroupSnapshotsTest-1290797889 None] Acquiring lock "cinder-quobyte-914f1968-112b-4994-9053-fa076c05198e" by "_delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:44 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7a1ec131-aeca-4e74-884f-1489a355df3b tempest-GroupSnapshotsTest-1290797889 None] Lock "cinder-quobyte-914f1968-112b-4994-9053-fa076c05198e" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:44 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-7a1ec131-aeca-4e74-884f-1489a355df3b tempest-GroupSnapshotsTest-1290797889 None] Deleting offline snapshot 914f1968-112b-4994-9053-fa076c05198e of volume ab6656d4-c1c8-4a79-a925-5975d322b77e {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:47:44 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-7a1ec131-aeca-4e74-884f-1489a355df3b tempest-GroupSnapshotsTest-1290797889 None] snapshot_file for this snap is: volume-ab6656d4-c1c8-4a79-a925-5975d322b77e.914f1968-112b-4994-9053-fa076c05198e {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:47:44 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b84e8c-c64f-458d-b3c6-bab702fef7ff]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7a1ec131-aeca-4e74-884f-1489a355df3b tempest-GroupSnapshotsTest-1290797889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ab6656d4-c1c8-4a79-a925-5975d322b77e.914f1968-112b-4994-9053-fa076c05198e {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:45 devstack sudo[94597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ab6656d4-c1c8-4a79-a925-5975d322b77e.914f1968-112b-4994-9053-fa076c05198e Jul 08 01:47:45 devstack sudo[94597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:46 devstack sudo[94597]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7a1ec131-aeca-4e74-884f-1489a355df3b tempest-GroupSnapshotsTest-1290797889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ab6656d4-c1c8-4a79-a925-5975d322b77e.914f1968-112b-4994-9053-fa076c05198e" returned: 0 in 1.247s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:46 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-7a1ec131-aeca-4e74-884f-1489a355df3b tempest-GroupSnapshotsTest-1290797889 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab6656d4-c1c8-4a79-a925-5975d322b77e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:47:46 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d00930-d530-4333-8737-6bf412b03188]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7a1ec131-aeca-4e74-884f-1489a355df3b tempest-GroupSnapshotsTest-1290797889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ab6656d4-c1c8-4a79-a925-5975d322b77e {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:46 devstack sudo[94603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ab6656d4-c1c8-4a79-a925-5975d322b77e Jul 08 01:47:46 devstack sudo[94603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:47 devstack sudo[94603]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7a1ec131-aeca-4e74-884f-1489a355df3b tempest-GroupSnapshotsTest-1290797889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ab6656d4-c1c8-4a79-a925-5975d322b77e" returned: 0 in 1.216s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7a1ec131-aeca-4e74-884f-1489a355df3b tempest-GroupSnapshotsTest-1290797889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ab6656d4-c1c8-4a79-a925-5975d322b77e.914f1968-112b-4994-9053-fa076c05198e {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:47 devstack sudo[94608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ab6656d4-c1c8-4a79-a925-5975d322b77e.914f1968-112b-4994-9053-fa076c05198e Jul 08 01:47:47 devstack sudo[94608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:48 devstack sudo[94608]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7a1ec131-aeca-4e74-884f-1489a355df3b tempest-GroupSnapshotsTest-1290797889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ab6656d4-c1c8-4a79-a925-5975d322b77e.914f1968-112b-4994-9053-fa076c05198e" returned: 0 in 0.989s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7a1ec131-aeca-4e74-884f-1489a355df3b tempest-GroupSnapshotsTest-1290797889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ab6656d4-c1c8-4a79-a925-5975d322b77e.914f1968-112b-4994-9053-fa076c05198e {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:48 devstack sudo[94613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ab6656d4-c1c8-4a79-a925-5975d322b77e.914f1968-112b-4994-9053-fa076c05198e Jul 08 01:47:48 devstack sudo[94613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:49 devstack sudo[94613]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:49 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7a1ec131-aeca-4e74-884f-1489a355df3b tempest-GroupSnapshotsTest-1290797889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ab6656d4-c1c8-4a79-a925-5975d322b77e.914f1968-112b-4994-9053-fa076c05198e" returned: 0 in 0.821s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:49 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7a1ec131-aeca-4e74-884f-1489a355df3b tempest-GroupSnapshotsTest-1290797889 None] Lock "cinder-quobyte-914f1968-112b-4994-9053-fa076c05198e" released by "_delete_snapshot" :: held 4.468s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:49 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7a1ec131-aeca-4e74-884f-1489a355df3b tempest-GroupSnapshotsTest-1290797889 None] Lock "cinder-quobyte-ab6656d4-c1c8-4a79-a925-5975d322b77e" released by "delete_snapshot" :: held 4.504s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:49 devstack cinder-volume[87134]: WARNING cinder.quota [None req-7a1ec131-aeca-4e74-884f-1489a355df3b tempest-GroupSnapshotsTest-1290797889 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1732581839 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1732581839, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:47:49 devstack cinder-volume[87134]: WARNING cinder.quota [None req-7a1ec131-aeca-4e74-884f-1489a355df3b tempest-GroupSnapshotsTest-1290797889 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1732581839 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1732581839, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:47:49 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-7a1ec131-aeca-4e74-884f-1489a355df3b tempest-GroupSnapshotsTest-1290797889 None] Created reservations ['7f0b39cc-ec0c-4959-ac8a-42610fe4482d', '360841c2-a44f-4f37-898e-74bed2000ccd', '8275c32f-4df5-4e7d-8dc4-071afa4dfbf5', '025db19a-d32d-4792-8837-cd8062449287'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:47:49 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-7a1ec131-aeca-4e74-884f-1489a355df3b tempest-GroupSnapshotsTest-1290797889 None] group_snapshot e90942b5-9117-4b25-b0b4-4ed36123199c: deleted successfully Jul 08 01:47:50 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-e175a1b8-a818-4450-8da8-f29ad8e12505 tempest-GroupSnapshotsTest-1290797889 None] Acquiring lock "cinder-quobyte-ab6656d4-c1c8-4a79-a925-5975d322b77e" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:50 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-e175a1b8-a818-4450-8da8-f29ad8e12505 tempest-GroupSnapshotsTest-1290797889 None] Lock "cinder-quobyte-ab6656d4-c1c8-4a79-a925-5975d322b77e" acquired by "delete_volume" :: waited 0.043s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:50 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec7d1e28-8b5c-4f1d-b4c2-100333f0eaf1]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:50 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e175a1b8-a818-4450-8da8-f29ad8e12505 tempest-GroupSnapshotsTest-1290797889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ab6656d4-c1c8-4a79-a925-5975d322b77e {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:51 devstack sudo[94616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ab6656d4-c1c8-4a79-a925-5975d322b77e Jul 08 01:47:51 devstack sudo[94616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:51 devstack sudo[94616]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e175a1b8-a818-4450-8da8-f29ad8e12505 tempest-GroupSnapshotsTest-1290797889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ab6656d4-c1c8-4a79-a925-5975d322b77e" returned: 0 in 1.051s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e175a1b8-a818-4450-8da8-f29ad8e12505 tempest-GroupSnapshotsTest-1290797889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ab6656d4-c1c8-4a79-a925-5975d322b77e {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:51 devstack sudo[94621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ab6656d4-c1c8-4a79-a925-5975d322b77e Jul 08 01:47:51 devstack sudo[94621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:52 devstack sudo[94621]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:52 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e175a1b8-a818-4450-8da8-f29ad8e12505 tempest-GroupSnapshotsTest-1290797889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ab6656d4-c1c8-4a79-a925-5975d322b77e" returned: 0 in 0.865s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:52 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-e175a1b8-a818-4450-8da8-f29ad8e12505 tempest-GroupSnapshotsTest-1290797889 None] Lock "cinder-quobyte-ab6656d4-c1c8-4a79-a925-5975d322b77e" released by "delete_volume" :: held 2.037s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:52 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-e175a1b8-a818-4450-8da8-f29ad8e12505 tempest-GroupSnapshotsTest-1290797889 None] Created reservations ['88c0db6a-b47e-44e3-9218-f05440004837'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:47:52 devstack cinder-volume[87134]: WARNING cinder.quota [None req-e175a1b8-a818-4450-8da8-f29ad8e12505 tempest-GroupSnapshotsTest-1290797889 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1732581839 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1732581839, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:47:52 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-e175a1b8-a818-4450-8da8-f29ad8e12505 tempest-GroupSnapshotsTest-1290797889 None] Created reservations ['ac37287a-06c0-4354-895f-924c2cbbe0d7', 'b9b117a3-3609-4789-9835-c4594a1d9ab3', 'e1e6640e-b8d6-4c5a-9453-60e4453b6c54', '05bb8d86-2ae0-4a6c-8655-1ff9d47fb637'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:47:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e175a1b8-a818-4450-8da8-f29ad8e12505 tempest-GroupSnapshotsTest-1290797889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e175a1b8-a818-4450-8da8-f29ad8e12505 tempest-GroupSnapshotsTest-1290797889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:53 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-e175a1b8-a818-4450-8da8-f29ad8e12505 tempest-GroupSnapshotsTest-1290797889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:47:53 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-e175a1b8-a818-4450-8da8-f29ad8e12505 tempest-GroupSnapshotsTest-1290797889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:47:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e175a1b8-a818-4450-8da8-f29ad8e12505 tempest-GroupSnapshotsTest-1290797889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e175a1b8-a818-4450-8da8-f29ad8e12505 tempest-GroupSnapshotsTest-1290797889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:53 devstack sudo[94625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:47:53 devstack sudo[94625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:53 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c109814-1571-4f1b-a3fa-d2aaa6349cbf tempest-VolumesServicesTestJSON-746338527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:47:53 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1c109814-1571-4f1b-a3fa-d2aaa6349cbf tempest-VolumesServicesTestJSON-746338527 None] Flow 'volume_create_manager' (218a7301-8926-4372-acb3-3187093f619e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:47:53 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1c109814-1571-4f1b-a3fa-d2aaa6349cbf tempest-VolumesServicesTestJSON-746338527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1e2f4dd-dc89-4c4d-b177-da0bd0516fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:53 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1c109814-1571-4f1b-a3fa-d2aaa6349cbf tempest-VolumesServicesTestJSON-746338527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1e2f4dd-dc89-4c4d-b177-da0bd0516fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:47:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-29483759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0034c39-8906-4b98-a3a5-35ebd176cc90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='531226d88fde4564b0c0135d5573750b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:47:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:47:54Z,use_quota=True,user_id='7bfb5926bf6441afbafd47dc6d167530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:53 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1c109814-1571-4f1b-a3fa-d2aaa6349cbf tempest-VolumesServicesTestJSON-746338527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71eb9da5-e441-47f4-a7c1-db5f0d159769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:53 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1c109814-1571-4f1b-a3fa-d2aaa6349cbf tempest-VolumesServicesTestJSON-746338527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71eb9da5-e441-47f4-a7c1-db5f0d159769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:53 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1c109814-1571-4f1b-a3fa-d2aaa6349cbf tempest-VolumesServicesTestJSON-746338527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7a56695-4de4-4382-8c9d-097df5ba8ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:54 devstack sudo[94625]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:54 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1c109814-1571-4f1b-a3fa-d2aaa6349cbf tempest-VolumesServicesTestJSON-746338527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7a56695-4de4-4382-8c9d-097df5ba8ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0034c39-8906-4b98-a3a5-35ebd176cc90', 'volume_name': 'volume-a0034c39-8906-4b98-a3a5-35ebd176cc90', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:54 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1c109814-1571-4f1b-a3fa-d2aaa6349cbf tempest-VolumesServicesTestJSON-746338527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c799d42-50d3-442b-b2f2-0db55db740ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:54 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1c109814-1571-4f1b-a3fa-d2aaa6349cbf tempest-VolumesServicesTestJSON-746338527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c799d42-50d3-442b-b2f2-0db55db740ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:54 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1c109814-1571-4f1b-a3fa-d2aaa6349cbf tempest-VolumesServicesTestJSON-746338527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88ed7a21-bb28-459d-b752-da7d4e56468e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:54 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-1c109814-1571-4f1b-a3fa-d2aaa6349cbf tempest-VolumesServicesTestJSON-746338527 None] Volume a0034c39-8906-4b98-a3a5-35ebd176cc90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0034c39-8906-4b98-a3a5-35ebd176cc90', 'volume_size': 1} Jul 08 01:47:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-1c109814-1571-4f1b-a3fa-d2aaa6349cbf tempest-VolumesServicesTestJSON-746338527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-1c109814-1571-4f1b-a3fa-d2aaa6349cbf tempest-VolumesServicesTestJSON-746338527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:54 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-1c109814-1571-4f1b-a3fa-d2aaa6349cbf tempest-VolumesServicesTestJSON-746338527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:47:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-29483759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0034c39-8906-4b98-a3a5-35ebd176cc90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='531226d88fde4564b0c0135d5573750b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:47:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:47:54Z,use_quota=True,user_id='7bfb5926bf6441afbafd47dc6d167530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:47:54 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-1c109814-1571-4f1b-a3fa-d2aaa6349cbf tempest-VolumesServicesTestJSON-746338527 None] Creating volume a0034c39-8906-4b98-a3a5-35ebd176cc90 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:47:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-1c109814-1571-4f1b-a3fa-d2aaa6349cbf tempest-VolumesServicesTestJSON-746338527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-1c109814-1571-4f1b-a3fa-d2aaa6349cbf tempest-VolumesServicesTestJSON-746338527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:54 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-1c109814-1571-4f1b-a3fa-d2aaa6349cbf tempest-VolumesServicesTestJSON-746338527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:47:54 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-1c109814-1571-4f1b-a3fa-d2aaa6349cbf tempest-VolumesServicesTestJSON-746338527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:47:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-1c109814-1571-4f1b-a3fa-d2aaa6349cbf tempest-VolumesServicesTestJSON-746338527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:54 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-1c109814-1571-4f1b-a3fa-d2aaa6349cbf tempest-VolumesServicesTestJSON-746338527 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:47:54 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-1c109814-1571-4f1b-a3fa-d2aaa6349cbf tempest-VolumesServicesTestJSON-746338527 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:47:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1c109814-1571-4f1b-a3fa-d2aaa6349cbf tempest-VolumesServicesTestJSON-746338527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a0034c39-8906-4b98-a3a5-35ebd176cc90 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e175a1b8-a818-4450-8da8-f29ad8e12505 tempest-GroupSnapshotsTest-1290797889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.938s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:54 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-e175a1b8-a818-4450-8da8-f29ad8e12505 tempest-GroupSnapshotsTest-1290797889 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:47:54 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-e175a1b8-a818-4450-8da8-f29ad8e12505 tempest-GroupSnapshotsTest-1290797889 None] Delete group completed successfully. Jul 08 01:47:54 devstack sudo[94628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a0034c39-8906-4b98-a3a5-35ebd176cc90 1073741824 Jul 08 01:47:54 devstack sudo[94628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:55 devstack sudo[94628]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:55 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1c109814-1571-4f1b-a3fa-d2aaa6349cbf tempest-VolumesServicesTestJSON-746338527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a0034c39-8906-4b98-a3a5-35ebd176cc90 1073741824" returned: 0 in 1.179s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:55 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1c109814-1571-4f1b-a3fa-d2aaa6349cbf tempest-VolumesServicesTestJSON-746338527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a0034c39-8906-4b98-a3a5-35ebd176cc90 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:55 devstack sudo[94637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a0034c39-8906-4b98-a3a5-35ebd176cc90 Jul 08 01:47:55 devstack sudo[94637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:56 devstack sudo[94637]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:56 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1c109814-1571-4f1b-a3fa-d2aaa6349cbf tempest-VolumesServicesTestJSON-746338527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a0034c39-8906-4b98-a3a5-35ebd176cc90" returned: 0 in 0.802s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:56 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-1c109814-1571-4f1b-a3fa-d2aaa6349cbf tempest-VolumesServicesTestJSON-746338527 None] <== create_volume: return (2044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:47:56 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-1c109814-1571-4f1b-a3fa-d2aaa6349cbf tempest-VolumesServicesTestJSON-746338527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.048s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:56 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1c109814-1571-4f1b-a3fa-d2aaa6349cbf tempest-VolumesServicesTestJSON-746338527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88ed7a21-bb28-459d-b752-da7d4e56468e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0034c39-8906-4b98-a3a5-35ebd176cc90', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:56 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1c109814-1571-4f1b-a3fa-d2aaa6349cbf tempest-VolumesServicesTestJSON-746338527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbebc4f6-2f6d-4af2-85f8-77dcc664c314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:47:56 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-1c109814-1571-4f1b-a3fa-d2aaa6349cbf tempest-VolumesServicesTestJSON-746338527 None] Volume volume-a0034c39-8906-4b98-a3a5-35ebd176cc90 (a0034c39-8906-4b98-a3a5-35ebd176cc90): created successfully Jul 08 01:47:56 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1c109814-1571-4f1b-a3fa-d2aaa6349cbf tempest-VolumesServicesTestJSON-746338527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbebc4f6-2f6d-4af2-85f8-77dcc664c314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:47:56 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1c109814-1571-4f1b-a3fa-d2aaa6349cbf tempest-VolumesServicesTestJSON-746338527 None] Flow 'volume_create_manager' (218a7301-8926-4372-acb3-3187093f619e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:47:56 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-1c109814-1571-4f1b-a3fa-d2aaa6349cbf tempest-VolumesServicesTestJSON-746338527 None] Created volume successfully. Jul 08 01:47:57 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-d10f9580-40e6-4369-9d34-2651e0aa12d0 tempest-VolumesServicesTestJSON-746338527 None] Acquiring lock "cinder-a0034c39-8906-4b98-a3a5-35ebd176cc90-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:57 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-d10f9580-40e6-4369-9d34-2651e0aa12d0 tempest-VolumesServicesTestJSON-746338527 None] Lock "cinder-a0034c39-8906-4b98-a3a5-35ebd176cc90-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:57 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-d10f9580-40e6-4369-9d34-2651e0aa12d0 tempest-VolumesServicesTestJSON-746338527 None] Acquiring lock "cinder-quobyte-a0034c39-8906-4b98-a3a5-35ebd176cc90" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:47:57 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-d10f9580-40e6-4369-9d34-2651e0aa12d0 tempest-VolumesServicesTestJSON-746338527 None] Lock "cinder-quobyte-a0034c39-8906-4b98-a3a5-35ebd176cc90" acquired by "delete_volume" :: waited 0.018s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:47:57 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[2628e9f8-378a-4285-9a11-e4639161ad73]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:47:57 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d10f9580-40e6-4369-9d34-2651e0aa12d0 tempest-VolumesServicesTestJSON-746338527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a0034c39-8906-4b98-a3a5-35ebd176cc90 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:57 devstack sudo[94641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a0034c39-8906-4b98-a3a5-35ebd176cc90 Jul 08 01:47:57 devstack sudo[94641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:58 devstack sudo[94641]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:58 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d10f9580-40e6-4369-9d34-2651e0aa12d0 tempest-VolumesServicesTestJSON-746338527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a0034c39-8906-4b98-a3a5-35ebd176cc90" returned: 0 in 0.921s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:58 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d10f9580-40e6-4369-9d34-2651e0aa12d0 tempest-VolumesServicesTestJSON-746338527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a0034c39-8906-4b98-a3a5-35ebd176cc90 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:58 devstack sudo[94646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a0034c39-8906-4b98-a3a5-35ebd176cc90 Jul 08 01:47:58 devstack sudo[94646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:47:59 devstack sudo[94646]: pam_unix(sudo:session): session closed for user root Jul 08 01:47:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d10f9580-40e6-4369-9d34-2651e0aa12d0 tempest-VolumesServicesTestJSON-746338527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a0034c39-8906-4b98-a3a5-35ebd176cc90" returned: 0 in 0.849s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:47:59 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-d10f9580-40e6-4369-9d34-2651e0aa12d0 tempest-VolumesServicesTestJSON-746338527 None] Lock "cinder-quobyte-a0034c39-8906-4b98-a3a5-35ebd176cc90" released by "delete_volume" :: held 1.827s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:47:59 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-d10f9580-40e6-4369-9d34-2651e0aa12d0 tempest-VolumesServicesTestJSON-746338527 None] Created reservations ['8ca001c7-a858-4169-84a1-528684f2e740', 'dc7c1f9f-8c03-4650-b5c9-005f1f85c33c', 'ef43cc29-aee2-49f0-8663-9b354f9d68ab', '06d81349-0f02-4a3e-b9eb-28d93e81b66c'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:47:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-d10f9580-40e6-4369-9d34-2651e0aa12d0 tempest-VolumesServicesTestJSON-746338527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:47:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-d10f9580-40e6-4369-9d34-2651e0aa12d0 tempest-VolumesServicesTestJSON-746338527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:47:59 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-d10f9580-40e6-4369-9d34-2651e0aa12d0 tempest-VolumesServicesTestJSON-746338527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:47:59 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-d10f9580-40e6-4369-9d34-2651e0aa12d0 tempest-VolumesServicesTestJSON-746338527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:47:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-d10f9580-40e6-4369-9d34-2651e0aa12d0 tempest-VolumesServicesTestJSON-746338527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:47:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d10f9580-40e6-4369-9d34-2651e0aa12d0 tempest-VolumesServicesTestJSON-746338527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:47:59 devstack sudo[94651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:47:59 devstack sudo[94651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:00 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-877abdf0-f077-4723-8f76-12d6cdcf2912 tempest-GroupsV314Test-651478195 None] Group tempest-GroupsV314Test-Group-170581091: creating Jul 08 01:48:00 devstack sudo[94651]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:00 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-877abdf0-f077-4723-8f76-12d6cdcf2912 tempest-GroupsV314Test-651478195 None] Group tempest-GroupsV314Test-Group-170581091: created successfully Jul 08 01:48:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d10f9580-40e6-4369-9d34-2651e0aa12d0 tempest-VolumesServicesTestJSON-746338527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 1.225s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:00 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-d10f9580-40e6-4369-9d34-2651e0aa12d0 tempest-VolumesServicesTestJSON-746338527 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:48:00 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-d10f9580-40e6-4369-9d34-2651e0aa12d0 tempest-VolumesServicesTestJSON-746338527 None] Deleted volume successfully. Jul 08 01:48:01 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-877abdf0-f077-4723-8f76-12d6cdcf2912 tempest-GroupsV314Test-651478195 None] Create group completed successfully. Jul 08 01:48:01 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-d10f9580-40e6-4369-9d34-2651e0aa12d0 tempest-VolumesServicesTestJSON-746338527 None] Lock "cinder-a0034c39-8906-4b98-a3a5-35ebd176cc90-delete_volume" released by "delete_volume" :: held 3.496s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:48:02 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ecce5d5-02cf-4159-a99c-3ed92d61bf65 tempest-GroupsV314Test-651478195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:48:02 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6ecce5d5-02cf-4159-a99c-3ed92d61bf65 tempest-GroupsV314Test-651478195 None] Flow 'volume_create_manager' (5437eb87-56e1-47a5-88c2-5076e6085f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:48:02 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6ecce5d5-02cf-4159-a99c-3ed92d61bf65 tempest-GroupsV314Test-651478195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d835d00-c73c-4d82-b3dc-60d886abade0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:02 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6ecce5d5-02cf-4159-a99c-3ed92d61bf65 tempest-GroupsV314Test-651478195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d835d00-c73c-4d82-b3dc-60d886abade0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:48:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2026941210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9095c495-5827-4441-9648-7a7ed2cd43ed,host='devstack@QuobyteHD#QuobyteHD',id=b03a8523-22d3-4465-a733-588c706e138d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4498869cf7684526a9291b8ef80dba54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:48:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:48:03Z,use_quota=True,user_id='fd7adb31db154a11b45472abbd70d717',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(955c70ee-4963-47ac-8da4-392824ab8c84),volume_type_id=955c70ee-4963-47ac-8da4-392824ab8c84)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:02 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6ecce5d5-02cf-4159-a99c-3ed92d61bf65 tempest-GroupsV314Test-651478195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7585bafd-df88-4396-81de-b117956c36b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:02 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6ecce5d5-02cf-4159-a99c-3ed92d61bf65 tempest-GroupsV314Test-651478195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7585bafd-df88-4396-81de-b117956c36b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:02 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6ecce5d5-02cf-4159-a99c-3ed92d61bf65 tempest-GroupsV314Test-651478195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc4adecc-495c-4290-bc76-2a1ec690ef38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:02 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6ecce5d5-02cf-4159-a99c-3ed92d61bf65 tempest-GroupsV314Test-651478195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc4adecc-495c-4290-bc76-2a1ec690ef38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b03a8523-22d3-4465-a733-588c706e138d', 'volume_name': 'volume-b03a8523-22d3-4465-a733-588c706e138d', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:02 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6ecce5d5-02cf-4159-a99c-3ed92d61bf65 tempest-GroupsV314Test-651478195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ebb6e86-eedd-4588-99f7-0b6ca4d6bb63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:02 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6ecce5d5-02cf-4159-a99c-3ed92d61bf65 tempest-GroupsV314Test-651478195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ebb6e86-eedd-4588-99f7-0b6ca4d6bb63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:02 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6ecce5d5-02cf-4159-a99c-3ed92d61bf65 tempest-GroupsV314Test-651478195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1726a41-3622-48b1-aea6-f3d309bfd4fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:02 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-6ecce5d5-02cf-4159-a99c-3ed92d61bf65 tempest-GroupsV314Test-651478195 None] Volume b03a8523-22d3-4465-a733-588c706e138d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b03a8523-22d3-4465-a733-588c706e138d', 'volume_size': 1} Jul 08 01:48:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6ecce5d5-02cf-4159-a99c-3ed92d61bf65 tempest-GroupsV314Test-651478195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:48:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6ecce5d5-02cf-4159-a99c-3ed92d61bf65 tempest-GroupsV314Test-651478195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:02 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-6ecce5d5-02cf-4159-a99c-3ed92d61bf65 tempest-GroupsV314Test-651478195 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9095c495-5827-4441-9648-7a7ed2cd43ed,created_at=2026-07-07T23:48:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2026941210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9095c495-5827-4441-9648-7a7ed2cd43ed,host='devstack@QuobyteHD#QuobyteHD',id=b03a8523-22d3-4465-a733-588c706e138d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4498869cf7684526a9291b8ef80dba54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:48:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:48:03Z,use_quota=True,user_id='fd7adb31db154a11b45472abbd70d717',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(955c70ee-4963-47ac-8da4-392824ab8c84),volume_type_id=955c70ee-4963-47ac-8da4-392824ab8c84)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:48:02 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-6ecce5d5-02cf-4159-a99c-3ed92d61bf65 tempest-GroupsV314Test-651478195 None] Creating volume b03a8523-22d3-4465-a733-588c706e138d {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:48:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6ecce5d5-02cf-4159-a99c-3ed92d61bf65 tempest-GroupsV314Test-651478195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:48:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6ecce5d5-02cf-4159-a99c-3ed92d61bf65 tempest-GroupsV314Test-651478195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:02 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-6ecce5d5-02cf-4159-a99c-3ed92d61bf65 tempest-GroupsV314Test-651478195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:48:02 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-6ecce5d5-02cf-4159-a99c-3ed92d61bf65 tempest-GroupsV314Test-651478195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:48:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6ecce5d5-02cf-4159-a99c-3ed92d61bf65 tempest-GroupsV314Test-651478195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:02 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-6ecce5d5-02cf-4159-a99c-3ed92d61bf65 tempest-GroupsV314Test-651478195 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:48:02 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-6ecce5d5-02cf-4159-a99c-3ed92d61bf65 tempest-GroupsV314Test-651478195 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:48:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6ecce5d5-02cf-4159-a99c-3ed92d61bf65 tempest-GroupsV314Test-651478195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b03a8523-22d3-4465-a733-588c706e138d 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:03 devstack sudo[94671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b03a8523-22d3-4465-a733-588c706e138d 1073741824 Jul 08 01:48:03 devstack sudo[94671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:04 devstack sudo[94671]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:04 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6ecce5d5-02cf-4159-a99c-3ed92d61bf65 tempest-GroupsV314Test-651478195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b03a8523-22d3-4465-a733-588c706e138d 1073741824" returned: 0 in 1.281s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:04 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6ecce5d5-02cf-4159-a99c-3ed92d61bf65 tempest-GroupsV314Test-651478195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b03a8523-22d3-4465-a733-588c706e138d {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:04 devstack sudo[94678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b03a8523-22d3-4465-a733-588c706e138d Jul 08 01:48:04 devstack sudo[94678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:05 devstack sudo[94678]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:05 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6ecce5d5-02cf-4159-a99c-3ed92d61bf65 tempest-GroupsV314Test-651478195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b03a8523-22d3-4465-a733-588c706e138d" returned: 0 in 0.730s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:05 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-6ecce5d5-02cf-4159-a99c-3ed92d61bf65 tempest-GroupsV314Test-651478195 None] <== create_volume: return (2081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:48:05 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6ecce5d5-02cf-4159-a99c-3ed92d61bf65 tempest-GroupsV314Test-651478195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.087s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:05 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6ecce5d5-02cf-4159-a99c-3ed92d61bf65 tempest-GroupsV314Test-651478195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1726a41-3622-48b1-aea6-f3d309bfd4fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b03a8523-22d3-4465-a733-588c706e138d', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:05 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6ecce5d5-02cf-4159-a99c-3ed92d61bf65 tempest-GroupsV314Test-651478195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9d63bff-5004-44d4-b64c-aa3b3a077c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:05 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-6ecce5d5-02cf-4159-a99c-3ed92d61bf65 tempest-GroupsV314Test-651478195 None] Volume volume-b03a8523-22d3-4465-a733-588c706e138d (b03a8523-22d3-4465-a733-588c706e138d): created successfully Jul 08 01:48:05 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6ecce5d5-02cf-4159-a99c-3ed92d61bf65 tempest-GroupsV314Test-651478195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9d63bff-5004-44d4-b64c-aa3b3a077c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:05 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6ecce5d5-02cf-4159-a99c-3ed92d61bf65 tempest-GroupsV314Test-651478195 None] Flow 'volume_create_manager' (5437eb87-56e1-47a5-88c2-5076e6085f15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:48:05 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-6ecce5d5-02cf-4159-a99c-3ed92d61bf65 tempest-GroupsV314Test-651478195 None] Created volume successfully. Jul 08 01:48:06 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-4e2435b5-7c99-4d1a-8cec-3e210b409742 tempest-GroupsV314Test-651478195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:48:06 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-4e2435b5-7c99-4d1a-8cec-3e210b409742 tempest-GroupsV314Test-651478195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:06 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-4e2435b5-7c99-4d1a-8cec-3e210b409742 tempest-GroupsV314Test-651478195 None] Cloning volume b03a8523-22d3-4465-a733-588c706e138d to volume 17260fe9-7171-4614-8b77-b5055b09c9c6 Jul 08 01:48:06 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-4e2435b5-7c99-4d1a-8cec-3e210b409742 tempest-GroupsV314Test-651478195 None] Creating offline snapshot d4d6b071-f5e4-4d67-b1c1-76968a3ff27a of volume b03a8523-22d3-4465-a733-588c706e138d {{(pid=87134) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:48:07 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[b939c9c9-a751-4c86-b174-5319ea6de37e]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:48:07 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4e2435b5-7c99-4d1a-8cec-3e210b409742 tempest-GroupsV314Test-651478195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b03a8523-22d3-4465-a733-588c706e138d {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:07 devstack sudo[94693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b03a8523-22d3-4465-a733-588c706e138d Jul 08 01:48:07 devstack sudo[94693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:08 devstack sudo[94693]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:08 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4e2435b5-7c99-4d1a-8cec-3e210b409742 tempest-GroupsV314Test-651478195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b03a8523-22d3-4465-a733-588c706e138d" returned: 0 in 1.347s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:08 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4e2435b5-7c99-4d1a-8cec-3e210b409742 tempest-GroupsV314Test-651478195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b03a8523-22d3-4465-a733-588c706e138d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b03a8523-22d3-4465-a733-588c706e138d.d4d6b071-f5e4-4d67-b1c1-76968a3ff27a 1G {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:08 devstack sudo[94734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b03a8523-22d3-4465-a733-588c706e138d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b03a8523-22d3-4465-a733-588c706e138d.d4d6b071-f5e4-4d67-b1c1-76968a3ff27a 1G Jul 08 01:48:08 devstack sudo[94734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:08 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-45dcb1ff-20f1-4a6e-b7a3-dfba12efd1fd tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:48:08 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-45dcb1ff-20f1-4a6e-b7a3-dfba12efd1fd tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] Flow 'volume_create_manager' (ea45c450-eada-4503-a1e8-a59b7c1e5410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:48:08 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-45dcb1ff-20f1-4a6e-b7a3-dfba12efd1fd tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e1cad00-95be-48fb-897a-fe37ddbeb3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:09 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-45dcb1ff-20f1-4a6e-b7a3-dfba12efd1fd tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e1cad00-95be-48fb-897a-fe37ddbeb3cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:48:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1884443836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32fd7b45-3af6-4503-99fa-abe55c390fca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb1dea9e48cd4932bb0bcdccd4b4efed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:48:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:48:09Z,use_quota=True,user_id='cb1c8de7079b4b4b88483c6e5522dfb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:09 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-45dcb1ff-20f1-4a6e-b7a3-dfba12efd1fd tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba7f4a91-2108-46dc-9c06-b8f2f60bdf70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:09 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-45dcb1ff-20f1-4a6e-b7a3-dfba12efd1fd tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba7f4a91-2108-46dc-9c06-b8f2f60bdf70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:09 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-45dcb1ff-20f1-4a6e-b7a3-dfba12efd1fd tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19e60d04-afb6-4bbf-b27b-3702b187ae38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:09 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-45dcb1ff-20f1-4a6e-b7a3-dfba12efd1fd tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19e60d04-afb6-4bbf-b27b-3702b187ae38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32fd7b45-3af6-4503-99fa-abe55c390fca', 'volume_name': 'volume-32fd7b45-3af6-4503-99fa-abe55c390fca', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:09 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-45dcb1ff-20f1-4a6e-b7a3-dfba12efd1fd tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aec647f5-53a5-472a-b72d-b64e8079d4d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:09 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-45dcb1ff-20f1-4a6e-b7a3-dfba12efd1fd tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aec647f5-53a5-472a-b72d-b64e8079d4d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:09 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-45dcb1ff-20f1-4a6e-b7a3-dfba12efd1fd tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c499b46b-4a7f-48e2-a7f6-25b92111686b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:09 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-45dcb1ff-20f1-4a6e-b7a3-dfba12efd1fd tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] Volume 32fd7b45-3af6-4503-99fa-abe55c390fca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32fd7b45-3af6-4503-99fa-abe55c390fca', 'volume_size': 1} Jul 08 01:48:09 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-45dcb1ff-20f1-4a6e-b7a3-dfba12efd1fd tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:48:09 devstack sudo[94734]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:09 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4e2435b5-7c99-4d1a-8cec-3e210b409742 tempest-GroupsV314Test-651478195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b03a8523-22d3-4465-a733-588c706e138d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b03a8523-22d3-4465-a733-588c706e138d.d4d6b071-f5e4-4d67-b1c1-76968a3ff27a 1G" returned: 0 in 1.181s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:09 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4e2435b5-7c99-4d1a-8cec-3e210b409742 tempest-GroupsV314Test-651478195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b03a8523-22d3-4465-a733-588c706e138d -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b03a8523-22d3-4465-a733-588c706e138d.d4d6b071-f5e4-4d67-b1c1-76968a3ff27a {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:09 devstack sudo[94761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b03a8523-22d3-4465-a733-588c706e138d -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b03a8523-22d3-4465-a733-588c706e138d.d4d6b071-f5e4-4d67-b1c1-76968a3ff27a Jul 08 01:48:09 devstack sudo[94761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:10 devstack sudo[94761]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:10 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4e2435b5-7c99-4d1a-8cec-3e210b409742 tempest-GroupsV314Test-651478195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b03a8523-22d3-4465-a733-588c706e138d -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b03a8523-22d3-4465-a733-588c706e138d.d4d6b071-f5e4-4d67-b1c1-76968a3ff27a" returned: 0 in 0.960s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:10 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-4e2435b5-7c99-4d1a-8cec-3e210b409742 tempest-GroupsV314Test-651478195 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b03a8523-22d3-4465-a733-588c706e138d.d4d6b071-f5e4-4d67-b1c1-76968a3ff27a is being set with open permissions: ugo+rw: NotImplementedError Jul 08 01:48:10 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4e2435b5-7c99-4d1a-8cec-3e210b409742 tempest-GroupsV314Test-651478195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b03a8523-22d3-4465-a733-588c706e138d.d4d6b071-f5e4-4d67-b1c1-76968a3ff27a {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:10 devstack sudo[94768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b03a8523-22d3-4465-a733-588c706e138d.d4d6b071-f5e4-4d67-b1c1-76968a3ff27a Jul 08 01:48:10 devstack sudo[94768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:11 devstack sudo[94768]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:11 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4e2435b5-7c99-4d1a-8cec-3e210b409742 tempest-GroupsV314Test-651478195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b03a8523-22d3-4465-a733-588c706e138d.d4d6b071-f5e4-4d67-b1c1-76968a3ff27a" returned: 0 in 0.932s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:11 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4e2435b5-7c99-4d1a-8cec-3e210b409742 tempest-GroupsV314Test-651478195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b03a8523-22d3-4465-a733-588c706e138d.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:11 devstack sudo[94774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b03a8523-22d3-4465-a733-588c706e138d.info Jul 08 01:48:11 devstack sudo[94774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:12 devstack sudo[94774]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:12 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4e2435b5-7c99-4d1a-8cec-3e210b409742 tempest-GroupsV314Test-651478195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b03a8523-22d3-4465-a733-588c706e138d.info" returned: 0 in 1.163s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:12 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-4e2435b5-7c99-4d1a-8cec-3e210b409742 tempest-GroupsV314Test-651478195 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b03a8523-22d3-4465-a733-588c706e138d.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 01:48:12 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4e2435b5-7c99-4d1a-8cec-3e210b409742 tempest-GroupsV314Test-651478195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b03a8523-22d3-4465-a733-588c706e138d.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:12 devstack sudo[94778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b03a8523-22d3-4465-a733-588c706e138d.info Jul 08 01:48:12 devstack sudo[94778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:13 devstack sudo[94778]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4e2435b5-7c99-4d1a-8cec-3e210b409742 tempest-GroupsV314Test-651478195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b03a8523-22d3-4465-a733-588c706e138d.info" returned: 0 in 0.883s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:13 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-4e2435b5-7c99-4d1a-8cec-3e210b409742 tempest-GroupsV314Test-651478195 None] Acquiring lock "cinder-quobyte-17260fe9-7171-4614-8b77-b5055b09c9c6" by "_copy_volume_from_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:48:13 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-4e2435b5-7c99-4d1a-8cec-3e210b409742 tempest-GroupsV314Test-651478195 None] Lock "cinder-quobyte-17260fe9-7171-4614-8b77-b5055b09c9c6" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:48:13 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-4e2435b5-7c99-4d1a-8cec-3e210b409742 tempest-GroupsV314Test-651478195 None] snapshot: d4d6b071-f5e4-4d67-b1c1-76968a3ff27a, volume: 17260fe9-7171-4614-8b77-b5055b09c9c6, {{(pid=87134) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 01:48:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-4e2435b5-7c99-4d1a-8cec-3e210b409742 tempest-GroupsV314Test-651478195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:48:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-4e2435b5-7c99-4d1a-8cec-3e210b409742 tempest-GroupsV314Test-651478195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:13 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-4e2435b5-7c99-4d1a-8cec-3e210b409742 tempest-GroupsV314Test-651478195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:48:13 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-4e2435b5-7c99-4d1a-8cec-3e210b409742 tempest-GroupsV314Test-651478195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:48:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-4e2435b5-7c99-4d1a-8cec-3e210b409742 tempest-GroupsV314Test-651478195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:13 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[733979c5-a7f3-4345-8374-758a1b9343ce]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:48:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4e2435b5-7c99-4d1a-8cec-3e210b409742 tempest-GroupsV314Test-651478195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b03a8523-22d3-4465-a733-588c706e138d.d4d6b071-f5e4-4d67-b1c1-76968a3ff27a {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:13 devstack sudo[94782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b03a8523-22d3-4465-a733-588c706e138d.d4d6b071-f5e4-4d67-b1c1-76968a3ff27a Jul 08 01:48:13 devstack sudo[94782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:14 devstack sudo[94782]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:14 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4e2435b5-7c99-4d1a-8cec-3e210b409742 tempest-GroupsV314Test-651478195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b03a8523-22d3-4465-a733-588c706e138d.d4d6b071-f5e4-4d67-b1c1-76968a3ff27a" returned: 0 in 1.012s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:14 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-4e2435b5-7c99-4d1a-8cec-3e210b409742 tempest-GroupsV314Test-651478195 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b03a8523-22d3-4465-a733-588c706e138d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:48:14 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-4e2435b5-7c99-4d1a-8cec-3e210b409742 tempest-GroupsV314Test-651478195 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b03a8523-22d3-4465-a733-588c706e138d {{(pid=87134) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 01:48:14 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-4e2435b5-7c99-4d1a-8cec-3e210b409742 tempest-GroupsV314Test-651478195 None] Creating direct copy from snapshot {{(pid=87134) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 01:48:14 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1d7dde-e856-4443-a5a0-51af167daf6c]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:48:14 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4e2435b5-7c99-4d1a-8cec-3e210b409742 tempest-GroupsV314Test-651478195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b03a8523-22d3-4465-a733-588c706e138d {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:14 devstack sudo[94789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b03a8523-22d3-4465-a733-588c706e138d Jul 08 01:48:14 devstack sudo[94789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:15 devstack sudo[94789]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4e2435b5-7c99-4d1a-8cec-3e210b409742 tempest-GroupsV314Test-651478195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b03a8523-22d3-4465-a733-588c706e138d" returned: 0 in 0.955s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:15 devstack cinder-volume[87134]: DEBUG cinder.utils [None req-4e2435b5-7c99-4d1a-8cec-3e210b409742 tempest-GroupsV314Test-651478195 None] Path /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-17260fe9-7171-4614-8b77-b5055b09c9c6 not found in is_blk_device check {{(pid=87134) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 01:48:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4e2435b5-7c99-4d1a-8cec-3e210b409742 tempest-GroupsV314Test-651478195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b03a8523-22d3-4465-a733-588c706e138d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-17260fe9-7171-4614-8b77-b5055b09c9c6 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:15 devstack sudo[94795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b03a8523-22d3-4465-a733-588c706e138d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-17260fe9-7171-4614-8b77-b5055b09c9c6 Jul 08 01:48:15 devstack sudo[94795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:20 devstack cinder-volume[87134]: DEBUG oslo_service.periodic_task [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87134) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:48:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:48:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:20 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:48:20 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:48:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:20 devstack sudo[94808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:48:20 devstack sudo[94808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:21 devstack cinder-volume[87134]: DEBUG dbcounter [-] [87134] Writing DB stats cinder:SELECT=119,cinder:UPDATE=126,cinder:DELETE=5,cinder:INSERT=36 {{(pid=87134) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:48:21 devstack cinder-volume[87134]: DEBUG dbcounter [-] [87134] Writing DB stats cinder:SELECT=121,cinder:UPDATE=117,cinder:INSERT=27,cinder:DELETE=3 {{(pid=87134) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:48:22 devstack sudo[94795]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4e2435b5-7c99-4d1a-8cec-3e210b409742 tempest-GroupsV314Test-651478195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b03a8523-22d3-4465-a733-588c706e138d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-17260fe9-7171-4614-8b77-b5055b09c9c6" returned: 0 in 7.265s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:23 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74d4187-ccb2-436f-b3e1-61086a679f6e]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:48:23 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4e2435b5-7c99-4d1a-8cec-3e210b409742 tempest-GroupsV314Test-651478195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b03a8523-22d3-4465-a733-588c706e138d {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:23 devstack sudo[94808]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:23 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 2.313s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:23 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:48:23 devstack cinder-volume[87134]: DEBUG oslo_service.periodic_task [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running periodic task VolumeManager._thread_info {{(pid=87134) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:48:23 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] thread count: 8 {{(pid=87134) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:48:23 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] thread info: [<_MainThread(MainThread, started 129378964615296)>, , , , , , , ] {{(pid=87134) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:48:23 devstack sudo[94862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b03a8523-22d3-4465-a733-588c706e138d Jul 08 01:48:23 devstack sudo[94862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:24 devstack sudo[94862]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4e2435b5-7c99-4d1a-8cec-3e210b409742 tempest-GroupsV314Test-651478195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b03a8523-22d3-4465-a733-588c706e138d" returned: 0 in 1.074s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:24 devstack cinder-volume[87134]: DEBUG cinder.image.image_utils [None req-4e2435b5-7c99-4d1a-8cec-3e210b409742 tempest-GroupsV314Test-651478195 None] Image conversion details: src /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b03a8523-22d3-4465-a733-588c706e138d, size 1024.00 MB, duration 7.27 sec, destination /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-17260fe9-7171-4614-8b77-b5055b09c9c6 {{(pid=87134) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:48:24 devstack cinder-volume[87134]: INFO cinder.image.image_utils [None req-4e2435b5-7c99-4d1a-8cec-3e210b409742 tempest-GroupsV314Test-651478195 None] Converted 1024.00 MB image at 140.92 MB/s Jul 08 01:48:24 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-4e2435b5-7c99-4d1a-8cec-3e210b409742 tempest-GroupsV314Test-651478195 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-17260fe9-7171-4614-8b77-b5055b09c9c6 is being set with open permissions: ugo+rw: NotImplementedError Jul 08 01:48:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4e2435b5-7c99-4d1a-8cec-3e210b409742 tempest-GroupsV314Test-651478195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-17260fe9-7171-4614-8b77-b5055b09c9c6 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:24 devstack sudo[94867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-17260fe9-7171-4614-8b77-b5055b09c9c6 Jul 08 01:48:24 devstack sudo[94867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:24 devstack sudo[94867]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4e2435b5-7c99-4d1a-8cec-3e210b409742 tempest-GroupsV314Test-651478195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-17260fe9-7171-4614-8b77-b5055b09c9c6" returned: 0 in 0.653s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:24 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-4e2435b5-7c99-4d1a-8cec-3e210b409742 tempest-GroupsV314Test-651478195 None] Lock "cinder-quobyte-17260fe9-7171-4614-8b77-b5055b09c9c6" released by "_copy_volume_from_snapshot" :: held 11.105s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:48:24 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-4e2435b5-7c99-4d1a-8cec-3e210b409742 tempest-GroupsV314Test-651478195 None] Acquiring lock "cinder-quobyte-d4d6b071-f5e4-4d67-b1c1-76968a3ff27a" by "_delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:48:24 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-4e2435b5-7c99-4d1a-8cec-3e210b409742 tempest-GroupsV314Test-651478195 None] Lock "cinder-quobyte-d4d6b071-f5e4-4d67-b1c1-76968a3ff27a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:48:24 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-4e2435b5-7c99-4d1a-8cec-3e210b409742 tempest-GroupsV314Test-651478195 None] Deleting offline snapshot d4d6b071-f5e4-4d67-b1c1-76968a3ff27a of volume b03a8523-22d3-4465-a733-588c706e138d {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:48:24 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-4e2435b5-7c99-4d1a-8cec-3e210b409742 tempest-GroupsV314Test-651478195 None] snapshot_file for this snap is: volume-b03a8523-22d3-4465-a733-588c706e138d.d4d6b071-f5e4-4d67-b1c1-76968a3ff27a {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:48:24 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[20dda8c3-ea8e-42c8-a8a7-d4785c56f1f9]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:48:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4e2435b5-7c99-4d1a-8cec-3e210b409742 tempest-GroupsV314Test-651478195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b03a8523-22d3-4465-a733-588c706e138d.d4d6b071-f5e4-4d67-b1c1-76968a3ff27a {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:24 devstack sudo[94870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b03a8523-22d3-4465-a733-588c706e138d.d4d6b071-f5e4-4d67-b1c1-76968a3ff27a Jul 08 01:48:24 devstack sudo[94870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:25 devstack sudo[94870]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:25 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4e2435b5-7c99-4d1a-8cec-3e210b409742 tempest-GroupsV314Test-651478195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b03a8523-22d3-4465-a733-588c706e138d.d4d6b071-f5e4-4d67-b1c1-76968a3ff27a" returned: 0 in 0.862s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:25 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-4e2435b5-7c99-4d1a-8cec-3e210b409742 tempest-GroupsV314Test-651478195 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b03a8523-22d3-4465-a733-588c706e138d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:48:25 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d3a430-d3c4-4e74-88c0-db1025981241]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:48:25 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4e2435b5-7c99-4d1a-8cec-3e210b409742 tempest-GroupsV314Test-651478195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b03a8523-22d3-4465-a733-588c706e138d {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:25 devstack sudo[94876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b03a8523-22d3-4465-a733-588c706e138d Jul 08 01:48:25 devstack sudo[94876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:25 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c0cba6c-5abc-49fc-b32e-3836bc1e7b87 tempest-VolumeQuotasAdminTestJSON-570935606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:48:25 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-0c0cba6c-5abc-49fc-b32e-3836bc1e7b87 tempest-VolumeQuotasAdminTestJSON-570935606 None] Flow 'volume_create_manager' (5655d578-b664-4159-bca3-765ae7f0d444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:48:25 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-0c0cba6c-5abc-49fc-b32e-3836bc1e7b87 tempest-VolumeQuotasAdminTestJSON-570935606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73808e82-242e-4d35-8aa2-90d0db48d5a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:25 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-0c0cba6c-5abc-49fc-b32e-3836bc1e7b87 tempest-VolumeQuotasAdminTestJSON-570935606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73808e82-242e-4d35-8aa2-90d0db48d5a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:48:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1766825304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db9f70d3-31d4-4c82-b14b-d08d7fc54dd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d2c69a123ce4fe6a36ce6abe64812f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:48:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:48:26Z,use_quota=True,user_id='0c0ea878984d4a9f9909925e70515429',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:25 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-0c0cba6c-5abc-49fc-b32e-3836bc1e7b87 tempest-VolumeQuotasAdminTestJSON-570935606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8304740d-3d88-4419-bd47-d72cf4ced68e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:25 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-0c0cba6c-5abc-49fc-b32e-3836bc1e7b87 tempest-VolumeQuotasAdminTestJSON-570935606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8304740d-3d88-4419-bd47-d72cf4ced68e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:25 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-0c0cba6c-5abc-49fc-b32e-3836bc1e7b87 tempest-VolumeQuotasAdminTestJSON-570935606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (608b9ae2-8c9b-4188-a86e-cca6c98b626d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:25 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-0c0cba6c-5abc-49fc-b32e-3836bc1e7b87 tempest-VolumeQuotasAdminTestJSON-570935606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (608b9ae2-8c9b-4188-a86e-cca6c98b626d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db9f70d3-31d4-4c82-b14b-d08d7fc54dd9', 'volume_name': 'volume-db9f70d3-31d4-4c82-b14b-d08d7fc54dd9', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:25 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-0c0cba6c-5abc-49fc-b32e-3836bc1e7b87 tempest-VolumeQuotasAdminTestJSON-570935606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42323167-fa9e-41b3-b06d-1b2bde95032d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:25 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-0c0cba6c-5abc-49fc-b32e-3836bc1e7b87 tempest-VolumeQuotasAdminTestJSON-570935606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42323167-fa9e-41b3-b06d-1b2bde95032d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:25 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-0c0cba6c-5abc-49fc-b32e-3836bc1e7b87 tempest-VolumeQuotasAdminTestJSON-570935606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27eb93ef-c24d-493d-9887-092b0be3f1f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:25 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-0c0cba6c-5abc-49fc-b32e-3836bc1e7b87 tempest-VolumeQuotasAdminTestJSON-570935606 None] Volume db9f70d3-31d4-4c82-b14b-d08d7fc54dd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db9f70d3-31d4-4c82-b14b-d08d7fc54dd9', 'volume_size': 1} Jul 08 01:48:25 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-0c0cba6c-5abc-49fc-b32e-3836bc1e7b87 tempest-VolumeQuotasAdminTestJSON-570935606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:48:26 devstack sudo[94876]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:26 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4e2435b5-7c99-4d1a-8cec-3e210b409742 tempest-GroupsV314Test-651478195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b03a8523-22d3-4465-a733-588c706e138d" returned: 0 in 0.764s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:26 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4e2435b5-7c99-4d1a-8cec-3e210b409742 tempest-GroupsV314Test-651478195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b03a8523-22d3-4465-a733-588c706e138d.d4d6b071-f5e4-4d67-b1c1-76968a3ff27a {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:26 devstack sudo[94881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b03a8523-22d3-4465-a733-588c706e138d.d4d6b071-f5e4-4d67-b1c1-76968a3ff27a Jul 08 01:48:26 devstack sudo[94881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:27 devstack sudo[94881]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:27 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4e2435b5-7c99-4d1a-8cec-3e210b409742 tempest-GroupsV314Test-651478195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b03a8523-22d3-4465-a733-588c706e138d.d4d6b071-f5e4-4d67-b1c1-76968a3ff27a" returned: 0 in 0.768s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:27 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4e2435b5-7c99-4d1a-8cec-3e210b409742 tempest-GroupsV314Test-651478195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b03a8523-22d3-4465-a733-588c706e138d.d4d6b071-f5e4-4d67-b1c1-76968a3ff27a {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:27 devstack sudo[94886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b03a8523-22d3-4465-a733-588c706e138d.d4d6b071-f5e4-4d67-b1c1-76968a3ff27a Jul 08 01:48:27 devstack sudo[94886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:27 devstack sudo[94886]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:27 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4e2435b5-7c99-4d1a-8cec-3e210b409742 tempest-GroupsV314Test-651478195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b03a8523-22d3-4465-a733-588c706e138d.d4d6b071-f5e4-4d67-b1c1-76968a3ff27a" returned: 0 in 0.711s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:28 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-4e2435b5-7c99-4d1a-8cec-3e210b409742 tempest-GroupsV314Test-651478195 None] Lock "cinder-quobyte-d4d6b071-f5e4-4d67-b1c1-76968a3ff27a" released by "_delete_snapshot" :: held 3.208s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:48:28 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-4e2435b5-7c99-4d1a-8cec-3e210b409742 tempest-GroupsV314Test-651478195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 21.160s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:28 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-45dcb1ff-20f1-4a6e-b7a3-dfba12efd1fd tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.931s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:28 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-45dcb1ff-20f1-4a6e-b7a3-dfba12efd1fd tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:48:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1884443836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32fd7b45-3af6-4503-99fa-abe55c390fca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb1dea9e48cd4932bb0bcdccd4b4efed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:48:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:48:09Z,use_quota=True,user_id='cb1c8de7079b4b4b88483c6e5522dfb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:48:28 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-45dcb1ff-20f1-4a6e-b7a3-dfba12efd1fd tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] Creating volume 32fd7b45-3af6-4503-99fa-abe55c390fca {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:48:28 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-45dcb1ff-20f1-4a6e-b7a3-dfba12efd1fd tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:48:28 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-45dcb1ff-20f1-4a6e-b7a3-dfba12efd1fd tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:28 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-45dcb1ff-20f1-4a6e-b7a3-dfba12efd1fd tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:48:28 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-45dcb1ff-20f1-4a6e-b7a3-dfba12efd1fd tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:48:28 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-45dcb1ff-20f1-4a6e-b7a3-dfba12efd1fd tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:28 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-45dcb1ff-20f1-4a6e-b7a3-dfba12efd1fd tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:48:28 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-45dcb1ff-20f1-4a6e-b7a3-dfba12efd1fd tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:48:28 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-45dcb1ff-20f1-4a6e-b7a3-dfba12efd1fd tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-32fd7b45-3af6-4503-99fa-abe55c390fca 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:28 devstack sudo[94889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-32fd7b45-3af6-4503-99fa-abe55c390fca 1073741824 Jul 08 01:48:28 devstack sudo[94889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:28 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-4e2435b5-7c99-4d1a-8cec-3e210b409742 tempest-GroupsV314Test-651478195 None] Create group from source-group-9095c495-5827-4441-9648-7a7ed2cd43ed completed successfully. Jul 08 01:48:29 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-f97571f4-4fa7-413f-a50b-ff1457f621ca tempest-GroupsV314Test-651478195 None] Acquiring lock "cinder-quobyte-17260fe9-7171-4614-8b77-b5055b09c9c6" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:48:29 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-f97571f4-4fa7-413f-a50b-ff1457f621ca tempest-GroupsV314Test-651478195 None] Lock "cinder-quobyte-17260fe9-7171-4614-8b77-b5055b09c9c6" acquired by "delete_volume" :: waited 0.025s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:48:29 devstack sudo[94889]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-45dcb1ff-20f1-4a6e-b7a3-dfba12efd1fd tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-32fd7b45-3af6-4503-99fa-abe55c390fca 1073741824" returned: 0 in 1.031s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:29 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ef4724-2b6e-465f-810b-a7af5a1276eb]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:48:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f97571f4-4fa7-413f-a50b-ff1457f621ca tempest-GroupsV314Test-651478195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-17260fe9-7171-4614-8b77-b5055b09c9c6 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-45dcb1ff-20f1-4a6e-b7a3-dfba12efd1fd tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-32fd7b45-3af6-4503-99fa-abe55c390fca {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:29 devstack sudo[94896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-32fd7b45-3af6-4503-99fa-abe55c390fca Jul 08 01:48:29 devstack sudo[94896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:29 devstack sudo[94895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-17260fe9-7171-4614-8b77-b5055b09c9c6 Jul 08 01:48:29 devstack sudo[94895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:29 devstack sudo[94896]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-45dcb1ff-20f1-4a6e-b7a3-dfba12efd1fd tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-32fd7b45-3af6-4503-99fa-abe55c390fca" returned: 0 in 0.740s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:29 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-45dcb1ff-20f1-4a6e-b7a3-dfba12efd1fd tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] <== create_volume: return (1827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:48:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-45dcb1ff-20f1-4a6e-b7a3-dfba12efd1fd tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.829s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-0c0cba6c-5abc-49fc-b32e-3836bc1e7b87 tempest-VolumeQuotasAdminTestJSON-570935606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.901s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:29 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-0c0cba6c-5abc-49fc-b32e-3836bc1e7b87 tempest-VolumeQuotasAdminTestJSON-570935606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:48:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1766825304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db9f70d3-31d4-4c82-b14b-d08d7fc54dd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d2c69a123ce4fe6a36ce6abe64812f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:48:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:48:26Z,use_quota=True,user_id='0c0ea878984d4a9f9909925e70515429',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:48:29 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-0c0cba6c-5abc-49fc-b32e-3836bc1e7b87 tempest-VolumeQuotasAdminTestJSON-570935606 None] Creating volume db9f70d3-31d4-4c82-b14b-d08d7fc54dd9 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:48:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-0c0cba6c-5abc-49fc-b32e-3836bc1e7b87 tempest-VolumeQuotasAdminTestJSON-570935606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:48:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-0c0cba6c-5abc-49fc-b32e-3836bc1e7b87 tempest-VolumeQuotasAdminTestJSON-570935606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:29 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-0c0cba6c-5abc-49fc-b32e-3836bc1e7b87 tempest-VolumeQuotasAdminTestJSON-570935606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:48:29 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-0c0cba6c-5abc-49fc-b32e-3836bc1e7b87 tempest-VolumeQuotasAdminTestJSON-570935606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:48:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-0c0cba6c-5abc-49fc-b32e-3836bc1e7b87 tempest-VolumeQuotasAdminTestJSON-570935606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:29 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-0c0cba6c-5abc-49fc-b32e-3836bc1e7b87 tempest-VolumeQuotasAdminTestJSON-570935606 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:48:29 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-0c0cba6c-5abc-49fc-b32e-3836bc1e7b87 tempest-VolumeQuotasAdminTestJSON-570935606 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:48:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-0c0cba6c-5abc-49fc-b32e-3836bc1e7b87 tempest-VolumeQuotasAdminTestJSON-570935606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-db9f70d3-31d4-4c82-b14b-d08d7fc54dd9 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:29 devstack sudo[94903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-db9f70d3-31d4-4c82-b14b-d08d7fc54dd9 1073741824 Jul 08 01:48:29 devstack sudo[94903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:29 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-45dcb1ff-20f1-4a6e-b7a3-dfba12efd1fd tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c499b46b-4a7f-48e2-a7f6-25b92111686b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32fd7b45-3af6-4503-99fa-abe55c390fca', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:29 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-45dcb1ff-20f1-4a6e-b7a3-dfba12efd1fd tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0397eb0-1b5d-4a4b-99fc-88e66c922eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:29 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-45dcb1ff-20f1-4a6e-b7a3-dfba12efd1fd tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] Volume volume-32fd7b45-3af6-4503-99fa-abe55c390fca (32fd7b45-3af6-4503-99fa-abe55c390fca): created successfully Jul 08 01:48:29 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-45dcb1ff-20f1-4a6e-b7a3-dfba12efd1fd tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0397eb0-1b5d-4a4b-99fc-88e66c922eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:29 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-45dcb1ff-20f1-4a6e-b7a3-dfba12efd1fd tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] Flow 'volume_create_manager' (ea45c450-eada-4503-a1e8-a59b7c1e5410) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:48:29 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-45dcb1ff-20f1-4a6e-b7a3-dfba12efd1fd tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] Created volume successfully. Jul 08 01:48:30 devstack sudo[94895]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f97571f4-4fa7-413f-a50b-ff1457f621ca tempest-GroupsV314Test-651478195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-17260fe9-7171-4614-8b77-b5055b09c9c6" returned: 0 in 0.938s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f97571f4-4fa7-413f-a50b-ff1457f621ca tempest-GroupsV314Test-651478195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-17260fe9-7171-4614-8b77-b5055b09c9c6 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:30 devstack sudo[94905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-17260fe9-7171-4614-8b77-b5055b09c9c6 Jul 08 01:48:30 devstack sudo[94905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:30 devstack sudo[94905]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f97571f4-4fa7-413f-a50b-ff1457f621ca tempest-GroupsV314Test-651478195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-17260fe9-7171-4614-8b77-b5055b09c9c6" returned: 0 in 0.672s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:30 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-f97571f4-4fa7-413f-a50b-ff1457f621ca tempest-GroupsV314Test-651478195 None] Lock "cinder-quobyte-17260fe9-7171-4614-8b77-b5055b09c9c6" released by "delete_volume" :: held 1.667s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:48:30 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-f97571f4-4fa7-413f-a50b-ff1457f621ca tempest-GroupsV314Test-651478195 None] Created reservations ['034672e1-30e3-481f-b07d-ce3f5e0b45ed'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:48:30 devstack cinder-volume[87134]: WARNING cinder.quota [None req-f97571f4-4fa7-413f-a50b-ff1457f621ca tempest-GroupsV314Test-651478195 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1970275365 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1970275365, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:48:30 devstack cinder-volume[87134]: WARNING cinder.quota [None req-f97571f4-4fa7-413f-a50b-ff1457f621ca tempest-GroupsV314Test-651478195 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1970275365 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1970275365, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:48:30 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-f97571f4-4fa7-413f-a50b-ff1457f621ca tempest-GroupsV314Test-651478195 None] Created reservations ['50a80651-2051-4cc4-a95f-e0bd5ffbc008', '01bfc899-b072-4a55-8c62-8d40ff71780b', '3654e655-f0c4-489f-bd24-2357c7b57dce', '98408b17-7819-49d8-a910-fa6ca7a70843'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:48:30 devstack sudo[94903]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-0c0cba6c-5abc-49fc-b32e-3836bc1e7b87 tempest-VolumeQuotasAdminTestJSON-570935606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-db9f70d3-31d4-4c82-b14b-d08d7fc54dd9 1073741824" returned: 0 in 1.035s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-0c0cba6c-5abc-49fc-b32e-3836bc1e7b87 tempest-VolumeQuotasAdminTestJSON-570935606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-db9f70d3-31d4-4c82-b14b-d08d7fc54dd9 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7bc47271-d875-4e76-ba9e-79757bb6782c tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:48:31 devstack sudo[94919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-db9f70d3-31d4-4c82-b14b-d08d7fc54dd9 Jul 08 01:48:31 devstack sudo[94919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-f97571f4-4fa7-413f-a50b-ff1457f621ca tempest-GroupsV314Test-651478195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:48:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-f97571f4-4fa7-413f-a50b-ff1457f621ca tempest-GroupsV314Test-651478195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:31 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-f97571f4-4fa7-413f-a50b-ff1457f621ca tempest-GroupsV314Test-651478195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:48:31 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-f97571f4-4fa7-413f-a50b-ff1457f621ca tempest-GroupsV314Test-651478195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:48:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-f97571f4-4fa7-413f-a50b-ff1457f621ca tempest-GroupsV314Test-651478195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f97571f4-4fa7-413f-a50b-ff1457f621ca tempest-GroupsV314Test-651478195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:31 devstack sudo[94921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:48:31 devstack sudo[94921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:31 devstack sudo[94919]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-0c0cba6c-5abc-49fc-b32e-3836bc1e7b87 tempest-VolumeQuotasAdminTestJSON-570935606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-db9f70d3-31d4-4c82-b14b-d08d7fc54dd9" returned: 0 in 0.740s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:31 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-0c0cba6c-5abc-49fc-b32e-3836bc1e7b87 tempest-VolumeQuotasAdminTestJSON-570935606 None] <== create_volume: return (1937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:48:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-0c0cba6c-5abc-49fc-b32e-3836bc1e7b87 tempest-VolumeQuotasAdminTestJSON-570935606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.940s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7bc47271-d875-4e76-ba9e-79757bb6782c tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.733s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:31 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-e8169208-4c08-4a14-b6a7-ee71e31bf64c tempest-GroupsV314Test-651478195 None] Acquiring lock "cinder-quobyte-b03a8523-22d3-4465-a733-588c706e138d" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:48:31 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-7bc47271-d875-4e76-ba9e-79757bb6782c tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] Creating offline snapshot 8d968488-66ea-4aac-8075-5345e3d4049f of volume 32fd7b45-3af6-4503-99fa-abe55c390fca {{(pid=87134) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:48:31 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-0c0cba6c-5abc-49fc-b32e-3836bc1e7b87 tempest-VolumeQuotasAdminTestJSON-570935606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27eb93ef-c24d-493d-9887-092b0be3f1f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db9f70d3-31d4-4c82-b14b-d08d7fc54dd9', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:31 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-0c0cba6c-5abc-49fc-b32e-3836bc1e7b87 tempest-VolumeQuotasAdminTestJSON-570935606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5b63d01-4c0d-495c-807d-d566d75005df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:31 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[d074cff4-0195-4f82-98a4-8b57164e2384]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:48:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7bc47271-d875-4e76-ba9e-79757bb6782c tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-32fd7b45-3af6-4503-99fa-abe55c390fca {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:31 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-0c0cba6c-5abc-49fc-b32e-3836bc1e7b87 tempest-VolumeQuotasAdminTestJSON-570935606 None] Volume volume-db9f70d3-31d4-4c82-b14b-d08d7fc54dd9 (db9f70d3-31d4-4c82-b14b-d08d7fc54dd9): created successfully Jul 08 01:48:31 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-0c0cba6c-5abc-49fc-b32e-3836bc1e7b87 tempest-VolumeQuotasAdminTestJSON-570935606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5b63d01-4c0d-495c-807d-d566d75005df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:31 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-0c0cba6c-5abc-49fc-b32e-3836bc1e7b87 tempest-VolumeQuotasAdminTestJSON-570935606 None] Flow 'volume_create_manager' (5655d578-b664-4159-bca3-765ae7f0d444) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:48:31 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-e8169208-4c08-4a14-b6a7-ee71e31bf64c tempest-GroupsV314Test-651478195 None] Lock "cinder-quobyte-b03a8523-22d3-4465-a733-588c706e138d" acquired by "delete_volume" :: waited 0.076s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:48:31 devstack sudo[94921]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f97571f4-4fa7-413f-a50b-ff1457f621ca tempest-GroupsV314Test-651478195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.814s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:31 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-f97571f4-4fa7-413f-a50b-ff1457f621ca tempest-GroupsV314Test-651478195 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:48:31 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-f97571f4-4fa7-413f-a50b-ff1457f621ca tempest-GroupsV314Test-651478195 None] Delete group completed successfully. Jul 08 01:48:31 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-0c0cba6c-5abc-49fc-b32e-3836bc1e7b87 tempest-VolumeQuotasAdminTestJSON-570935606 None] Created volume successfully. Jul 08 01:48:31 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[3782a0ce-8839-41d4-80bb-c25e0e8c482b]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:48:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e8169208-4c08-4a14-b6a7-ee71e31bf64c tempest-GroupsV314Test-651478195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b03a8523-22d3-4465-a733-588c706e138d {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:31 devstack sudo[94925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-32fd7b45-3af6-4503-99fa-abe55c390fca Jul 08 01:48:31 devstack sudo[94925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:32 devstack sudo[94926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b03a8523-22d3-4465-a733-588c706e138d Jul 08 01:48:32 devstack sudo[94926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:32 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-0eaca6ce-4ab9-47c4-8478-b6cb7463ac25 tempest-VolumeQuotasAdminTestJSON-570935606 None] Acquiring lock "cinder-db9f70d3-31d4-4c82-b14b-d08d7fc54dd9-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:48:32 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-0eaca6ce-4ab9-47c4-8478-b6cb7463ac25 tempest-VolumeQuotasAdminTestJSON-570935606 None] Lock "cinder-db9f70d3-31d4-4c82-b14b-d08d7fc54dd9-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:48:32 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-0eaca6ce-4ab9-47c4-8478-b6cb7463ac25 tempest-VolumeQuotasAdminTestJSON-570935606 None] Acquiring lock "cinder-quobyte-db9f70d3-31d4-4c82-b14b-d08d7fc54dd9" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:48:32 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-0eaca6ce-4ab9-47c4-8478-b6cb7463ac25 tempest-VolumeQuotasAdminTestJSON-570935606 None] Lock "cinder-quobyte-db9f70d3-31d4-4c82-b14b-d08d7fc54dd9" acquired by "delete_volume" :: waited 0.017s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:48:32 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[33511f45-8e87-4929-9da5-8c4cb72599e2]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:48:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-0eaca6ce-4ab9-47c4-8478-b6cb7463ac25 tempest-VolumeQuotasAdminTestJSON-570935606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-db9f70d3-31d4-4c82-b14b-d08d7fc54dd9 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:32 devstack sudo[94930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-db9f70d3-31d4-4c82-b14b-d08d7fc54dd9 Jul 08 01:48:32 devstack sudo[94930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:32 devstack sudo[94925]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7bc47271-d875-4e76-ba9e-79757bb6782c tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-32fd7b45-3af6-4503-99fa-abe55c390fca" returned: 0 in 0.873s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7bc47271-d875-4e76-ba9e-79757bb6782c tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-32fd7b45-3af6-4503-99fa-abe55c390fca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-32fd7b45-3af6-4503-99fa-abe55c390fca.8d968488-66ea-4aac-8075-5345e3d4049f 1G {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:32 devstack sudo[94938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-32fd7b45-3af6-4503-99fa-abe55c390fca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-32fd7b45-3af6-4503-99fa-abe55c390fca.8d968488-66ea-4aac-8075-5345e3d4049f 1G Jul 08 01:48:32 devstack sudo[94938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:32 devstack sudo[94926]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e8169208-4c08-4a14-b6a7-ee71e31bf64c tempest-GroupsV314Test-651478195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b03a8523-22d3-4465-a733-588c706e138d" returned: 0 in 0.845s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e8169208-4c08-4a14-b6a7-ee71e31bf64c tempest-GroupsV314Test-651478195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b03a8523-22d3-4465-a733-588c706e138d {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:32 devstack sudo[94940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b03a8523-22d3-4465-a733-588c706e138d Jul 08 01:48:32 devstack sudo[94940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:33 devstack sudo[94930]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-0eaca6ce-4ab9-47c4-8478-b6cb7463ac25 tempest-VolumeQuotasAdminTestJSON-570935606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-db9f70d3-31d4-4c82-b14b-d08d7fc54dd9" returned: 0 in 0.838s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-0eaca6ce-4ab9-47c4-8478-b6cb7463ac25 tempest-VolumeQuotasAdminTestJSON-570935606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-db9f70d3-31d4-4c82-b14b-d08d7fc54dd9 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:33 devstack sudo[94945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-db9f70d3-31d4-4c82-b14b-d08d7fc54dd9 Jul 08 01:48:33 devstack sudo[94945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:33 devstack sudo[94940]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e8169208-4c08-4a14-b6a7-ee71e31bf64c tempest-GroupsV314Test-651478195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b03a8523-22d3-4465-a733-588c706e138d" returned: 0 in 0.724s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:33 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-e8169208-4c08-4a14-b6a7-ee71e31bf64c tempest-GroupsV314Test-651478195 None] Lock "cinder-quobyte-b03a8523-22d3-4465-a733-588c706e138d" released by "delete_volume" :: held 1.678s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:48:33 devstack sudo[94938]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7bc47271-d875-4e76-ba9e-79757bb6782c tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-32fd7b45-3af6-4503-99fa-abe55c390fca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-32fd7b45-3af6-4503-99fa-abe55c390fca.8d968488-66ea-4aac-8075-5345e3d4049f 1G" returned: 0 in 0.880s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7bc47271-d875-4e76-ba9e-79757bb6782c tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32fd7b45-3af6-4503-99fa-abe55c390fca -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-32fd7b45-3af6-4503-99fa-abe55c390fca.8d968488-66ea-4aac-8075-5345e3d4049f {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:33 devstack sudo[94953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32fd7b45-3af6-4503-99fa-abe55c390fca -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-32fd7b45-3af6-4503-99fa-abe55c390fca.8d968488-66ea-4aac-8075-5345e3d4049f Jul 08 01:48:33 devstack sudo[94953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:33 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-e8169208-4c08-4a14-b6a7-ee71e31bf64c tempest-GroupsV314Test-651478195 None] Created reservations ['485f4a98-2fc7-4c32-924b-1de73cda59db'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:48:33 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-e8169208-4c08-4a14-b6a7-ee71e31bf64c tempest-GroupsV314Test-651478195 None] Created reservations ['81b80e02-1693-41de-a646-448733868e8e', 'ec875035-946b-471c-bf02-7f2e45a86b95', '795bf834-87f6-4e1a-bb4e-ce5d38efedc8', '1b10a5d0-ac96-4a08-a395-5db39cb0b9a8'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:48:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e8169208-4c08-4a14-b6a7-ee71e31bf64c tempest-GroupsV314Test-651478195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:48:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e8169208-4c08-4a14-b6a7-ee71e31bf64c tempest-GroupsV314Test-651478195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:33 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-e8169208-4c08-4a14-b6a7-ee71e31bf64c tempest-GroupsV314Test-651478195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:48:33 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-e8169208-4c08-4a14-b6a7-ee71e31bf64c tempest-GroupsV314Test-651478195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:48:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e8169208-4c08-4a14-b6a7-ee71e31bf64c tempest-GroupsV314Test-651478195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e8169208-4c08-4a14-b6a7-ee71e31bf64c tempest-GroupsV314Test-651478195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:33 devstack sudo[94956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:48:33 devstack sudo[94956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:33 devstack sudo[94945]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-0eaca6ce-4ab9-47c4-8478-b6cb7463ac25 tempest-VolumeQuotasAdminTestJSON-570935606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-db9f70d3-31d4-4c82-b14b-d08d7fc54dd9" returned: 0 in 0.788s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:33 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-0eaca6ce-4ab9-47c4-8478-b6cb7463ac25 tempest-VolumeQuotasAdminTestJSON-570935606 None] Lock "cinder-quobyte-db9f70d3-31d4-4c82-b14b-d08d7fc54dd9" released by "delete_volume" :: held 1.680s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:48:34 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-0eaca6ce-4ab9-47c4-8478-b6cb7463ac25 tempest-VolumeQuotasAdminTestJSON-570935606 None] Created reservations ['8537c38e-de50-48c7-a7a3-466678635b46', '3d8bfd9e-23bb-456b-a387-6b4de5081deb', '1eed4feb-b61b-4d0a-8273-8009d1173d7a', 'd58574c9-c513-4d1b-a7c4-921bb5b652db'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:48:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-0eaca6ce-4ab9-47c4-8478-b6cb7463ac25 tempest-VolumeQuotasAdminTestJSON-570935606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:48:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-0eaca6ce-4ab9-47c4-8478-b6cb7463ac25 tempest-VolumeQuotasAdminTestJSON-570935606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:34 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-0eaca6ce-4ab9-47c4-8478-b6cb7463ac25 tempest-VolumeQuotasAdminTestJSON-570935606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:48:34 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-0eaca6ce-4ab9-47c4-8478-b6cb7463ac25 tempest-VolumeQuotasAdminTestJSON-570935606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:48:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-0eaca6ce-4ab9-47c4-8478-b6cb7463ac25 tempest-VolumeQuotasAdminTestJSON-570935606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-0eaca6ce-4ab9-47c4-8478-b6cb7463ac25 tempest-VolumeQuotasAdminTestJSON-570935606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:34 devstack sudo[94958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:48:34 devstack sudo[94958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:34 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c358abf-74e5-4920-a5a0-1f5f860ea3af tempest-AttachVolumeNegativeTest-677114920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:48:34 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-4c358abf-74e5-4920-a5a0-1f5f860ea3af tempest-AttachVolumeNegativeTest-677114920 None] Flow 'volume_create_manager' (606c5a8e-8381-49b9-a87d-4399807680f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:48:34 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-4c358abf-74e5-4920-a5a0-1f5f860ea3af tempest-AttachVolumeNegativeTest-677114920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba65826f-d727-4ed3-962e-6cb1961b2222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:34 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-4c358abf-74e5-4920-a5a0-1f5f860ea3af tempest-AttachVolumeNegativeTest-677114920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba65826f-d727-4ed3-962e-6cb1961b2222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:48:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-130448587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22712370-5615-4367-be20-43de0edd73b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d7bf0ee4dd241ae89007f93f5fbefaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:48:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:48:34Z,use_quota=True,user_id='26133f3fc0794c73a867ebf2d1393d53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:34 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-4c358abf-74e5-4920-a5a0-1f5f860ea3af tempest-AttachVolumeNegativeTest-677114920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0310a63f-98f7-47a1-95a0-cda1ef158a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:34 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-4c358abf-74e5-4920-a5a0-1f5f860ea3af tempest-AttachVolumeNegativeTest-677114920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0310a63f-98f7-47a1-95a0-cda1ef158a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:34 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-4c358abf-74e5-4920-a5a0-1f5f860ea3af tempest-AttachVolumeNegativeTest-677114920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53123cb6-8e2c-437e-a5d6-3c2cdb9221f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:34 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-4c358abf-74e5-4920-a5a0-1f5f860ea3af tempest-AttachVolumeNegativeTest-677114920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53123cb6-8e2c-437e-a5d6-3c2cdb9221f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22712370-5615-4367-be20-43de0edd73b6', 'volume_name': 'volume-22712370-5615-4367-be20-43de0edd73b6', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:34 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-4c358abf-74e5-4920-a5a0-1f5f860ea3af tempest-AttachVolumeNegativeTest-677114920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f04aa7e6-5fc0-45ae-ac79-528566cd56e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:34 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-4c358abf-74e5-4920-a5a0-1f5f860ea3af tempest-AttachVolumeNegativeTest-677114920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f04aa7e6-5fc0-45ae-ac79-528566cd56e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:34 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-4c358abf-74e5-4920-a5a0-1f5f860ea3af tempest-AttachVolumeNegativeTest-677114920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37e75f15-5d42-4cd5-9827-1599d3f18caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:34 devstack sudo[94953]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:34 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-4c358abf-74e5-4920-a5a0-1f5f860ea3af tempest-AttachVolumeNegativeTest-677114920 None] Volume 22712370-5615-4367-be20-43de0edd73b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22712370-5615-4367-be20-43de0edd73b6', 'volume_size': 1} Jul 08 01:48:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-4c358abf-74e5-4920-a5a0-1f5f860ea3af tempest-AttachVolumeNegativeTest-677114920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:48:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7bc47271-d875-4e76-ba9e-79757bb6782c tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32fd7b45-3af6-4503-99fa-abe55c390fca -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-32fd7b45-3af6-4503-99fa-abe55c390fca.8d968488-66ea-4aac-8075-5345e3d4049f" returned: 0 in 1.127s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:34 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-7bc47271-d875-4e76-ba9e-79757bb6782c tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-32fd7b45-3af6-4503-99fa-abe55c390fca.8d968488-66ea-4aac-8075-5345e3d4049f is being set with open permissions: ugo+rw Jul 08 01:48:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7bc47271-d875-4e76-ba9e-79757bb6782c tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-32fd7b45-3af6-4503-99fa-abe55c390fca.8d968488-66ea-4aac-8075-5345e3d4049f {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:34 devstack sudo[94963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-32fd7b45-3af6-4503-99fa-abe55c390fca.8d968488-66ea-4aac-8075-5345e3d4049f Jul 08 01:48:34 devstack sudo[94963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:34 devstack sudo[94956]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e8169208-4c08-4a14-b6a7-ee71e31bf64c tempest-GroupsV314Test-651478195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 1.104s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:34 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-e8169208-4c08-4a14-b6a7-ee71e31bf64c tempest-GroupsV314Test-651478195 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:48:35 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-e8169208-4c08-4a14-b6a7-ee71e31bf64c tempest-GroupsV314Test-651478195 None] Delete group completed successfully. Jul 08 01:48:35 devstack sudo[94958]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-0eaca6ce-4ab9-47c4-8478-b6cb7463ac25 tempest-VolumeQuotasAdminTestJSON-570935606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.996s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:35 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-0eaca6ce-4ab9-47c4-8478-b6cb7463ac25 tempest-VolumeQuotasAdminTestJSON-570935606 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:48:35 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-0eaca6ce-4ab9-47c4-8478-b6cb7463ac25 tempest-VolumeQuotasAdminTestJSON-570935606 None] Deleted volume successfully. Jul 08 01:48:35 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-0eaca6ce-4ab9-47c4-8478-b6cb7463ac25 tempest-VolumeQuotasAdminTestJSON-570935606 None] Lock "cinder-db9f70d3-31d4-4c82-b14b-d08d7fc54dd9-delete_volume" released by "delete_volume" :: held 3.009s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:48:35 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ae8cf5e-b2eb-4dc4-8579-645e94b38c69 tempest-VolumeQuotasAdminTestJSON-570935606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:48:35 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1ae8cf5e-b2eb-4dc4-8579-645e94b38c69 tempest-VolumeQuotasAdminTestJSON-570935606 None] Flow 'volume_create_manager' (e67d75a2-1cd7-423b-a346-4f94b06147f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:48:35 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1ae8cf5e-b2eb-4dc4-8579-645e94b38c69 tempest-VolumeQuotasAdminTestJSON-570935606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a927122-65a1-4c2f-9855-51d24099c9fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:35 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1ae8cf5e-b2eb-4dc4-8579-645e94b38c69 tempest-VolumeQuotasAdminTestJSON-570935606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a927122-65a1-4c2f-9855-51d24099c9fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:48:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-734645921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c7c721f-f0d5-4e14-ae9a-fb4d3dfe235d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d2c69a123ce4fe6a36ce6abe64812f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:48:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:48:35Z,use_quota=True,user_id='0c0ea878984d4a9f9909925e70515429',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:35 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1ae8cf5e-b2eb-4dc4-8579-645e94b38c69 tempest-VolumeQuotasAdminTestJSON-570935606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fea6128-b05f-4621-96d5-01ee7a9dfb06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:35 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1ae8cf5e-b2eb-4dc4-8579-645e94b38c69 tempest-VolumeQuotasAdminTestJSON-570935606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fea6128-b05f-4621-96d5-01ee7a9dfb06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:35 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1ae8cf5e-b2eb-4dc4-8579-645e94b38c69 tempest-VolumeQuotasAdminTestJSON-570935606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f503ccd8-8cac-4a23-a3ed-8ac0a0a1975e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:35 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1ae8cf5e-b2eb-4dc4-8579-645e94b38c69 tempest-VolumeQuotasAdminTestJSON-570935606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f503ccd8-8cac-4a23-a3ed-8ac0a0a1975e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c7c721f-f0d5-4e14-ae9a-fb4d3dfe235d', 'volume_name': 'volume-3c7c721f-f0d5-4e14-ae9a-fb4d3dfe235d', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:35 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1ae8cf5e-b2eb-4dc4-8579-645e94b38c69 tempest-VolumeQuotasAdminTestJSON-570935606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c98e49a7-9e82-4616-a9e0-44b8e664fb6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:35 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1ae8cf5e-b2eb-4dc4-8579-645e94b38c69 tempest-VolumeQuotasAdminTestJSON-570935606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c98e49a7-9e82-4616-a9e0-44b8e664fb6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:35 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1ae8cf5e-b2eb-4dc4-8579-645e94b38c69 tempest-VolumeQuotasAdminTestJSON-570935606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (870f9c5a-a8dc-4f58-a955-1895a2c65287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:35 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-1ae8cf5e-b2eb-4dc4-8579-645e94b38c69 tempest-VolumeQuotasAdminTestJSON-570935606 None] Volume 3c7c721f-f0d5-4e14-ae9a-fb4d3dfe235d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c7c721f-f0d5-4e14-ae9a-fb4d3dfe235d', 'volume_size': 1} Jul 08 01:48:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-1ae8cf5e-b2eb-4dc4-8579-645e94b38c69 tempest-VolumeQuotasAdminTestJSON-570935606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:48:35 devstack sudo[94963]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7bc47271-d875-4e76-ba9e-79757bb6782c tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-32fd7b45-3af6-4503-99fa-abe55c390fca.8d968488-66ea-4aac-8075-5345e3d4049f" returned: 0 in 0.920s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7bc47271-d875-4e76-ba9e-79757bb6782c tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-32fd7b45-3af6-4503-99fa-abe55c390fca.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:35 devstack sudo[94968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-32fd7b45-3af6-4503-99fa-abe55c390fca.info Jul 08 01:48:35 devstack sudo[94968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:36 devstack sudo[94968]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7bc47271-d875-4e76-ba9e-79757bb6782c tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-32fd7b45-3af6-4503-99fa-abe55c390fca.info" returned: 0 in 0.733s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:36 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-7bc47271-d875-4e76-ba9e-79757bb6782c tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-32fd7b45-3af6-4503-99fa-abe55c390fca.info is being set with open permissions: ugo+rw Jul 08 01:48:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7bc47271-d875-4e76-ba9e-79757bb6782c tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-32fd7b45-3af6-4503-99fa-abe55c390fca.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:36 devstack sudo[94972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-32fd7b45-3af6-4503-99fa-abe55c390fca.info Jul 08 01:48:36 devstack sudo[94972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:37 devstack sudo[94972]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7bc47271-d875-4e76-ba9e-79757bb6782c tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-32fd7b45-3af6-4503-99fa-abe55c390fca.info" returned: 0 in 0.856s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7bc47271-d875-4e76-ba9e-79757bb6782c tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.502s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-4c358abf-74e5-4920-a5a0-1f5f860ea3af tempest-AttachVolumeNegativeTest-677114920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.575s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:37 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-4c358abf-74e5-4920-a5a0-1f5f860ea3af tempest-AttachVolumeNegativeTest-677114920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:48:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-130448587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22712370-5615-4367-be20-43de0edd73b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d7bf0ee4dd241ae89007f93f5fbefaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:48:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:48:34Z,use_quota=True,user_id='26133f3fc0794c73a867ebf2d1393d53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:48:37 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-4c358abf-74e5-4920-a5a0-1f5f860ea3af tempest-AttachVolumeNegativeTest-677114920 None] Creating volume 22712370-5615-4367-be20-43de0edd73b6 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:48:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-4c358abf-74e5-4920-a5a0-1f5f860ea3af tempest-AttachVolumeNegativeTest-677114920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:48:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-4c358abf-74e5-4920-a5a0-1f5f860ea3af tempest-AttachVolumeNegativeTest-677114920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:37 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-4c358abf-74e5-4920-a5a0-1f5f860ea3af tempest-AttachVolumeNegativeTest-677114920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:48:37 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-4c358abf-74e5-4920-a5a0-1f5f860ea3af tempest-AttachVolumeNegativeTest-677114920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:48:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-4c358abf-74e5-4920-a5a0-1f5f860ea3af tempest-AttachVolumeNegativeTest-677114920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:37 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-4c358abf-74e5-4920-a5a0-1f5f860ea3af tempest-AttachVolumeNegativeTest-677114920 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:48:37 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-4c358abf-74e5-4920-a5a0-1f5f860ea3af tempest-AttachVolumeNegativeTest-677114920 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:48:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4c358abf-74e5-4920-a5a0-1f5f860ea3af tempest-AttachVolumeNegativeTest-677114920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-22712370-5615-4367-be20-43de0edd73b6 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:37 devstack sudo[94975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-22712370-5615-4367-be20-43de0edd73b6 1073741824 Jul 08 01:48:37 devstack sudo[94975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:37 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-7bc47271-d875-4e76-ba9e-79757bb6782c tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] Create snapshot completed successfully Jul 08 01:48:38 devstack sudo[94975]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4c358abf-74e5-4920-a5a0-1f5f860ea3af tempest-AttachVolumeNegativeTest-677114920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-22712370-5615-4367-be20-43de0edd73b6 1073741824" returned: 0 in 0.943s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4c358abf-74e5-4920-a5a0-1f5f860ea3af tempest-AttachVolumeNegativeTest-677114920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-22712370-5615-4367-be20-43de0edd73b6 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:38 devstack sudo[94981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-22712370-5615-4367-be20-43de0edd73b6 Jul 08 01:48:38 devstack sudo[94981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:38 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-3c2ed802-7ae8-454b-8cb9-27acfb0edf77 tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] Acquiring lock "cinder-8d968488-66ea-4aac-8075-5345e3d4049f-delete_snapshot" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:48:39 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-3c2ed802-7ae8-454b-8cb9-27acfb0edf77 tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] Lock "cinder-8d968488-66ea-4aac-8075-5345e3d4049f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:48:39 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-3c2ed802-7ae8-454b-8cb9-27acfb0edf77 tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] Acquiring lock "cinder-quobyte-32fd7b45-3af6-4503-99fa-abe55c390fca" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:48:39 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-3c2ed802-7ae8-454b-8cb9-27acfb0edf77 tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] Lock "cinder-quobyte-32fd7b45-3af6-4503-99fa-abe55c390fca" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:48:39 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-3c2ed802-7ae8-454b-8cb9-27acfb0edf77 tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] Acquiring lock "cinder-quobyte-8d968488-66ea-4aac-8075-5345e3d4049f" by "_delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:48:39 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-3c2ed802-7ae8-454b-8cb9-27acfb0edf77 tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] Lock "cinder-quobyte-8d968488-66ea-4aac-8075-5345e3d4049f" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:48:39 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-3c2ed802-7ae8-454b-8cb9-27acfb0edf77 tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] Deleting offline snapshot 8d968488-66ea-4aac-8075-5345e3d4049f of volume 32fd7b45-3af6-4503-99fa-abe55c390fca {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:48:39 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-3c2ed802-7ae8-454b-8cb9-27acfb0edf77 tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] snapshot_file for this snap is: volume-32fd7b45-3af6-4503-99fa-abe55c390fca.8d968488-66ea-4aac-8075-5345e3d4049f {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:48:39 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd097a3-0e18-448b-802d-ff9d99b598d7]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:48:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-3c2ed802-7ae8-454b-8cb9-27acfb0edf77 tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-32fd7b45-3af6-4503-99fa-abe55c390fca.8d968488-66ea-4aac-8075-5345e3d4049f {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:39 devstack sudo[94981]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4c358abf-74e5-4920-a5a0-1f5f860ea3af tempest-AttachVolumeNegativeTest-677114920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-22712370-5615-4367-be20-43de0edd73b6" returned: 0 in 0.837s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:39 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-4c358abf-74e5-4920-a5a0-1f5f860ea3af tempest-AttachVolumeNegativeTest-677114920 None] <== create_volume: return (1835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:48:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-4c358abf-74e5-4920-a5a0-1f5f860ea3af tempest-AttachVolumeNegativeTest-677114920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.838s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-1ae8cf5e-b2eb-4dc4-8579-645e94b38c69 tempest-VolumeQuotasAdminTestJSON-570935606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.656s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:39 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-1ae8cf5e-b2eb-4dc4-8579-645e94b38c69 tempest-VolumeQuotasAdminTestJSON-570935606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:48:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-734645921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c7c721f-f0d5-4e14-ae9a-fb4d3dfe235d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d2c69a123ce4fe6a36ce6abe64812f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:48:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:48:35Z,use_quota=True,user_id='0c0ea878984d4a9f9909925e70515429',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:48:39 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-1ae8cf5e-b2eb-4dc4-8579-645e94b38c69 tempest-VolumeQuotasAdminTestJSON-570935606 None] Creating volume 3c7c721f-f0d5-4e14-ae9a-fb4d3dfe235d {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:48:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-1ae8cf5e-b2eb-4dc4-8579-645e94b38c69 tempest-VolumeQuotasAdminTestJSON-570935606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:48:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-1ae8cf5e-b2eb-4dc4-8579-645e94b38c69 tempest-VolumeQuotasAdminTestJSON-570935606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:39 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-1ae8cf5e-b2eb-4dc4-8579-645e94b38c69 tempest-VolumeQuotasAdminTestJSON-570935606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:48:39 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-1ae8cf5e-b2eb-4dc4-8579-645e94b38c69 tempest-VolumeQuotasAdminTestJSON-570935606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:48:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-1ae8cf5e-b2eb-4dc4-8579-645e94b38c69 tempest-VolumeQuotasAdminTestJSON-570935606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:39 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-1ae8cf5e-b2eb-4dc4-8579-645e94b38c69 tempest-VolumeQuotasAdminTestJSON-570935606 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:48:39 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-1ae8cf5e-b2eb-4dc4-8579-645e94b38c69 tempest-VolumeQuotasAdminTestJSON-570935606 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:48:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1ae8cf5e-b2eb-4dc4-8579-645e94b38c69 tempest-VolumeQuotasAdminTestJSON-570935606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3c7c721f-f0d5-4e14-ae9a-fb4d3dfe235d 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:39 devstack sudo[94985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3c7c721f-f0d5-4e14-ae9a-fb4d3dfe235d 1073741824 Jul 08 01:48:39 devstack sudo[94985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:39 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-4c358abf-74e5-4920-a5a0-1f5f860ea3af tempest-AttachVolumeNegativeTest-677114920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37e75f15-5d42-4cd5-9827-1599d3f18caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22712370-5615-4367-be20-43de0edd73b6', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:39 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-4c358abf-74e5-4920-a5a0-1f5f860ea3af tempest-AttachVolumeNegativeTest-677114920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fc95632-7b5b-4cda-9c41-2a840fc8896b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:39 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-4c358abf-74e5-4920-a5a0-1f5f860ea3af tempest-AttachVolumeNegativeTest-677114920 None] Volume volume-22712370-5615-4367-be20-43de0edd73b6 (22712370-5615-4367-be20-43de0edd73b6): created successfully Jul 08 01:48:39 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-4c358abf-74e5-4920-a5a0-1f5f860ea3af tempest-AttachVolumeNegativeTest-677114920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fc95632-7b5b-4cda-9c41-2a840fc8896b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:39 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-4c358abf-74e5-4920-a5a0-1f5f860ea3af tempest-AttachVolumeNegativeTest-677114920 None] Flow 'volume_create_manager' (606c5a8e-8381-49b9-a87d-4399807680f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:48:39 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-4c358abf-74e5-4920-a5a0-1f5f860ea3af tempest-AttachVolumeNegativeTest-677114920 None] Created volume successfully. Jul 08 01:48:39 devstack sudo[94984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-32fd7b45-3af6-4503-99fa-abe55c390fca.8d968488-66ea-4aac-8075-5345e3d4049f Jul 08 01:48:39 devstack sudo[94984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:40 devstack sudo[94985]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1ae8cf5e-b2eb-4dc4-8579-645e94b38c69 tempest-VolumeQuotasAdminTestJSON-570935606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3c7c721f-f0d5-4e14-ae9a-fb4d3dfe235d 1073741824" returned: 0 in 1.042s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1ae8cf5e-b2eb-4dc4-8579-645e94b38c69 tempest-VolumeQuotasAdminTestJSON-570935606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3c7c721f-f0d5-4e14-ae9a-fb4d3dfe235d {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:40 devstack sudo[94984]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:40 devstack sudo[94999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3c7c721f-f0d5-4e14-ae9a-fb4d3dfe235d Jul 08 01:48:40 devstack sudo[94999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-3c2ed802-7ae8-454b-8cb9-27acfb0edf77 tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-32fd7b45-3af6-4503-99fa-abe55c390fca.8d968488-66ea-4aac-8075-5345e3d4049f" returned: 0 in 1.144s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:40 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-3c2ed802-7ae8-454b-8cb9-27acfb0edf77 tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32fd7b45-3af6-4503-99fa-abe55c390fca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:48:40 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[8516f895-0bb1-4d56-b569-1e3cddd53098]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:48:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-3c2ed802-7ae8-454b-8cb9-27acfb0edf77 tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-32fd7b45-3af6-4503-99fa-abe55c390fca {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:40 devstack sudo[95001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-32fd7b45-3af6-4503-99fa-abe55c390fca Jul 08 01:48:40 devstack sudo[95001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:40 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-19be6e41-8acb-4005-8eb1-84f4f7054e37 tempest-GroupsV320Test-1443148802 None] Group tempest-GroupsV320Test-Group-29409011: creating Jul 08 01:48:40 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-19be6e41-8acb-4005-8eb1-84f4f7054e37 tempest-GroupsV320Test-1443148802 None] Group tempest-GroupsV320Test-Group-29409011: created successfully Jul 08 01:48:40 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-19be6e41-8acb-4005-8eb1-84f4f7054e37 tempest-GroupsV320Test-1443148802 None] Create group completed successfully. Jul 08 01:48:40 devstack sudo[94999]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1ae8cf5e-b2eb-4dc4-8579-645e94b38c69 tempest-VolumeQuotasAdminTestJSON-570935606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3c7c721f-f0d5-4e14-ae9a-fb4d3dfe235d" returned: 0 in 0.743s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:40 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-1ae8cf5e-b2eb-4dc4-8579-645e94b38c69 tempest-VolumeQuotasAdminTestJSON-570935606 None] <== create_volume: return (1832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:48:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-1ae8cf5e-b2eb-4dc4-8579-645e94b38c69 tempest-VolumeQuotasAdminTestJSON-570935606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.835s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:41 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1ae8cf5e-b2eb-4dc4-8579-645e94b38c69 tempest-VolumeQuotasAdminTestJSON-570935606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (870f9c5a-a8dc-4f58-a955-1895a2c65287) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c7c721f-f0d5-4e14-ae9a-fb4d3dfe235d', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:41 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1ae8cf5e-b2eb-4dc4-8579-645e94b38c69 tempest-VolumeQuotasAdminTestJSON-570935606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a5e6b29-b10e-457f-8b6d-a8015e6afb92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:41 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-1ae8cf5e-b2eb-4dc4-8579-645e94b38c69 tempest-VolumeQuotasAdminTestJSON-570935606 None] Volume volume-3c7c721f-f0d5-4e14-ae9a-fb4d3dfe235d (3c7c721f-f0d5-4e14-ae9a-fb4d3dfe235d): created successfully Jul 08 01:48:41 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1ae8cf5e-b2eb-4dc4-8579-645e94b38c69 tempest-VolumeQuotasAdminTestJSON-570935606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a5e6b29-b10e-457f-8b6d-a8015e6afb92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:41 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1ae8cf5e-b2eb-4dc4-8579-645e94b38c69 tempest-VolumeQuotasAdminTestJSON-570935606 None] Flow 'volume_create_manager' (e67d75a2-1cd7-423b-a346-4f94b06147f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:48:41 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-1ae8cf5e-b2eb-4dc4-8579-645e94b38c69 tempest-VolumeQuotasAdminTestJSON-570935606 None] Created volume successfully. Jul 08 01:48:41 devstack sudo[95001]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-3c2ed802-7ae8-454b-8cb9-27acfb0edf77 tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-32fd7b45-3af6-4503-99fa-abe55c390fca" returned: 0 in 0.901s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-3c2ed802-7ae8-454b-8cb9-27acfb0edf77 tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-32fd7b45-3af6-4503-99fa-abe55c390fca.8d968488-66ea-4aac-8075-5345e3d4049f {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:41 devstack sudo[95007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-32fd7b45-3af6-4503-99fa-abe55c390fca.8d968488-66ea-4aac-8075-5345e3d4049f Jul 08 01:48:41 devstack sudo[95007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:42 devstack sudo[95007]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-3c2ed802-7ae8-454b-8cb9-27acfb0edf77 tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-32fd7b45-3af6-4503-99fa-abe55c390fca.8d968488-66ea-4aac-8075-5345e3d4049f" returned: 0 in 0.819s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-3c2ed802-7ae8-454b-8cb9-27acfb0edf77 tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-32fd7b45-3af6-4503-99fa-abe55c390fca.8d968488-66ea-4aac-8075-5345e3d4049f {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:42 devstack sudo[95012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-32fd7b45-3af6-4503-99fa-abe55c390fca.8d968488-66ea-4aac-8075-5345e3d4049f Jul 08 01:48:42 devstack sudo[95012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:42 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-e79c2d3c-5302-4aec-abe7-eaf63aa809a0 tempest-VolumeQuotasAdminTestJSON-14825515 None] Transfer volume completed successfully. Jul 08 01:48:42 devstack sudo[95012]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-3c2ed802-7ae8-454b-8cb9-27acfb0edf77 tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-32fd7b45-3af6-4503-99fa-abe55c390fca.8d968488-66ea-4aac-8075-5345e3d4049f" returned: 0 in 0.711s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:42 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-3c2ed802-7ae8-454b-8cb9-27acfb0edf77 tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] Lock "cinder-quobyte-8d968488-66ea-4aac-8075-5345e3d4049f" released by "_delete_snapshot" :: held 3.724s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:48:42 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-3c2ed802-7ae8-454b-8cb9-27acfb0edf77 tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] Lock "cinder-quobyte-32fd7b45-3af6-4503-99fa-abe55c390fca" released by "delete_snapshot" :: held 3.756s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:48:42 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-42eb1e5b-f0e3-4919-99f5-6d23e99b4421 tempest-GroupsV320Test-1443148802 None] Created reservations ['a8aa4daa-91da-4b18-b4d3-b1e2d0768845'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:48:42 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-3c2ed802-7ae8-454b-8cb9-27acfb0edf77 tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] Created reservations ['9ed0b368-98bb-43d5-a727-fc1a876c8294', 'aec0874d-c415-42d2-99d5-6897c38bcbe0', 'cc28862e-7319-4690-ac52-29782162152f', '5ef5a0ad-a74c-48eb-9c28-9e4864a300ff'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:48:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-42eb1e5b-f0e3-4919-99f5-6d23e99b4421 tempest-GroupsV320Test-1443148802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:48:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-42eb1e5b-f0e3-4919-99f5-6d23e99b4421 tempest-GroupsV320Test-1443148802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:42 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-42eb1e5b-f0e3-4919-99f5-6d23e99b4421 tempest-GroupsV320Test-1443148802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:48:42 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-42eb1e5b-f0e3-4919-99f5-6d23e99b4421 tempest-GroupsV320Test-1443148802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:48:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-42eb1e5b-f0e3-4919-99f5-6d23e99b4421 tempest-GroupsV320Test-1443148802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-42eb1e5b-f0e3-4919-99f5-6d23e99b4421 tempest-GroupsV320Test-1443148802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:42 devstack sudo[95024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:48:42 devstack sudo[95024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:42 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-3c2ed802-7ae8-454b-8cb9-27acfb0edf77 tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] Delete snapshot completed successfully. Jul 08 01:48:43 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-3c2ed802-7ae8-454b-8cb9-27acfb0edf77 tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] Lock "cinder-8d968488-66ea-4aac-8075-5345e3d4049f-delete_snapshot" released by "delete_snapshot" :: held 3.978s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:48:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-92a7ed69-62d7-466c-a6b5-081f3758b35c req-af7883ac-637f-4d24-a037-31316ce4d55a tempest-AttachVolumeNegativeTest-677114920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:48:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-92a7ed69-62d7-466c-a6b5-081f3758b35c req-af7883ac-637f-4d24-a037-31316ce4d55a tempest-AttachVolumeNegativeTest-677114920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:43 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[7255eb03-ca9d-413a-b137-2fd76a783c14]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:48:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-92a7ed69-62d7-466c-a6b5-081f3758b35c req-af7883ac-637f-4d24-a037-31316ce4d55a tempest-AttachVolumeNegativeTest-677114920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-22712370-5615-4367-be20-43de0edd73b6 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:43 devstack sudo[95027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-22712370-5615-4367-be20-43de0edd73b6 Jul 08 01:48:43 devstack sudo[95027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:43 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-88411621-b626-4a3c-ae4c-d8eec87b2160 tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] Acquiring lock "cinder-32fd7b45-3af6-4503-99fa-abe55c390fca-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:48:43 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-88411621-b626-4a3c-ae4c-d8eec87b2160 tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] Lock "cinder-32fd7b45-3af6-4503-99fa-abe55c390fca-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:48:43 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-88411621-b626-4a3c-ae4c-d8eec87b2160 tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] Acquiring lock "cinder-quobyte-32fd7b45-3af6-4503-99fa-abe55c390fca" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:48:43 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-88411621-b626-4a3c-ae4c-d8eec87b2160 tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] Lock "cinder-quobyte-32fd7b45-3af6-4503-99fa-abe55c390fca" acquired by "delete_volume" :: waited 0.021s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:48:43 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56b776f-a9ab-458b-b985-1fbd8c83354a]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:48:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-88411621-b626-4a3c-ae4c-d8eec87b2160 tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-32fd7b45-3af6-4503-99fa-abe55c390fca {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:43 devstack sudo[95024]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-42eb1e5b-f0e3-4919-99f5-6d23e99b4421 tempest-GroupsV320Test-1443148802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.780s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:43 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-42eb1e5b-f0e3-4919-99f5-6d23e99b4421 tempest-GroupsV320Test-1443148802 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:48:43 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-42eb1e5b-f0e3-4919-99f5-6d23e99b4421 tempest-GroupsV320Test-1443148802 None] Delete group completed successfully. Jul 08 01:48:43 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-574c9fad-7ea0-4e96-97b4-d36e9bf64ef0 tempest-VolumeQuotasAdminTestJSON-338641712 None] Acquiring lock "cinder-3c7c721f-f0d5-4e14-ae9a-fb4d3dfe235d-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:48:43 devstack sudo[95030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-32fd7b45-3af6-4503-99fa-abe55c390fca Jul 08 01:48:43 devstack sudo[95030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:43 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-574c9fad-7ea0-4e96-97b4-d36e9bf64ef0 tempest-VolumeQuotasAdminTestJSON-338641712 None] Lock "cinder-3c7c721f-f0d5-4e14-ae9a-fb4d3dfe235d-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:48:43 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-574c9fad-7ea0-4e96-97b4-d36e9bf64ef0 tempest-VolumeQuotasAdminTestJSON-338641712 None] Acquiring lock "cinder-quobyte-3c7c721f-f0d5-4e14-ae9a-fb4d3dfe235d" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:48:43 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-574c9fad-7ea0-4e96-97b4-d36e9bf64ef0 tempest-VolumeQuotasAdminTestJSON-338641712 None] Lock "cinder-quobyte-3c7c721f-f0d5-4e14-ae9a-fb4d3dfe235d" acquired by "delete_volume" :: waited 0.020s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:48:44 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ec53e7-0bff-442a-94de-b30d6d2c3222]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:48:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-574c9fad-7ea0-4e96-97b4-d36e9bf64ef0 tempest-VolumeQuotasAdminTestJSON-338641712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3c7c721f-f0d5-4e14-ae9a-fb4d3dfe235d {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:44 devstack sudo[95027]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:44 devstack sudo[95035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3c7c721f-f0d5-4e14-ae9a-fb4d3dfe235d Jul 08 01:48:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-92a7ed69-62d7-466c-a6b5-081f3758b35c req-af7883ac-637f-4d24-a037-31316ce4d55a tempest-AttachVolumeNegativeTest-677114920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-22712370-5615-4367-be20-43de0edd73b6" returned: 0 in 1.050s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:44 devstack sudo[95035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-92a7ed69-62d7-466c-a6b5-081f3758b35c req-af7883ac-637f-4d24-a037-31316ce4d55a tempest-AttachVolumeNegativeTest-677114920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.069s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:44 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [req-92a7ed69-62d7-466c-a6b5-081f3758b35c req-af7883ac-637f-4d24-a037-31316ce4d55a tempest-AttachVolumeNegativeTest-677114920 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17', 'name': 'volume-22712370-5615-4367-be20-43de0edd73b6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7415db72-5853-40f4-9e18-dd0cdc589ec5', 'enforce_multipath': True} {{(pid=87134) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:48:44 devstack cinder-volume[87134]: INFO cinder.volume.manager [req-92a7ed69-62d7-466c-a6b5-081f3758b35c req-af7883ac-637f-4d24-a037-31316ce4d55a tempest-AttachVolumeNegativeTest-677114920 None] attachment_update completed successfully. Jul 08 01:48:44 devstack sudo[95030]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-88411621-b626-4a3c-ae4c-d8eec87b2160 tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-32fd7b45-3af6-4503-99fa-abe55c390fca" returned: 0 in 1.076s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-88411621-b626-4a3c-ae4c-d8eec87b2160 tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-32fd7b45-3af6-4503-99fa-abe55c390fca {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:44 devstack sudo[95068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-32fd7b45-3af6-4503-99fa-abe55c390fca Jul 08 01:48:44 devstack sudo[95068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:45 devstack sudo[95035]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-574c9fad-7ea0-4e96-97b4-d36e9bf64ef0 tempest-VolumeQuotasAdminTestJSON-338641712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3c7c721f-f0d5-4e14-ae9a-fb4d3dfe235d" returned: 0 in 1.081s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-574c9fad-7ea0-4e96-97b4-d36e9bf64ef0 tempest-VolumeQuotasAdminTestJSON-338641712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3c7c721f-f0d5-4e14-ae9a-fb4d3dfe235d {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:45 devstack sudo[95429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3c7c721f-f0d5-4e14-ae9a-fb4d3dfe235d Jul 08 01:48:45 devstack sudo[95429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:45 devstack sudo[95068]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-88411621-b626-4a3c-ae4c-d8eec87b2160 tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-32fd7b45-3af6-4503-99fa-abe55c390fca" returned: 0 in 0.892s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:45 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-88411621-b626-4a3c-ae4c-d8eec87b2160 tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] Lock "cinder-quobyte-32fd7b45-3af6-4503-99fa-abe55c390fca" released by "delete_volume" :: held 2.074s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:48:45 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-88411621-b626-4a3c-ae4c-d8eec87b2160 tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] Created reservations ['8e96b16d-0bf1-4cf2-888d-41d833837c2e', '95b6033f-62f2-4a69-8b07-428d44ebbfa0', 'a0f011e4-da23-4928-b376-f4e1f0ee13a7', 'aa516fdf-f6f0-4ab9-9b10-b8ac7666c2b9'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:48:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-88411621-b626-4a3c-ae4c-d8eec87b2160 tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:48:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-88411621-b626-4a3c-ae4c-d8eec87b2160 tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:45 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-88411621-b626-4a3c-ae4c-d8eec87b2160 tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:48:45 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-88411621-b626-4a3c-ae4c-d8eec87b2160 tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:48:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-88411621-b626-4a3c-ae4c-d8eec87b2160 tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-88411621-b626-4a3c-ae4c-d8eec87b2160 tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:45 devstack sudo[95429]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-574c9fad-7ea0-4e96-97b4-d36e9bf64ef0 tempest-VolumeQuotasAdminTestJSON-338641712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3c7c721f-f0d5-4e14-ae9a-fb4d3dfe235d" returned: 0 in 0.799s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:45 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-574c9fad-7ea0-4e96-97b4-d36e9bf64ef0 tempest-VolumeQuotasAdminTestJSON-338641712 None] Lock "cinder-quobyte-3c7c721f-f0d5-4e14-ae9a-fb4d3dfe235d" released by "delete_volume" :: held 1.952s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:48:45 devstack sudo[95433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:48:45 devstack sudo[95433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:45 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-574c9fad-7ea0-4e96-97b4-d36e9bf64ef0 tempest-VolumeQuotasAdminTestJSON-338641712 None] Created reservations ['ebfb776e-0761-435d-b69f-90231813785e', '23ff5701-b261-41ec-ba8a-4719640eff53', '4e8b78d9-f543-4f26-b0b3-0357c1ddf0ea', '11052924-3beb-4c17-a17b-4e4206460f50'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:48:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-574c9fad-7ea0-4e96-97b4-d36e9bf64ef0 tempest-VolumeQuotasAdminTestJSON-338641712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:48:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-574c9fad-7ea0-4e96-97b4-d36e9bf64ef0 tempest-VolumeQuotasAdminTestJSON-338641712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:46 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-574c9fad-7ea0-4e96-97b4-d36e9bf64ef0 tempest-VolumeQuotasAdminTestJSON-338641712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:48:46 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-574c9fad-7ea0-4e96-97b4-d36e9bf64ef0 tempest-VolumeQuotasAdminTestJSON-338641712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:48:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-574c9fad-7ea0-4e96-97b4-d36e9bf64ef0 tempest-VolumeQuotasAdminTestJSON-338641712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-574c9fad-7ea0-4e96-97b4-d36e9bf64ef0 tempest-VolumeQuotasAdminTestJSON-338641712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:46 devstack sudo[95435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:48:46 devstack sudo[95435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:47 devstack sudo[95433]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-88411621-b626-4a3c-ae4c-d8eec87b2160 tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 1.137s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:47 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-88411621-b626-4a3c-ae4c-d8eec87b2160 tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:48:47 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-88411621-b626-4a3c-ae4c-d8eec87b2160 tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] Deleted volume successfully. Jul 08 01:48:47 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-88411621-b626-4a3c-ae4c-d8eec87b2160 tempest-VolumeSnapshotQuotasNegativeTestJSON-659341577 None] Lock "cinder-32fd7b45-3af6-4503-99fa-abe55c390fca-delete_volume" released by "delete_volume" :: held 3.525s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:48:47 devstack sudo[95435]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-574c9fad-7ea0-4e96-97b4-d36e9bf64ef0 tempest-VolumeQuotasAdminTestJSON-338641712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 1.043s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:47 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-574c9fad-7ea0-4e96-97b4-d36e9bf64ef0 tempest-VolumeQuotasAdminTestJSON-338641712 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:48:47 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-574c9fad-7ea0-4e96-97b4-d36e9bf64ef0 tempest-VolumeQuotasAdminTestJSON-338641712 None] Deleted volume successfully. Jul 08 01:48:47 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-574c9fad-7ea0-4e96-97b4-d36e9bf64ef0 tempest-VolumeQuotasAdminTestJSON-338641712 None] Lock "cinder-3c7c721f-f0d5-4e14-ae9a-fb4d3dfe235d-delete_volume" released by "delete_volume" :: held 3.299s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:48:50 devstack cinder-volume[87134]: INFO cinder.volume.manager [req-a4d60b81-ded6-4a44-8ea9-e1a0e6071ed9 req-f607293e-5366-485b-8a79-2145ba7358a1 tempest-AttachVolumeNegativeTest-677114920 None] Terminate volume connection completed successfully. Jul 08 01:48:50 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [req-a4d60b81-ded6-4a44-8ea9-e1a0e6071ed9 req-f607293e-5366-485b-8a79-2145ba7358a1 tempest-AttachVolumeNegativeTest-677114920 None] Deleting attachment 7415db72-5853-40f4-9e18-dd0cdc589ec5. {{(pid=87134) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:48:53 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-abd9eb44-6145-44a6-b69f-d6054230ea0d tempest-VolumeRetypeWithoutMigrationTest-1021880692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:48:53 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-abd9eb44-6145-44a6-b69f-d6054230ea0d tempest-VolumeRetypeWithoutMigrationTest-1021880692 None] Flow 'volume_create_manager' (64feb724-f44f-41eb-9e36-bd5b11445f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:48:53 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-abd9eb44-6145-44a6-b69f-d6054230ea0d tempest-VolumeRetypeWithoutMigrationTest-1021880692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3663fad5-61ff-4240-b757-4564dfa5f791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:53 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-abd9eb44-6145-44a6-b69f-d6054230ea0d tempest-VolumeRetypeWithoutMigrationTest-1021880692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3663fad5-61ff-4240-b757-4564dfa5f791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:48:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1149512400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41b8338d-23ec-4916-ace7-a0c24145ef9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce97efb4e17448d78f85653857ccbee0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:48:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:48:53Z,use_quota=True,user_id='8dc585404f784a3495f5129c2b2fb714',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10f48aaa-61b4-41dd-8f41-f08af8d5a459),volume_type_id=10f48aaa-61b4-41dd-8f41-f08af8d5a459)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:53 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-abd9eb44-6145-44a6-b69f-d6054230ea0d tempest-VolumeRetypeWithoutMigrationTest-1021880692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9631982-25f6-4b06-8bff-3f76c2abc36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:53 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-abd9eb44-6145-44a6-b69f-d6054230ea0d tempest-VolumeRetypeWithoutMigrationTest-1021880692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9631982-25f6-4b06-8bff-3f76c2abc36e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:53 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-abd9eb44-6145-44a6-b69f-d6054230ea0d tempest-VolumeRetypeWithoutMigrationTest-1021880692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef95b5e6-c9e6-4718-bff6-25cf571bb8f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:53 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-abd9eb44-6145-44a6-b69f-d6054230ea0d tempest-VolumeRetypeWithoutMigrationTest-1021880692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef95b5e6-c9e6-4718-bff6-25cf571bb8f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41b8338d-23ec-4916-ace7-a0c24145ef9a', 'volume_name': 'volume-41b8338d-23ec-4916-ace7-a0c24145ef9a', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:53 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-abd9eb44-6145-44a6-b69f-d6054230ea0d tempest-VolumeRetypeWithoutMigrationTest-1021880692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58df7614-e317-41a4-a4bf-293b159be63d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:53 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-abd9eb44-6145-44a6-b69f-d6054230ea0d tempest-VolumeRetypeWithoutMigrationTest-1021880692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58df7614-e317-41a4-a4bf-293b159be63d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:53 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-abd9eb44-6145-44a6-b69f-d6054230ea0d tempest-VolumeRetypeWithoutMigrationTest-1021880692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecc01461-7c87-4c02-ad87-921a4598d96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:53 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-abd9eb44-6145-44a6-b69f-d6054230ea0d tempest-VolumeRetypeWithoutMigrationTest-1021880692 None] Volume 41b8338d-23ec-4916-ace7-a0c24145ef9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41b8338d-23ec-4916-ace7-a0c24145ef9a', 'volume_size': 1} Jul 08 01:48:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-abd9eb44-6145-44a6-b69f-d6054230ea0d tempest-VolumeRetypeWithoutMigrationTest-1021880692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:48:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-abd9eb44-6145-44a6-b69f-d6054230ea0d tempest-VolumeRetypeWithoutMigrationTest-1021880692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:53 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-abd9eb44-6145-44a6-b69f-d6054230ea0d tempest-VolumeRetypeWithoutMigrationTest-1021880692 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:48:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1149512400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41b8338d-23ec-4916-ace7-a0c24145ef9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce97efb4e17448d78f85653857ccbee0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:48:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:48:53Z,use_quota=True,user_id='8dc585404f784a3495f5129c2b2fb714',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10f48aaa-61b4-41dd-8f41-f08af8d5a459),volume_type_id=10f48aaa-61b4-41dd-8f41-f08af8d5a459)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:48:53 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-abd9eb44-6145-44a6-b69f-d6054230ea0d tempest-VolumeRetypeWithoutMigrationTest-1021880692 None] Creating volume 41b8338d-23ec-4916-ace7-a0c24145ef9a {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:48:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-abd9eb44-6145-44a6-b69f-d6054230ea0d tempest-VolumeRetypeWithoutMigrationTest-1021880692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:48:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-abd9eb44-6145-44a6-b69f-d6054230ea0d tempest-VolumeRetypeWithoutMigrationTest-1021880692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:53 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-abd9eb44-6145-44a6-b69f-d6054230ea0d tempest-VolumeRetypeWithoutMigrationTest-1021880692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:48:53 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-abd9eb44-6145-44a6-b69f-d6054230ea0d tempest-VolumeRetypeWithoutMigrationTest-1021880692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:48:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-abd9eb44-6145-44a6-b69f-d6054230ea0d tempest-VolumeRetypeWithoutMigrationTest-1021880692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:53 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-abd9eb44-6145-44a6-b69f-d6054230ea0d tempest-VolumeRetypeWithoutMigrationTest-1021880692 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:48:53 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-abd9eb44-6145-44a6-b69f-d6054230ea0d tempest-VolumeRetypeWithoutMigrationTest-1021880692 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:48:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-abd9eb44-6145-44a6-b69f-d6054230ea0d tempest-VolumeRetypeWithoutMigrationTest-1021880692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41b8338d-23ec-4916-ace7-a0c24145ef9a 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:53 devstack sudo[95469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41b8338d-23ec-4916-ace7-a0c24145ef9a 1073741824 Jul 08 01:48:53 devstack sudo[95469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:54 devstack sudo[95469]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-abd9eb44-6145-44a6-b69f-d6054230ea0d tempest-VolumeRetypeWithoutMigrationTest-1021880692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41b8338d-23ec-4916-ace7-a0c24145ef9a 1073741824" returned: 0 in 1.078s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-abd9eb44-6145-44a6-b69f-d6054230ea0d tempest-VolumeRetypeWithoutMigrationTest-1021880692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41b8338d-23ec-4916-ace7-a0c24145ef9a {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:54 devstack sudo[95490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41b8338d-23ec-4916-ace7-a0c24145ef9a Jul 08 01:48:54 devstack sudo[95490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:55 devstack sudo[95490]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:55 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-abd9eb44-6145-44a6-b69f-d6054230ea0d tempest-VolumeRetypeWithoutMigrationTest-1021880692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41b8338d-23ec-4916-ace7-a0c24145ef9a" returned: 0 in 0.980s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:55 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-abd9eb44-6145-44a6-b69f-d6054230ea0d tempest-VolumeRetypeWithoutMigrationTest-1021880692 None] <== create_volume: return (2165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:48:55 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-abd9eb44-6145-44a6-b69f-d6054230ea0d tempest-VolumeRetypeWithoutMigrationTest-1021880692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.169s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:55 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-abd9eb44-6145-44a6-b69f-d6054230ea0d tempest-VolumeRetypeWithoutMigrationTest-1021880692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecc01461-7c87-4c02-ad87-921a4598d96e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41b8338d-23ec-4916-ace7-a0c24145ef9a', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:55 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-abd9eb44-6145-44a6-b69f-d6054230ea0d tempest-VolumeRetypeWithoutMigrationTest-1021880692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fb7fa31-03ef-47e7-9064-6d99c840c947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:55 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-abd9eb44-6145-44a6-b69f-d6054230ea0d tempest-VolumeRetypeWithoutMigrationTest-1021880692 None] Volume volume-41b8338d-23ec-4916-ace7-a0c24145ef9a (41b8338d-23ec-4916-ace7-a0c24145ef9a): created successfully Jul 08 01:48:55 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-abd9eb44-6145-44a6-b69f-d6054230ea0d tempest-VolumeRetypeWithoutMigrationTest-1021880692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fb7fa31-03ef-47e7-9064-6d99c840c947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:55 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-abd9eb44-6145-44a6-b69f-d6054230ea0d tempest-VolumeRetypeWithoutMigrationTest-1021880692 None] Flow 'volume_create_manager' (64feb724-f44f-41eb-9e36-bd5b11445f80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:48:55 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-abd9eb44-6145-44a6-b69f-d6054230ea0d tempest-VolumeRetypeWithoutMigrationTest-1021880692 None] Created volume successfully. Jul 08 01:48:56 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c716b88-0d44-4e77-9a44-b33a2e2573ca tempest-VolumeQuotasNegativeTestJSON-2109613326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:48:56 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8c716b88-0d44-4e77-9a44-b33a2e2573ca tempest-VolumeQuotasNegativeTestJSON-2109613326 None] Flow 'volume_create_manager' (9c9cff6e-ac22-492c-bd0b-2897e556699e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:48:56 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8c716b88-0d44-4e77-9a44-b33a2e2573ca tempest-VolumeQuotasNegativeTestJSON-2109613326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f55cd55-4a06-4975-b225-bf00c9d4c88a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:56 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8c716b88-0d44-4e77-9a44-b33a2e2573ca tempest-VolumeQuotasNegativeTestJSON-2109613326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f55cd55-4a06-4975-b225-bf00c9d4c88a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:48:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1241652583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8e77c53-2c55-4c00-a61e-2f4d58746344,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d0540a57c41435691a3745d08196c73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:48:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:48:57Z,use_quota=True,user_id='d457e0216e274485b9d2099f78133360',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:56 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8c716b88-0d44-4e77-9a44-b33a2e2573ca tempest-VolumeQuotasNegativeTestJSON-2109613326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (826d36e9-3f9a-416e-aab6-017f80225253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:56 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8c716b88-0d44-4e77-9a44-b33a2e2573ca tempest-VolumeQuotasNegativeTestJSON-2109613326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (826d36e9-3f9a-416e-aab6-017f80225253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:56 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8c716b88-0d44-4e77-9a44-b33a2e2573ca tempest-VolumeQuotasNegativeTestJSON-2109613326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04c55b88-0d99-4a07-bd17-8fa0fa267179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:56 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8c716b88-0d44-4e77-9a44-b33a2e2573ca tempest-VolumeQuotasNegativeTestJSON-2109613326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04c55b88-0d99-4a07-bd17-8fa0fa267179) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8e77c53-2c55-4c00-a61e-2f4d58746344', 'volume_name': 'volume-e8e77c53-2c55-4c00-a61e-2f4d58746344', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:56 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8c716b88-0d44-4e77-9a44-b33a2e2573ca tempest-VolumeQuotasNegativeTestJSON-2109613326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be4aaab1-d3d3-4546-a5db-c3d758bdc459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:56 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8c716b88-0d44-4e77-9a44-b33a2e2573ca tempest-VolumeQuotasNegativeTestJSON-2109613326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be4aaab1-d3d3-4546-a5db-c3d758bdc459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:56 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8c716b88-0d44-4e77-9a44-b33a2e2573ca tempest-VolumeQuotasNegativeTestJSON-2109613326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a72b63d2-3b80-40f0-aad8-5da042375414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:56 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-8c716b88-0d44-4e77-9a44-b33a2e2573ca tempest-VolumeQuotasNegativeTestJSON-2109613326 None] Volume e8e77c53-2c55-4c00-a61e-2f4d58746344: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8e77c53-2c55-4c00-a61e-2f4d58746344', 'volume_size': 1} Jul 08 01:48:56 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-8c716b88-0d44-4e77-9a44-b33a2e2573ca tempest-VolumeQuotasNegativeTestJSON-2109613326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:48:56 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-8c716b88-0d44-4e77-9a44-b33a2e2573ca tempest-VolumeQuotasNegativeTestJSON-2109613326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:56 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-8c716b88-0d44-4e77-9a44-b33a2e2573ca tempest-VolumeQuotasNegativeTestJSON-2109613326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:48:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1241652583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8e77c53-2c55-4c00-a61e-2f4d58746344,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d0540a57c41435691a3745d08196c73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:48:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:48:57Z,use_quota=True,user_id='d457e0216e274485b9d2099f78133360',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:48:56 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-8c716b88-0d44-4e77-9a44-b33a2e2573ca tempest-VolumeQuotasNegativeTestJSON-2109613326 None] Creating volume e8e77c53-2c55-4c00-a61e-2f4d58746344 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:48:56 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-8c716b88-0d44-4e77-9a44-b33a2e2573ca tempest-VolumeQuotasNegativeTestJSON-2109613326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:48:56 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-8c716b88-0d44-4e77-9a44-b33a2e2573ca tempest-VolumeQuotasNegativeTestJSON-2109613326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:56 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-8c716b88-0d44-4e77-9a44-b33a2e2573ca tempest-VolumeQuotasNegativeTestJSON-2109613326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:48:56 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-8c716b88-0d44-4e77-9a44-b33a2e2573ca tempest-VolumeQuotasNegativeTestJSON-2109613326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:48:56 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-8c716b88-0d44-4e77-9a44-b33a2e2573ca tempest-VolumeQuotasNegativeTestJSON-2109613326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:56 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-8c716b88-0d44-4e77-9a44-b33a2e2573ca tempest-VolumeQuotasNegativeTestJSON-2109613326 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:48:56 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-8c716b88-0d44-4e77-9a44-b33a2e2573ca tempest-VolumeQuotasNegativeTestJSON-2109613326 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:48:56 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8c716b88-0d44-4e77-9a44-b33a2e2573ca tempest-VolumeQuotasNegativeTestJSON-2109613326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e8e77c53-2c55-4c00-a61e-2f4d58746344 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:56 devstack sudo[95505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e8e77c53-2c55-4c00-a61e-2f4d58746344 1073741824 Jul 08 01:48:56 devstack sudo[95505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:57 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6e6c7e94-d808-4258-b907-3fab6989352c tempest-VolumeRetypeWithoutMigrationTest-1021880692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:48:57 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6e6c7e94-d808-4258-b907-3fab6989352c tempest-VolumeRetypeWithoutMigrationTest-1021880692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:57 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-6e6c7e94-d808-4258-b907-3fab6989352c tempest-VolumeRetypeWithoutMigrationTest-1021880692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:48:57 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-6e6c7e94-d808-4258-b907-3fab6989352c tempest-VolumeRetypeWithoutMigrationTest-1021880692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:48:57 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6e6c7e94-d808-4258-b907-3fab6989352c tempest-VolumeRetypeWithoutMigrationTest-1021880692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:57 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6e6c7e94-d808-4258-b907-3fab6989352c tempest-VolumeRetypeWithoutMigrationTest-1021880692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:57 devstack sudo[95507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:48:57 devstack sudo[95507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:57 devstack sudo[95507]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:57 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6e6c7e94-d808-4258-b907-3fab6989352c tempest-VolumeRetypeWithoutMigrationTest-1021880692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.890s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:57 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-6e6c7e94-d808-4258-b907-3fab6989352c tempest-VolumeRetypeWithoutMigrationTest-1021880692 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:48:57 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-6e6c7e94-d808-4258-b907-3fab6989352c tempest-VolumeRetypeWithoutMigrationTest-1021880692 None] Retype volume completed successfully. Jul 08 01:48:57 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-8953fcb8-3172-4d39-af51-03a98c78ab1d tempest-VolumeRetypeWithoutMigrationTest-1021880692 None] Acquiring lock "cinder-41b8338d-23ec-4916-ace7-a0c24145ef9a-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:48:57 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-8953fcb8-3172-4d39-af51-03a98c78ab1d tempest-VolumeRetypeWithoutMigrationTest-1021880692 None] Lock "cinder-41b8338d-23ec-4916-ace7-a0c24145ef9a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:48:58 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-8953fcb8-3172-4d39-af51-03a98c78ab1d tempest-VolumeRetypeWithoutMigrationTest-1021880692 None] Acquiring lock "cinder-quobyte-41b8338d-23ec-4916-ace7-a0c24145ef9a" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:48:58 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-8953fcb8-3172-4d39-af51-03a98c78ab1d tempest-VolumeRetypeWithoutMigrationTest-1021880692 None] Lock "cinder-quobyte-41b8338d-23ec-4916-ace7-a0c24145ef9a" acquired by "delete_volume" :: waited 0.019s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:48:58 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe28a0e-a6c4-4185-af68-e471df0b205a]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:48:58 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8953fcb8-3172-4d39-af51-03a98c78ab1d tempest-VolumeRetypeWithoutMigrationTest-1021880692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41b8338d-23ec-4916-ace7-a0c24145ef9a {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:58 devstack sudo[95505]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:58 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8c716b88-0d44-4e77-9a44-b33a2e2573ca tempest-VolumeQuotasNegativeTestJSON-2109613326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e8e77c53-2c55-4c00-a61e-2f4d58746344 1073741824" returned: 0 in 1.210s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:58 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8c716b88-0d44-4e77-9a44-b33a2e2573ca tempest-VolumeQuotasNegativeTestJSON-2109613326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e8e77c53-2c55-4c00-a61e-2f4d58746344 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:58 devstack sudo[95514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41b8338d-23ec-4916-ace7-a0c24145ef9a Jul 08 01:48:58 devstack sudo[95514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:58 devstack sudo[95515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e8e77c53-2c55-4c00-a61e-2f4d58746344 Jul 08 01:48:58 devstack sudo[95515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:58 devstack sudo[95515]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:58 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8c716b88-0d44-4e77-9a44-b33a2e2573ca tempest-VolumeQuotasNegativeTestJSON-2109613326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e8e77c53-2c55-4c00-a61e-2f4d58746344" returned: 0 in 0.786s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:58 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-8c716b88-0d44-4e77-9a44-b33a2e2573ca tempest-VolumeQuotasNegativeTestJSON-2109613326 None] <== create_volume: return (2040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:48:58 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-8c716b88-0d44-4e77-9a44-b33a2e2573ca tempest-VolumeQuotasNegativeTestJSON-2109613326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.045s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:59 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8c716b88-0d44-4e77-9a44-b33a2e2573ca tempest-VolumeQuotasNegativeTestJSON-2109613326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a72b63d2-3b80-40f0-aad8-5da042375414) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8e77c53-2c55-4c00-a61e-2f4d58746344', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:59 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8c716b88-0d44-4e77-9a44-b33a2e2573ca tempest-VolumeQuotasNegativeTestJSON-2109613326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd6aa64f-37d3-4816-bb54-c9ab70c0fbd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:48:59 devstack sudo[95514]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8953fcb8-3172-4d39-af51-03a98c78ab1d tempest-VolumeRetypeWithoutMigrationTest-1021880692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41b8338d-23ec-4916-ace7-a0c24145ef9a" returned: 0 in 0.944s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8953fcb8-3172-4d39-af51-03a98c78ab1d tempest-VolumeRetypeWithoutMigrationTest-1021880692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41b8338d-23ec-4916-ace7-a0c24145ef9a {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:59 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-8c716b88-0d44-4e77-9a44-b33a2e2573ca tempest-VolumeQuotasNegativeTestJSON-2109613326 None] Volume volume-e8e77c53-2c55-4c00-a61e-2f4d58746344 (e8e77c53-2c55-4c00-a61e-2f4d58746344): created successfully Jul 08 01:48:59 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8c716b88-0d44-4e77-9a44-b33a2e2573ca tempest-VolumeQuotasNegativeTestJSON-2109613326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd6aa64f-37d3-4816-bb54-c9ab70c0fbd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:48:59 devstack sudo[95523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41b8338d-23ec-4916-ace7-a0c24145ef9a Jul 08 01:48:59 devstack sudo[95523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:48:59 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8c716b88-0d44-4e77-9a44-b33a2e2573ca tempest-VolumeQuotasNegativeTestJSON-2109613326 None] Flow 'volume_create_manager' (9c9cff6e-ac22-492c-bd0b-2897e556699e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:48:59 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-8c716b88-0d44-4e77-9a44-b33a2e2573ca tempest-VolumeQuotasNegativeTestJSON-2109613326 None] Created volume successfully. Jul 08 01:48:59 devstack sudo[95523]: pam_unix(sudo:session): session closed for user root Jul 08 01:48:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8953fcb8-3172-4d39-af51-03a98c78ab1d tempest-VolumeRetypeWithoutMigrationTest-1021880692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-41b8338d-23ec-4916-ace7-a0c24145ef9a" returned: 0 in 0.713s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:48:59 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-8953fcb8-3172-4d39-af51-03a98c78ab1d tempest-VolumeRetypeWithoutMigrationTest-1021880692 None] Lock "cinder-quobyte-41b8338d-23ec-4916-ace7-a0c24145ef9a" released by "delete_volume" :: held 1.701s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:48:59 devstack cinder-volume[87134]: WARNING cinder.quota [None req-8953fcb8-3172-4d39-af51-03a98c78ab1d tempest-VolumeRetypeWithoutMigrationTest-1021880692 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:48:59 devstack cinder-volume[87134]: WARNING cinder.quota [None req-8953fcb8-3172-4d39-af51-03a98c78ab1d tempest-VolumeRetypeWithoutMigrationTest-1021880692 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:48:59 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-8953fcb8-3172-4d39-af51-03a98c78ab1d tempest-VolumeRetypeWithoutMigrationTest-1021880692 None] Created reservations ['af882bd3-fa41-4aab-b5a2-8a9d5faefbb6', '823011f0-2f7f-4d4e-9730-579f4872086c', '4ffd64e7-e41e-4016-9035-c033b5383faa', '6b63eaa9-7aec-4a2b-a3cd-ee643f5593c2'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:48:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-8953fcb8-3172-4d39-af51-03a98c78ab1d tempest-VolumeRetypeWithoutMigrationTest-1021880692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:48:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-8953fcb8-3172-4d39-af51-03a98c78ab1d tempest-VolumeRetypeWithoutMigrationTest-1021880692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:48:59 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-8953fcb8-3172-4d39-af51-03a98c78ab1d tempest-VolumeRetypeWithoutMigrationTest-1021880692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:48:59 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-8953fcb8-3172-4d39-af51-03a98c78ab1d tempest-VolumeRetypeWithoutMigrationTest-1021880692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:48:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-8953fcb8-3172-4d39-af51-03a98c78ab1d tempest-VolumeRetypeWithoutMigrationTest-1021880692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:48:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8953fcb8-3172-4d39-af51-03a98c78ab1d tempest-VolumeRetypeWithoutMigrationTest-1021880692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:48:59 devstack sudo[95526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:48:59 devstack sudo[95526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:00 devstack sudo[95526]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8953fcb8-3172-4d39-af51-03a98c78ab1d tempest-VolumeRetypeWithoutMigrationTest-1021880692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.915s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:00 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-8953fcb8-3172-4d39-af51-03a98c78ab1d tempest-VolumeRetypeWithoutMigrationTest-1021880692 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:49:00 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-8953fcb8-3172-4d39-af51-03a98c78ab1d tempest-VolumeRetypeWithoutMigrationTest-1021880692 None] Deleted volume successfully. Jul 08 01:49:00 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-8953fcb8-3172-4d39-af51-03a98c78ab1d tempest-VolumeRetypeWithoutMigrationTest-1021880692 None] Lock "cinder-41b8338d-23ec-4916-ace7-a0c24145ef9a-delete_volume" released by "delete_volume" :: held 2.894s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:49:01 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-2a3fd04d-e4b3-412b-b00a-28ef894f2c90 tempest-VolumeQuotasNegativeTestJSON-2109613326 None] Acquiring lock "cinder-e8e77c53-2c55-4c00-a61e-2f4d58746344-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:49:01 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-2a3fd04d-e4b3-412b-b00a-28ef894f2c90 tempest-VolumeQuotasNegativeTestJSON-2109613326 None] Lock "cinder-e8e77c53-2c55-4c00-a61e-2f4d58746344-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:49:01 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-2a3fd04d-e4b3-412b-b00a-28ef894f2c90 tempest-VolumeQuotasNegativeTestJSON-2109613326 None] Acquiring lock "cinder-quobyte-e8e77c53-2c55-4c00-a61e-2f4d58746344" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:49:01 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-2a3fd04d-e4b3-412b-b00a-28ef894f2c90 tempest-VolumeQuotasNegativeTestJSON-2109613326 None] Lock "cinder-quobyte-e8e77c53-2c55-4c00-a61e-2f4d58746344" acquired by "delete_volume" :: waited 0.025s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:49:01 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[3759d28d-1316-4a3d-8f3d-e9d9e26d72a3]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:49:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2a3fd04d-e4b3-412b-b00a-28ef894f2c90 tempest-VolumeQuotasNegativeTestJSON-2109613326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e8e77c53-2c55-4c00-a61e-2f4d58746344 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:01 devstack sudo[95531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e8e77c53-2c55-4c00-a61e-2f4d58746344 Jul 08 01:49:01 devstack sudo[95531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:02 devstack sudo[95531]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2a3fd04d-e4b3-412b-b00a-28ef894f2c90 tempest-VolumeQuotasNegativeTestJSON-2109613326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e8e77c53-2c55-4c00-a61e-2f4d58746344" returned: 0 in 1.208s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2a3fd04d-e4b3-412b-b00a-28ef894f2c90 tempest-VolumeQuotasNegativeTestJSON-2109613326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e8e77c53-2c55-4c00-a61e-2f4d58746344 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:02 devstack sudo[95538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e8e77c53-2c55-4c00-a61e-2f4d58746344 Jul 08 01:49:02 devstack sudo[95538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:03 devstack sudo[95538]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:03 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2a3fd04d-e4b3-412b-b00a-28ef894f2c90 tempest-VolumeQuotasNegativeTestJSON-2109613326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e8e77c53-2c55-4c00-a61e-2f4d58746344" returned: 0 in 0.930s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:03 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-2a3fd04d-e4b3-412b-b00a-28ef894f2c90 tempest-VolumeQuotasNegativeTestJSON-2109613326 None] Lock "cinder-quobyte-e8e77c53-2c55-4c00-a61e-2f4d58746344" released by "delete_volume" :: held 2.191s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:49:03 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-2a3fd04d-e4b3-412b-b00a-28ef894f2c90 tempest-VolumeQuotasNegativeTestJSON-2109613326 None] Created reservations ['6ffe480d-9eca-42f7-8198-8739debc7bd3', '5c25e070-5988-4dd1-ba46-fb967b880a91', '9aa13517-5b9a-43db-80e2-2d630603c3b9', '218b1ed6-68ae-417c-b193-00ef83f36325'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:49:03 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-2a3fd04d-e4b3-412b-b00a-28ef894f2c90 tempest-VolumeQuotasNegativeTestJSON-2109613326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:49:03 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-2a3fd04d-e4b3-412b-b00a-28ef894f2c90 tempest-VolumeQuotasNegativeTestJSON-2109613326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:49:03 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-2a3fd04d-e4b3-412b-b00a-28ef894f2c90 tempest-VolumeQuotasNegativeTestJSON-2109613326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:49:03 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-2a3fd04d-e4b3-412b-b00a-28ef894f2c90 tempest-VolumeQuotasNegativeTestJSON-2109613326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:49:03 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-2a3fd04d-e4b3-412b-b00a-28ef894f2c90 tempest-VolumeQuotasNegativeTestJSON-2109613326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:49:03 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2a3fd04d-e4b3-412b-b00a-28ef894f2c90 tempest-VolumeQuotasNegativeTestJSON-2109613326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:03 devstack sudo[95541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:49:03 devstack sudo[95541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:04 devstack sudo[95541]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:04 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2a3fd04d-e4b3-412b-b00a-28ef894f2c90 tempest-VolumeQuotasNegativeTestJSON-2109613326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.748s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:04 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-2a3fd04d-e4b3-412b-b00a-28ef894f2c90 tempest-VolumeQuotasNegativeTestJSON-2109613326 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:49:04 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-2a3fd04d-e4b3-412b-b00a-28ef894f2c90 tempest-VolumeQuotasNegativeTestJSON-2109613326 None] Deleted volume successfully. Jul 08 01:49:04 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-2a3fd04d-e4b3-412b-b00a-28ef894f2c90 tempest-VolumeQuotasNegativeTestJSON-2109613326 None] Lock "cinder-e8e77c53-2c55-4c00-a61e-2f4d58746344-delete_volume" released by "delete_volume" :: held 3.221s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:49:13 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-7eeda5b7-c3b8-488f-b64a-053b59df3b88 tempest-SnapshotMetadataTestJSON-200518742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:49:13 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-7eeda5b7-c3b8-488f-b64a-053b59df3b88 tempest-SnapshotMetadataTestJSON-200518742 None] Flow 'volume_create_manager' (82fa6653-7f99-4580-ad13-4800fdbcbdc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:49:13 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-7eeda5b7-c3b8-488f-b64a-053b59df3b88 tempest-SnapshotMetadataTestJSON-200518742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed0ef7d7-ded4-445b-b6e6-8079eb27780c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:13 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-7eeda5b7-c3b8-488f-b64a-053b59df3b88 tempest-SnapshotMetadataTestJSON-200518742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed0ef7d7-ded4-445b-b6e6-8079eb27780c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:49:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1894194588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a20c3c5-78c6-41d1-a185-d7db20f205a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7739afbb8984473a9a4465beb43a6e76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:49:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:49:13Z,use_quota=True,user_id='c43143fdd8804ebca0087ab225b8a441',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:13 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-7eeda5b7-c3b8-488f-b64a-053b59df3b88 tempest-SnapshotMetadataTestJSON-200518742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (469b8d46-44f3-416e-9912-ae53cd3abfe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:13 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-7eeda5b7-c3b8-488f-b64a-053b59df3b88 tempest-SnapshotMetadataTestJSON-200518742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (469b8d46-44f3-416e-9912-ae53cd3abfe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:13 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-7eeda5b7-c3b8-488f-b64a-053b59df3b88 tempest-SnapshotMetadataTestJSON-200518742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73db7991-78c4-4d22-a2b1-d9e2e58995f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:13 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-7eeda5b7-c3b8-488f-b64a-053b59df3b88 tempest-SnapshotMetadataTestJSON-200518742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73db7991-78c4-4d22-a2b1-d9e2e58995f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a20c3c5-78c6-41d1-a185-d7db20f205a4', 'volume_name': 'volume-8a20c3c5-78c6-41d1-a185-d7db20f205a4', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:13 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-7eeda5b7-c3b8-488f-b64a-053b59df3b88 tempest-SnapshotMetadataTestJSON-200518742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33a68c6e-fa85-45b9-9901-ffb63fa4b701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:13 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-7eeda5b7-c3b8-488f-b64a-053b59df3b88 tempest-SnapshotMetadataTestJSON-200518742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33a68c6e-fa85-45b9-9901-ffb63fa4b701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:13 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-7eeda5b7-c3b8-488f-b64a-053b59df3b88 tempest-SnapshotMetadataTestJSON-200518742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7973661e-9695-4390-b3a6-41122a9cc19b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:13 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-7eeda5b7-c3b8-488f-b64a-053b59df3b88 tempest-SnapshotMetadataTestJSON-200518742 None] Volume 8a20c3c5-78c6-41d1-a185-d7db20f205a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a20c3c5-78c6-41d1-a185-d7db20f205a4', 'volume_size': 1} Jul 08 01:49:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7eeda5b7-c3b8-488f-b64a-053b59df3b88 tempest-SnapshotMetadataTestJSON-200518742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:49:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7eeda5b7-c3b8-488f-b64a-053b59df3b88 tempest-SnapshotMetadataTestJSON-200518742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:49:13 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-7eeda5b7-c3b8-488f-b64a-053b59df3b88 tempest-SnapshotMetadataTestJSON-200518742 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:49:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1894194588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a20c3c5-78c6-41d1-a185-d7db20f205a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7739afbb8984473a9a4465beb43a6e76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:49:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:49:13Z,use_quota=True,user_id='c43143fdd8804ebca0087ab225b8a441',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:49:13 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-7eeda5b7-c3b8-488f-b64a-053b59df3b88 tempest-SnapshotMetadataTestJSON-200518742 None] Creating volume 8a20c3c5-78c6-41d1-a185-d7db20f205a4 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:49:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7eeda5b7-c3b8-488f-b64a-053b59df3b88 tempest-SnapshotMetadataTestJSON-200518742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:49:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7eeda5b7-c3b8-488f-b64a-053b59df3b88 tempest-SnapshotMetadataTestJSON-200518742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:49:13 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-7eeda5b7-c3b8-488f-b64a-053b59df3b88 tempest-SnapshotMetadataTestJSON-200518742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:49:13 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-7eeda5b7-c3b8-488f-b64a-053b59df3b88 tempest-SnapshotMetadataTestJSON-200518742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:49:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7eeda5b7-c3b8-488f-b64a-053b59df3b88 tempest-SnapshotMetadataTestJSON-200518742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:49:13 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-7eeda5b7-c3b8-488f-b64a-053b59df3b88 tempest-SnapshotMetadataTestJSON-200518742 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:49:13 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-7eeda5b7-c3b8-488f-b64a-053b59df3b88 tempest-SnapshotMetadataTestJSON-200518742 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:49:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7eeda5b7-c3b8-488f-b64a-053b59df3b88 tempest-SnapshotMetadataTestJSON-200518742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8a20c3c5-78c6-41d1-a185-d7db20f205a4 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:13 devstack sudo[95551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8a20c3c5-78c6-41d1-a185-d7db20f205a4 1073741824 Jul 08 01:49:13 devstack sudo[95551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:14 devstack sudo[95551]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:14 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7eeda5b7-c3b8-488f-b64a-053b59df3b88 tempest-SnapshotMetadataTestJSON-200518742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8a20c3c5-78c6-41d1-a185-d7db20f205a4 1073741824" returned: 0 in 1.424s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:14 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7eeda5b7-c3b8-488f-b64a-053b59df3b88 tempest-SnapshotMetadataTestJSON-200518742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8a20c3c5-78c6-41d1-a185-d7db20f205a4 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:14 devstack sudo[95574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8a20c3c5-78c6-41d1-a185-d7db20f205a4 Jul 08 01:49:14 devstack sudo[95574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:15 devstack sudo[95574]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7eeda5b7-c3b8-488f-b64a-053b59df3b88 tempest-SnapshotMetadataTestJSON-200518742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8a20c3c5-78c6-41d1-a185-d7db20f205a4" returned: 0 in 0.931s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:15 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-7eeda5b7-c3b8-488f-b64a-053b59df3b88 tempest-SnapshotMetadataTestJSON-200518742 None] <== create_volume: return (2414ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:49:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7eeda5b7-c3b8-488f-b64a-053b59df3b88 tempest-SnapshotMetadataTestJSON-200518742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.417s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:49:15 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-7eeda5b7-c3b8-488f-b64a-053b59df3b88 tempest-SnapshotMetadataTestJSON-200518742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7973661e-9695-4390-b3a6-41122a9cc19b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a20c3c5-78c6-41d1-a185-d7db20f205a4', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:15 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-7eeda5b7-c3b8-488f-b64a-053b59df3b88 tempest-SnapshotMetadataTestJSON-200518742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8c579c7-37e3-43d1-a696-2bcac0262a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:15 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-7eeda5b7-c3b8-488f-b64a-053b59df3b88 tempest-SnapshotMetadataTestJSON-200518742 None] Volume volume-8a20c3c5-78c6-41d1-a185-d7db20f205a4 (8a20c3c5-78c6-41d1-a185-d7db20f205a4): created successfully Jul 08 01:49:15 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-7eeda5b7-c3b8-488f-b64a-053b59df3b88 tempest-SnapshotMetadataTestJSON-200518742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8c579c7-37e3-43d1-a696-2bcac0262a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:15 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-7eeda5b7-c3b8-488f-b64a-053b59df3b88 tempest-SnapshotMetadataTestJSON-200518742 None] Flow 'volume_create_manager' (82fa6653-7f99-4580-ad13-4800fdbcbdc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:49:15 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-7eeda5b7-c3b8-488f-b64a-053b59df3b88 tempest-SnapshotMetadataTestJSON-200518742 None] Created volume successfully. Jul 08 01:49:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-546a6540-281a-4da3-8bc3-780a6cd90670 tempest-SnapshotMetadataTestJSON-200518742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:49:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-546a6540-281a-4da3-8bc3-780a6cd90670 tempest-SnapshotMetadataTestJSON-200518742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:49:16 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-546a6540-281a-4da3-8bc3-780a6cd90670 tempest-SnapshotMetadataTestJSON-200518742 None] Creating offline snapshot d710a362-a7be-4de1-9148-0732c71ac72b of volume 8a20c3c5-78c6-41d1-a185-d7db20f205a4 {{(pid=87134) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:49:16 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[45155272-fd85-4de3-8584-17990ac924c8]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:49:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-546a6540-281a-4da3-8bc3-780a6cd90670 tempest-SnapshotMetadataTestJSON-200518742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8a20c3c5-78c6-41d1-a185-d7db20f205a4 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:16 devstack sudo[95577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8a20c3c5-78c6-41d1-a185-d7db20f205a4 Jul 08 01:49:16 devstack sudo[95577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:17 devstack sudo[95577]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-546a6540-281a-4da3-8bc3-780a6cd90670 tempest-SnapshotMetadataTestJSON-200518742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8a20c3c5-78c6-41d1-a185-d7db20f205a4" returned: 0 in 1.116s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-546a6540-281a-4da3-8bc3-780a6cd90670 tempest-SnapshotMetadataTestJSON-200518742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8a20c3c5-78c6-41d1-a185-d7db20f205a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8a20c3c5-78c6-41d1-a185-d7db20f205a4.d710a362-a7be-4de1-9148-0732c71ac72b 1G {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:17 devstack sudo[95582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8a20c3c5-78c6-41d1-a185-d7db20f205a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8a20c3c5-78c6-41d1-a185-d7db20f205a4.d710a362-a7be-4de1-9148-0732c71ac72b 1G Jul 08 01:49:17 devstack sudo[95582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:19 devstack sudo[95582]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-546a6540-281a-4da3-8bc3-780a6cd90670 tempest-SnapshotMetadataTestJSON-200518742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8a20c3c5-78c6-41d1-a185-d7db20f205a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8a20c3c5-78c6-41d1-a185-d7db20f205a4.d710a362-a7be-4de1-9148-0732c71ac72b 1G" returned: 0 in 1.510s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-546a6540-281a-4da3-8bc3-780a6cd90670 tempest-SnapshotMetadataTestJSON-200518742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a20c3c5-78c6-41d1-a185-d7db20f205a4 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8a20c3c5-78c6-41d1-a185-d7db20f205a4.d710a362-a7be-4de1-9148-0732c71ac72b {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:19 devstack sudo[95631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a20c3c5-78c6-41d1-a185-d7db20f205a4 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8a20c3c5-78c6-41d1-a185-d7db20f205a4.d710a362-a7be-4de1-9148-0732c71ac72b Jul 08 01:49:19 devstack sudo[95631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:20 devstack sudo[95631]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-546a6540-281a-4da3-8bc3-780a6cd90670 tempest-SnapshotMetadataTestJSON-200518742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a20c3c5-78c6-41d1-a185-d7db20f205a4 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8a20c3c5-78c6-41d1-a185-d7db20f205a4.d710a362-a7be-4de1-9148-0732c71ac72b" returned: 0 in 0.895s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:20 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-546a6540-281a-4da3-8bc3-780a6cd90670 tempest-SnapshotMetadataTestJSON-200518742 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8a20c3c5-78c6-41d1-a185-d7db20f205a4.d710a362-a7be-4de1-9148-0732c71ac72b is being set with open permissions: ugo+rw Jul 08 01:49:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-546a6540-281a-4da3-8bc3-780a6cd90670 tempest-SnapshotMetadataTestJSON-200518742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8a20c3c5-78c6-41d1-a185-d7db20f205a4.d710a362-a7be-4de1-9148-0732c71ac72b {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:20 devstack sudo[95659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8a20c3c5-78c6-41d1-a185-d7db20f205a4.d710a362-a7be-4de1-9148-0732c71ac72b Jul 08 01:49:20 devstack sudo[95659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:20 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6b2cf8d-36cc-4799-94c5-1c3830e414c7 tempest-VolumesListAdminTestJSON-605819604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:49:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c6b2cf8d-36cc-4799-94c5-1c3830e414c7 tempest-VolumesListAdminTestJSON-605819604 None] Flow 'volume_create_manager' (d7dad2b2-3abd-4f90-8f66-e912991ae429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:49:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c6b2cf8d-36cc-4799-94c5-1c3830e414c7 tempest-VolumesListAdminTestJSON-605819604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd1299da-1d4d-45ca-af34-5de6279dbc05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c6b2cf8d-36cc-4799-94c5-1c3830e414c7 tempest-VolumesListAdminTestJSON-605819604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd1299da-1d4d-45ca-af34-5de6279dbc05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:49:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1830079032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a245c3c9-ea62-46ab-abbe-b5593e5f6159,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2775d2facb484ba38bf51b5cfa673119',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:49:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:49:21Z,use_quota=True,user_id='c243f811c5c14fee9a1c494ec6eee887',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c6b2cf8d-36cc-4799-94c5-1c3830e414c7 tempest-VolumesListAdminTestJSON-605819604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (491fd663-a8ec-4dfa-bd0b-846c6c1407de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c6b2cf8d-36cc-4799-94c5-1c3830e414c7 tempest-VolumesListAdminTestJSON-605819604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (491fd663-a8ec-4dfa-bd0b-846c6c1407de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c6b2cf8d-36cc-4799-94c5-1c3830e414c7 tempest-VolumesListAdminTestJSON-605819604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf91dccd-a3ce-4101-8352-d88b34875e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c6b2cf8d-36cc-4799-94c5-1c3830e414c7 tempest-VolumesListAdminTestJSON-605819604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf91dccd-a3ce-4101-8352-d88b34875e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a245c3c9-ea62-46ab-abbe-b5593e5f6159', 'volume_name': 'volume-a245c3c9-ea62-46ab-abbe-b5593e5f6159', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c6b2cf8d-36cc-4799-94c5-1c3830e414c7 tempest-VolumesListAdminTestJSON-605819604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1cc45bb-7a37-4db0-8c58-70e0d20b724c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c6b2cf8d-36cc-4799-94c5-1c3830e414c7 tempest-VolumesListAdminTestJSON-605819604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1cc45bb-7a37-4db0-8c58-70e0d20b724c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c6b2cf8d-36cc-4799-94c5-1c3830e414c7 tempest-VolumesListAdminTestJSON-605819604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5409dbd6-ceca-4f4e-98ce-9fad43b478e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:20 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-c6b2cf8d-36cc-4799-94c5-1c3830e414c7 tempest-VolumesListAdminTestJSON-605819604 None] Volume a245c3c9-ea62-46ab-abbe-b5593e5f6159: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a245c3c9-ea62-46ab-abbe-b5593e5f6159', 'volume_size': 1} Jul 08 01:49:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c6b2cf8d-36cc-4799-94c5-1c3830e414c7 tempest-VolumesListAdminTestJSON-605819604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:49:20 devstack cinder-volume[87134]: DEBUG oslo_service.periodic_task [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87134) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:49:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:49:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:49:20 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:49:20 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:49:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:49:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:20 devstack sudo[95662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:49:20 devstack sudo[95662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:21 devstack sudo[95659]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-546a6540-281a-4da3-8bc3-780a6cd90670 tempest-SnapshotMetadataTestJSON-200518742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8a20c3c5-78c6-41d1-a185-d7db20f205a4.d710a362-a7be-4de1-9148-0732c71ac72b" returned: 0 in 0.847s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-546a6540-281a-4da3-8bc3-780a6cd90670 tempest-SnapshotMetadataTestJSON-200518742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8a20c3c5-78c6-41d1-a185-d7db20f205a4.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:21 devstack sudo[95664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8a20c3c5-78c6-41d1-a185-d7db20f205a4.info Jul 08 01:49:21 devstack sudo[95664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:21 devstack sudo[95662]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.866s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:21 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:49:21 devstack cinder-volume[87134]: DEBUG oslo_service.periodic_task [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running periodic task VolumeManager._thread_info {{(pid=87134) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:49:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] thread count: 8 {{(pid=87134) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:49:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] thread info: [<_MainThread(MainThread, started 129378964615296)>, , , , , , , ] {{(pid=87134) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:49:22 devstack sudo[95664]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-546a6540-281a-4da3-8bc3-780a6cd90670 tempest-SnapshotMetadataTestJSON-200518742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8a20c3c5-78c6-41d1-a185-d7db20f205a4.info" returned: 0 in 1.126s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:22 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-546a6540-281a-4da3-8bc3-780a6cd90670 tempest-SnapshotMetadataTestJSON-200518742 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8a20c3c5-78c6-41d1-a185-d7db20f205a4.info is being set with open permissions: ugo+rw Jul 08 01:49:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-546a6540-281a-4da3-8bc3-780a6cd90670 tempest-SnapshotMetadataTestJSON-200518742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8a20c3c5-78c6-41d1-a185-d7db20f205a4.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:22 devstack sudo[95670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8a20c3c5-78c6-41d1-a185-d7db20f205a4.info Jul 08 01:49:22 devstack sudo[95670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:23 devstack sudo[95670]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:23 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-546a6540-281a-4da3-8bc3-780a6cd90670 tempest-SnapshotMetadataTestJSON-200518742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8a20c3c5-78c6-41d1-a185-d7db20f205a4.info" returned: 0 in 0.842s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:23 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-546a6540-281a-4da3-8bc3-780a6cd90670 tempest-SnapshotMetadataTestJSON-200518742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.501s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:49:23 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c6b2cf8d-36cc-4799-94c5-1c3830e414c7 tempest-VolumesListAdminTestJSON-605819604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.213s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:49:23 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-c6b2cf8d-36cc-4799-94c5-1c3830e414c7 tempest-VolumesListAdminTestJSON-605819604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:49:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1830079032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a245c3c9-ea62-46ab-abbe-b5593e5f6159,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2775d2facb484ba38bf51b5cfa673119',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:49:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:49:21Z,use_quota=True,user_id='c243f811c5c14fee9a1c494ec6eee887',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:49:23 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-c6b2cf8d-36cc-4799-94c5-1c3830e414c7 tempest-VolumesListAdminTestJSON-605819604 None] Creating volume a245c3c9-ea62-46ab-abbe-b5593e5f6159 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:49:23 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c6b2cf8d-36cc-4799-94c5-1c3830e414c7 tempest-VolumesListAdminTestJSON-605819604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:49:23 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c6b2cf8d-36cc-4799-94c5-1c3830e414c7 tempest-VolumesListAdminTestJSON-605819604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:49:23 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-c6b2cf8d-36cc-4799-94c5-1c3830e414c7 tempest-VolumesListAdminTestJSON-605819604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:49:23 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-c6b2cf8d-36cc-4799-94c5-1c3830e414c7 tempest-VolumesListAdminTestJSON-605819604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:49:23 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c6b2cf8d-36cc-4799-94c5-1c3830e414c7 tempest-VolumesListAdminTestJSON-605819604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:49:23 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-c6b2cf8d-36cc-4799-94c5-1c3830e414c7 tempest-VolumesListAdminTestJSON-605819604 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:49:23 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-c6b2cf8d-36cc-4799-94c5-1c3830e414c7 tempest-VolumesListAdminTestJSON-605819604 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:49:23 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c6b2cf8d-36cc-4799-94c5-1c3830e414c7 tempest-VolumesListAdminTestJSON-605819604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a245c3c9-ea62-46ab-abbe-b5593e5f6159 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:23 devstack cinder-volume[87134]: DEBUG dbcounter [-] [87134] Writing DB stats cinder:UPDATE=100,cinder:SELECT=96,cinder:INSERT=19,cinder:DELETE=8 {{(pid=87134) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:49:23 devstack cinder-volume[87134]: DEBUG dbcounter [-] [87134] Writing DB stats cinder:SELECT=84,cinder:UPDATE=107,cinder:INSERT=25,cinder:DELETE=5 {{(pid=87134) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:49:23 devstack sudo[95674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a245c3c9-ea62-46ab-abbe-b5593e5f6159 1073741824 Jul 08 01:49:23 devstack sudo[95674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:23 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-546a6540-281a-4da3-8bc3-780a6cd90670 tempest-SnapshotMetadataTestJSON-200518742 None] Create snapshot completed successfully Jul 08 01:49:24 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb4628b9-b120-4357-9a77-4e826928d3fc tempest-VolumesImageMetadata-1716837216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:49:24 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-eb4628b9-b120-4357-9a77-4e826928d3fc tempest-VolumesImageMetadata-1716837216 None] Flow 'volume_create_manager' (75c454e7-ea07-4f3a-a090-be37d0250d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:49:24 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-eb4628b9-b120-4357-9a77-4e826928d3fc tempest-VolumesImageMetadata-1716837216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ad17314-94e2-42f0-beb4-ff752dc53d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:24 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-eb4628b9-b120-4357-9a77-4e826928d3fc tempest-VolumesImageMetadata-1716837216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ad17314-94e2-42f0-beb4-ff752dc53d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:49:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1375634232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4312223-7f73-4624-bbd8-18e280027184,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a75e1c31ce4417ca459c6bc2b8e3ec8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:49:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:49:24Z,use_quota=True,user_id='e4594b15493347519d959600515434e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:24 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-eb4628b9-b120-4357-9a77-4e826928d3fc tempest-VolumesImageMetadata-1716837216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4efd947f-eaad-4aac-a955-5a105839cfd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:24 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-eb4628b9-b120-4357-9a77-4e826928d3fc tempest-VolumesImageMetadata-1716837216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4efd947f-eaad-4aac-a955-5a105839cfd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:24 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-eb4628b9-b120-4357-9a77-4e826928d3fc tempest-VolumesImageMetadata-1716837216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32ad314c-a0b5-4db9-ba99-52cf074f193d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:24 devstack cinder-volume[87134]: DEBUG cinder.image.glance [None req-eb4628b9-b120-4357-9a77-4e826928d3fc tempest-VolumesImageMetadata-1716837216 None] Creating Keystone auth plugin from conf {{(pid=87134) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 01:49:24 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-eb4628b9-b120-4357-9a77-4e826928d3fc tempest-VolumesImageMetadata-1716837216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32ad314c-a0b5-4db9-ba99-52cf074f193d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd4312223-7f73-4624-bbd8-18e280027184', 'volume_name': 'volume-d4312223-7f73-4624-bbd8-18e280027184', 'volume_size': 1, 'image_id': 'd85f0fe5-8496-4fc8-ab6c-110323b36076', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d85f0fe5-8496-4fc8-ab6c-110323b36076', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '44fe2859624d49239062555b2318d354', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd85f0fe5-8496-4fc8-ab6c-110323b36076', 'created_at': datetime.datetime(2026, 7, 7, 23, 34, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 34, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d85f0fe5-8496-4fc8-ab6c-110323b36076/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:24 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-eb4628b9-b120-4357-9a77-4e826928d3fc tempest-VolumesImageMetadata-1716837216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69da6ea9-8bfd-43e5-b51f-62525df14e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:24 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-eb4628b9-b120-4357-9a77-4e826928d3fc tempest-VolumesImageMetadata-1716837216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69da6ea9-8bfd-43e5-b51f-62525df14e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:24 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-eb4628b9-b120-4357-9a77-4e826928d3fc tempest-VolumesImageMetadata-1716837216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (577ad878-589b-4972-941d-5c8e6cbdcbae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:24 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-eb4628b9-b120-4357-9a77-4e826928d3fc tempest-VolumesImageMetadata-1716837216 None] Volume d4312223-7f73-4624-bbd8-18e280027184: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d4312223-7f73-4624-bbd8-18e280027184', 'volume_size': 1, 'image_id': 'd85f0fe5-8496-4fc8-ab6c-110323b36076', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d85f0fe5-8496-4fc8-ab6c-110323b36076', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '44fe2859624d49239062555b2318d354', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd85f0fe5-8496-4fc8-ab6c-110323b36076', 'created_at': datetime.datetime(2026, 7, 7, 23, 34, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 34, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d85f0fe5-8496-4fc8-ab6c-110323b36076/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 08 01:49:24 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb4628b9-b120-4357-9a77-4e826928d3fc tempest-VolumesImageMetadata-1716837216 None] Trying to clone d4312223-7f73-4624-bbd8-18e280027184 from image d85f0fe5-8496-4fc8-ab6c-110323b36076 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d85f0fe5-8496-4fc8-ab6c-110323b36076', 'metadata': {}}]). {{(pid=87134) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 01:49:25 devstack sudo[95674]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:25 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c6b2cf8d-36cc-4799-94c5-1c3830e414c7 tempest-VolumesListAdminTestJSON-605819604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a245c3c9-ea62-46ab-abbe-b5593e5f6159 1073741824" returned: 0 in 2.045s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:25 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c6b2cf8d-36cc-4799-94c5-1c3830e414c7 tempest-VolumesListAdminTestJSON-605819604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a245c3c9-ea62-46ab-abbe-b5593e5f6159 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:25 devstack sudo[95736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a245c3c9-ea62-46ab-abbe-b5593e5f6159 Jul 08 01:49:25 devstack sudo[95736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:25 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-c893323a-5cb0-4fa7-bade-5b41b431b3ad tempest-SnapshotMetadataTestJSON-200518742 None] Acquiring lock "cinder-d710a362-a7be-4de1-9148-0732c71ac72b-delete_snapshot" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:49:25 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-c893323a-5cb0-4fa7-bade-5b41b431b3ad tempest-SnapshotMetadataTestJSON-200518742 None] Lock "cinder-d710a362-a7be-4de1-9148-0732c71ac72b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.071s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:49:25 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-c893323a-5cb0-4fa7-bade-5b41b431b3ad tempest-SnapshotMetadataTestJSON-200518742 None] Acquiring lock "cinder-quobyte-8a20c3c5-78c6-41d1-a185-d7db20f205a4" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:49:25 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-c893323a-5cb0-4fa7-bade-5b41b431b3ad tempest-SnapshotMetadataTestJSON-200518742 None] Lock "cinder-quobyte-8a20c3c5-78c6-41d1-a185-d7db20f205a4" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:49:25 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-c893323a-5cb0-4fa7-bade-5b41b431b3ad tempest-SnapshotMetadataTestJSON-200518742 None] Acquiring lock "cinder-quobyte-d710a362-a7be-4de1-9148-0732c71ac72b" by "_delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:49:25 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-c893323a-5cb0-4fa7-bade-5b41b431b3ad tempest-SnapshotMetadataTestJSON-200518742 None] Lock "cinder-quobyte-d710a362-a7be-4de1-9148-0732c71ac72b" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:49:25 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-c893323a-5cb0-4fa7-bade-5b41b431b3ad tempest-SnapshotMetadataTestJSON-200518742 None] Deleting offline snapshot d710a362-a7be-4de1-9148-0732c71ac72b of volume 8a20c3c5-78c6-41d1-a185-d7db20f205a4 {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:49:25 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-c893323a-5cb0-4fa7-bade-5b41b431b3ad tempest-SnapshotMetadataTestJSON-200518742 None] snapshot_file for this snap is: volume-8a20c3c5-78c6-41d1-a185-d7db20f205a4.d710a362-a7be-4de1-9148-0732c71ac72b {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:49:25 devstack cinder-volume[87134]: DEBUG cinder.image.image_utils [None req-eb4628b9-b120-4357-9a77-4e826928d3fc tempest-VolumesImageMetadata-1716837216 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d85f0fe5-8496-4fc8-ab6c-110323b36076_rro69vygdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87134) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 01:49:25 devstack cinder-volume[87134]: INFO cinder.image.image_utils [None req-eb4628b9-b120-4357-9a77-4e826928d3fc tempest-VolumesImageMetadata-1716837216 None] Image download 20.69 MB at 20.69 MB/s Jul 08 01:49:25 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d26d6a7-f096-4a92-a315-f1faf0d9e3b7]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:49:25 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c893323a-5cb0-4fa7-bade-5b41b431b3ad tempest-SnapshotMetadataTestJSON-200518742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8a20c3c5-78c6-41d1-a185-d7db20f205a4.d710a362-a7be-4de1-9148-0732c71ac72b {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:25 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5acfeae-c50c-476d-ab3b-18b3b69cd196]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:49:25 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-eb4628b9-b120-4357-9a77-4e826928d3fc tempest-VolumesImageMetadata-1716837216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d85f0fe5-8496-4fc8-ab6c-110323b36076_rro69vygdevstack@QuobyteHD {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:25 devstack sudo[95741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8a20c3c5-78c6-41d1-a185-d7db20f205a4.d710a362-a7be-4de1-9148-0732c71ac72b Jul 08 01:49:25 devstack sudo[95741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:26 devstack sudo[95742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d85f0fe5-8496-4fc8-ab6c-110323b36076_rro69vygdevstack@QuobyteHD Jul 08 01:49:26 devstack sudo[95742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:26 devstack sudo[95736]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:26 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c6b2cf8d-36cc-4799-94c5-1c3830e414c7 tempest-VolumesListAdminTestJSON-605819604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a245c3c9-ea62-46ab-abbe-b5593e5f6159" returned: 0 in 1.019s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:26 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-c6b2cf8d-36cc-4799-94c5-1c3830e414c7 tempest-VolumesListAdminTestJSON-605819604 None] <== create_volume: return (3168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:49:26 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c6b2cf8d-36cc-4799-94c5-1c3830e414c7 tempest-VolumesListAdminTestJSON-605819604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.172s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:49:26 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c6b2cf8d-36cc-4799-94c5-1c3830e414c7 tempest-VolumesListAdminTestJSON-605819604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5409dbd6-ceca-4f4e-98ce-9fad43b478e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a245c3c9-ea62-46ab-abbe-b5593e5f6159', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:26 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c6b2cf8d-36cc-4799-94c5-1c3830e414c7 tempest-VolumesListAdminTestJSON-605819604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31342ced-3964-4102-8135-5efea13c280d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:26 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-c6b2cf8d-36cc-4799-94c5-1c3830e414c7 tempest-VolumesListAdminTestJSON-605819604 None] Volume volume-a245c3c9-ea62-46ab-abbe-b5593e5f6159 (a245c3c9-ea62-46ab-abbe-b5593e5f6159): created successfully Jul 08 01:49:26 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c6b2cf8d-36cc-4799-94c5-1c3830e414c7 tempest-VolumesListAdminTestJSON-605819604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31342ced-3964-4102-8135-5efea13c280d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:26 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c6b2cf8d-36cc-4799-94c5-1c3830e414c7 tempest-VolumesListAdminTestJSON-605819604 None] Flow 'volume_create_manager' (d7dad2b2-3abd-4f90-8f66-e912991ae429) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:49:26 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-c6b2cf8d-36cc-4799-94c5-1c3830e414c7 tempest-VolumesListAdminTestJSON-605819604 None] Created volume successfully. Jul 08 01:49:26 devstack sudo[95741]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:26 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c893323a-5cb0-4fa7-bade-5b41b431b3ad tempest-SnapshotMetadataTestJSON-200518742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8a20c3c5-78c6-41d1-a185-d7db20f205a4.d710a362-a7be-4de1-9148-0732c71ac72b" returned: 0 in 1.147s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:26 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-c893323a-5cb0-4fa7-bade-5b41b431b3ad tempest-SnapshotMetadataTestJSON-200518742 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a20c3c5-78c6-41d1-a185-d7db20f205a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:49:26 devstack sudo[95742]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:26 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-eb4628b9-b120-4357-9a77-4e826928d3fc tempest-VolumesImageMetadata-1716837216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d85f0fe5-8496-4fc8-ab6c-110323b36076_rro69vygdevstack@QuobyteHD" returned: 0 in 1.074s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:26 devstack cinder-volume[87134]: DEBUG cinder.image.image_utils [None req-eb4628b9-b120-4357-9a77-4e826928d3fc tempest-VolumesImageMetadata-1716837216 None] Temporary image d85f0fe5-8496-4fc8-ab6c-110323b36076 is fetched for user e4594b15493347519d959600515434e9. {{(pid=87134) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 01:49:26 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5d2b19-da52-46fb-a772-7c2eda8b91e4]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:49:26 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c893323a-5cb0-4fa7-bade-5b41b431b3ad tempest-SnapshotMetadataTestJSON-200518742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8a20c3c5-78c6-41d1-a185-d7db20f205a4 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:26 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3f1b7b-1570-492a-b649-7986d555099b]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:49:26 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-eb4628b9-b120-4357-9a77-4e826928d3fc tempest-VolumesImageMetadata-1716837216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d85f0fe5-8496-4fc8-ab6c-110323b36076_rro69vygdevstack@QuobyteHD {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:27 devstack sudo[95754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8a20c3c5-78c6-41d1-a185-d7db20f205a4 Jul 08 01:49:27 devstack sudo[95754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:27 devstack sudo[95755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d85f0fe5-8496-4fc8-ab6c-110323b36076_rro69vygdevstack@QuobyteHD Jul 08 01:49:27 devstack sudo[95755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:27 devstack sudo[95754]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:27 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c893323a-5cb0-4fa7-bade-5b41b431b3ad tempest-SnapshotMetadataTestJSON-200518742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8a20c3c5-78c6-41d1-a185-d7db20f205a4" returned: 0 in 0.984s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:27 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c893323a-5cb0-4fa7-bade-5b41b431b3ad tempest-SnapshotMetadataTestJSON-200518742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8a20c3c5-78c6-41d1-a185-d7db20f205a4.d710a362-a7be-4de1-9148-0732c71ac72b {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:27 devstack sudo[95762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8a20c3c5-78c6-41d1-a185-d7db20f205a4.d710a362-a7be-4de1-9148-0732c71ac72b Jul 08 01:49:27 devstack sudo[95762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:28 devstack sudo[95755]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:28 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-eb4628b9-b120-4357-9a77-4e826928d3fc tempest-VolumesImageMetadata-1716837216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d85f0fe5-8496-4fc8-ab6c-110323b36076_rro69vygdevstack@QuobyteHD" returned: 0 in 1.106s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:28 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-eb4628b9-b120-4357-9a77-4e826928d3fc tempest-VolumesImageMetadata-1716837216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:49:28 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-eb4628b9-b120-4357-9a77-4e826928d3fc tempest-VolumesImageMetadata-1716837216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:49:28 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-eb4628b9-b120-4357-9a77-4e826928d3fc tempest-VolumesImageMetadata-1716837216 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:49:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1375634232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4312223-7f73-4624-bbd8-18e280027184,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a75e1c31ce4417ca459c6bc2b8e3ec8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:49:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:49:24Z,use_quota=True,user_id='e4594b15493347519d959600515434e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:49:28 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-eb4628b9-b120-4357-9a77-4e826928d3fc tempest-VolumesImageMetadata-1716837216 None] Creating volume d4312223-7f73-4624-bbd8-18e280027184 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:49:28 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-eb4628b9-b120-4357-9a77-4e826928d3fc tempest-VolumesImageMetadata-1716837216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:49:28 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-eb4628b9-b120-4357-9a77-4e826928d3fc tempest-VolumesImageMetadata-1716837216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:49:28 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-eb4628b9-b120-4357-9a77-4e826928d3fc tempest-VolumesImageMetadata-1716837216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:49:28 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-eb4628b9-b120-4357-9a77-4e826928d3fc tempest-VolumesImageMetadata-1716837216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:49:28 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-eb4628b9-b120-4357-9a77-4e826928d3fc tempest-VolumesImageMetadata-1716837216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:49:28 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-eb4628b9-b120-4357-9a77-4e826928d3fc tempest-VolumesImageMetadata-1716837216 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:49:28 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-eb4628b9-b120-4357-9a77-4e826928d3fc tempest-VolumesImageMetadata-1716837216 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:49:28 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-eb4628b9-b120-4357-9a77-4e826928d3fc tempest-VolumesImageMetadata-1716837216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d4312223-7f73-4624-bbd8-18e280027184 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:28 devstack sudo[95766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d4312223-7f73-4624-bbd8-18e280027184 1073741824 Jul 08 01:49:28 devstack sudo[95766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:28 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e8b0c7b-1f96-4539-9c5e-8596379f0b37 tempest-VolumesListAdminTestJSON-605819604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:49:28 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1e8b0c7b-1f96-4539-9c5e-8596379f0b37 tempest-VolumesListAdminTestJSON-605819604 None] Flow 'volume_create_manager' (54417724-06bc-47e2-8509-a2cab7f46d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:49:28 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1e8b0c7b-1f96-4539-9c5e-8596379f0b37 tempest-VolumesListAdminTestJSON-605819604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f3c0277-e5be-40be-b2c7-52b49ecbd943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:28 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1e8b0c7b-1f96-4539-9c5e-8596379f0b37 tempest-VolumesListAdminTestJSON-605819604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f3c0277-e5be-40be-b2c7-52b49ecbd943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:49:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1832941257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=453ba4cf-7830-44c2-9712-ddc79db412fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2775d2facb484ba38bf51b5cfa673119',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:49:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:49:28Z,use_quota=True,user_id='c243f811c5c14fee9a1c494ec6eee887',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:28 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1e8b0c7b-1f96-4539-9c5e-8596379f0b37 tempest-VolumesListAdminTestJSON-605819604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2f25689-b7fc-4103-a227-3a9c9b5f00d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:28 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1e8b0c7b-1f96-4539-9c5e-8596379f0b37 tempest-VolumesListAdminTestJSON-605819604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2f25689-b7fc-4103-a227-3a9c9b5f00d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:28 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1e8b0c7b-1f96-4539-9c5e-8596379f0b37 tempest-VolumesListAdminTestJSON-605819604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e62471ba-6f74-4a36-8bdb-c7eab60c3819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:28 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1e8b0c7b-1f96-4539-9c5e-8596379f0b37 tempest-VolumesListAdminTestJSON-605819604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e62471ba-6f74-4a36-8bdb-c7eab60c3819) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '453ba4cf-7830-44c2-9712-ddc79db412fa', 'volume_name': 'volume-453ba4cf-7830-44c2-9712-ddc79db412fa', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:28 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1e8b0c7b-1f96-4539-9c5e-8596379f0b37 tempest-VolumesListAdminTestJSON-605819604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46e4781f-cb04-4c47-bf40-3054943d03a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:28 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1e8b0c7b-1f96-4539-9c5e-8596379f0b37 tempest-VolumesListAdminTestJSON-605819604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46e4781f-cb04-4c47-bf40-3054943d03a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:28 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1e8b0c7b-1f96-4539-9c5e-8596379f0b37 tempest-VolumesListAdminTestJSON-605819604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca3f5459-72e2-44f0-beb6-e32320215ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:28 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-1e8b0c7b-1f96-4539-9c5e-8596379f0b37 tempest-VolumesListAdminTestJSON-605819604 None] Volume 453ba4cf-7830-44c2-9712-ddc79db412fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-453ba4cf-7830-44c2-9712-ddc79db412fa', 'volume_size': 1} Jul 08 01:49:28 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-1e8b0c7b-1f96-4539-9c5e-8596379f0b37 tempest-VolumesListAdminTestJSON-605819604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:49:28 devstack sudo[95762]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:28 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c893323a-5cb0-4fa7-bade-5b41b431b3ad tempest-SnapshotMetadataTestJSON-200518742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8a20c3c5-78c6-41d1-a185-d7db20f205a4.d710a362-a7be-4de1-9148-0732c71ac72b" returned: 0 in 1.024s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:28 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c893323a-5cb0-4fa7-bade-5b41b431b3ad tempest-SnapshotMetadataTestJSON-200518742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8a20c3c5-78c6-41d1-a185-d7db20f205a4.d710a362-a7be-4de1-9148-0732c71ac72b {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:28 devstack sudo[95775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8a20c3c5-78c6-41d1-a185-d7db20f205a4.d710a362-a7be-4de1-9148-0732c71ac72b Jul 08 01:49:28 devstack sudo[95775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:28 devstack sudo[95766]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:28 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-eb4628b9-b120-4357-9a77-4e826928d3fc tempest-VolumesImageMetadata-1716837216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d4312223-7f73-4624-bbd8-18e280027184 1073741824" returned: 0 in 0.894s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-eb4628b9-b120-4357-9a77-4e826928d3fc tempest-VolumesImageMetadata-1716837216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d4312223-7f73-4624-bbd8-18e280027184 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:29 devstack sudo[95777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d4312223-7f73-4624-bbd8-18e280027184 Jul 08 01:49:29 devstack sudo[95777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:29 devstack sudo[95775]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c893323a-5cb0-4fa7-bade-5b41b431b3ad tempest-SnapshotMetadataTestJSON-200518742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8a20c3c5-78c6-41d1-a185-d7db20f205a4.d710a362-a7be-4de1-9148-0732c71ac72b" returned: 0 in 0.722s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:29 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-c893323a-5cb0-4fa7-bade-5b41b431b3ad tempest-SnapshotMetadataTestJSON-200518742 None] Lock "cinder-quobyte-d710a362-a7be-4de1-9148-0732c71ac72b" released by "_delete_snapshot" :: held 4.045s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:49:29 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-c893323a-5cb0-4fa7-bade-5b41b431b3ad tempest-SnapshotMetadataTestJSON-200518742 None] Lock "cinder-quobyte-8a20c3c5-78c6-41d1-a185-d7db20f205a4" released by "delete_snapshot" :: held 4.093s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:49:29 devstack sudo[95777]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-eb4628b9-b120-4357-9a77-4e826928d3fc tempest-VolumesImageMetadata-1716837216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d4312223-7f73-4624-bbd8-18e280027184" returned: 0 in 0.734s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:29 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-eb4628b9-b120-4357-9a77-4e826928d3fc tempest-VolumesImageMetadata-1716837216 None] <== create_volume: return (1682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:49:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-eb4628b9-b120-4357-9a77-4e826928d3fc tempest-VolumesImageMetadata-1716837216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.685s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:49:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-1e8b0c7b-1f96-4539-9c5e-8596379f0b37 tempest-VolumesListAdminTestJSON-605819604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.475s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:49:29 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-1e8b0c7b-1f96-4539-9c5e-8596379f0b37 tempest-VolumesListAdminTestJSON-605819604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:49:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1832941257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=453ba4cf-7830-44c2-9712-ddc79db412fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2775d2facb484ba38bf51b5cfa673119',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:49:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:49:28Z,use_quota=True,user_id='c243f811c5c14fee9a1c494ec6eee887',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:49:29 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-1e8b0c7b-1f96-4539-9c5e-8596379f0b37 tempest-VolumesListAdminTestJSON-605819604 None] Creating volume 453ba4cf-7830-44c2-9712-ddc79db412fa {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:49:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-1e8b0c7b-1f96-4539-9c5e-8596379f0b37 tempest-VolumesListAdminTestJSON-605819604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:49:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-1e8b0c7b-1f96-4539-9c5e-8596379f0b37 tempest-VolumesListAdminTestJSON-605819604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:49:29 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-1e8b0c7b-1f96-4539-9c5e-8596379f0b37 tempest-VolumesListAdminTestJSON-605819604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:49:29 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-1e8b0c7b-1f96-4539-9c5e-8596379f0b37 tempest-VolumesListAdminTestJSON-605819604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:49:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-1e8b0c7b-1f96-4539-9c5e-8596379f0b37 tempest-VolumesListAdminTestJSON-605819604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:49:29 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-1e8b0c7b-1f96-4539-9c5e-8596379f0b37 tempest-VolumesListAdminTestJSON-605819604 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:49:29 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-1e8b0c7b-1f96-4539-9c5e-8596379f0b37 tempest-VolumesListAdminTestJSON-605819604 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:49:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1e8b0c7b-1f96-4539-9c5e-8596379f0b37 tempest-VolumesListAdminTestJSON-605819604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-453ba4cf-7830-44c2-9712-ddc79db412fa 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:29 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-c893323a-5cb0-4fa7-bade-5b41b431b3ad tempest-SnapshotMetadataTestJSON-200518742 None] Created reservations ['f5affff0-89ca-487e-b893-ce0ae046b48a', 'ee983848-fc4a-465c-aa66-698a09ae8d87', '173b7619-a73d-47a0-bf12-dc8469df8317', '1f081a76-c459-468b-a8ae-3a4e279566a5'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:49:29 devstack sudo[95781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-453ba4cf-7830-44c2-9712-ddc79db412fa 1073741824 Jul 08 01:49:29 devstack sudo[95781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:29 devstack cinder-volume[87134]: DEBUG cinder.volume.volume_utils [None req-eb4628b9-b120-4357-9a77-4e826928d3fc tempest-VolumesImageMetadata-1716837216 None] Attempting download of d85f0fe5-8496-4fc8-ab6c-110323b36076 ((None, [{'url': 'file:///opt/stack/data/glance/images/d85f0fe5-8496-4fc8-ab6c-110323b36076', 'metadata': {}}])) to volume d4312223-7f73-4624-bbd8-18e280027184. {{(pid=87134) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 01:49:29 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-c893323a-5cb0-4fa7-bade-5b41b431b3ad tempest-SnapshotMetadataTestJSON-200518742 None] Delete snapshot completed successfully. Jul 08 01:49:29 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-c893323a-5cb0-4fa7-bade-5b41b431b3ad tempest-SnapshotMetadataTestJSON-200518742 None] Lock "cinder-d710a362-a7be-4de1-9148-0732c71ac72b-delete_snapshot" released by "delete_snapshot" :: held 4.376s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:49:29 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[8930cb02-882a-4a2d-a596-4d9332dcd65b]: (4, 'raw') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:49:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-eb4628b9-b120-4357-9a77-4e826928d3fc tempest-VolumesImageMetadata-1716837216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d85f0fe5-8496-4fc8-ab6c-110323b36076_zqxtfhzd {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:30 devstack sudo[95783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d85f0fe5-8496-4fc8-ab6c-110323b36076_zqxtfhzd Jul 08 01:49:30 devstack sudo[95783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:30 devstack sudo[95781]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1e8b0c7b-1f96-4539-9c5e-8596379f0b37 tempest-VolumesListAdminTestJSON-605819604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-453ba4cf-7830-44c2-9712-ddc79db412fa 1073741824" returned: 0 in 0.883s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1e8b0c7b-1f96-4539-9c5e-8596379f0b37 tempest-VolumesListAdminTestJSON-605819604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-453ba4cf-7830-44c2-9712-ddc79db412fa {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:30 devstack sudo[95796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-453ba4cf-7830-44c2-9712-ddc79db412fa Jul 08 01:49:30 devstack sudo[95796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:30 devstack sudo[95783]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-eb4628b9-b120-4357-9a77-4e826928d3fc tempest-VolumesImageMetadata-1716837216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d85f0fe5-8496-4fc8-ab6c-110323b36076_zqxtfhzd" returned: 0 in 0.911s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-eb4628b9-b120-4357-9a77-4e826928d3fc tempest-VolumesImageMetadata-1716837216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d85f0fe5-8496-4fc8-ab6c-110323b36076_zqxtfhzd {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:30 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a57b386c-28bb-416e-8e04-b5eda19c6da4 tempest-SnapshotMetadataTestJSON-200518742 None] Acquiring lock "cinder-8a20c3c5-78c6-41d1-a185-d7db20f205a4-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:49:30 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a57b386c-28bb-416e-8e04-b5eda19c6da4 tempest-SnapshotMetadataTestJSON-200518742 None] Lock "cinder-8a20c3c5-78c6-41d1-a185-d7db20f205a4-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:49:31 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a57b386c-28bb-416e-8e04-b5eda19c6da4 tempest-SnapshotMetadataTestJSON-200518742 None] Acquiring lock "cinder-quobyte-8a20c3c5-78c6-41d1-a185-d7db20f205a4" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:49:31 devstack sudo[95798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d85f0fe5-8496-4fc8-ab6c-110323b36076_zqxtfhzd Jul 08 01:49:31 devstack sudo[95798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:31 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a57b386c-28bb-416e-8e04-b5eda19c6da4 tempest-SnapshotMetadataTestJSON-200518742 None] Lock "cinder-quobyte-8a20c3c5-78c6-41d1-a185-d7db20f205a4" acquired by "delete_volume" :: waited 0.023s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:49:31 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d5b6d3-cb43-4007-b941-22932dde6613]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:49:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a57b386c-28bb-416e-8e04-b5eda19c6da4 tempest-SnapshotMetadataTestJSON-200518742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8a20c3c5-78c6-41d1-a185-d7db20f205a4 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:31 devstack sudo[95800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8a20c3c5-78c6-41d1-a185-d7db20f205a4 Jul 08 01:49:31 devstack sudo[95800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:31 devstack sudo[95796]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1e8b0c7b-1f96-4539-9c5e-8596379f0b37 tempest-VolumesListAdminTestJSON-605819604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-453ba4cf-7830-44c2-9712-ddc79db412fa" returned: 0 in 0.876s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:31 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-1e8b0c7b-1f96-4539-9c5e-8596379f0b37 tempest-VolumesListAdminTestJSON-605819604 None] <== create_volume: return (1825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:49:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-1e8b0c7b-1f96-4539-9c5e-8596379f0b37 tempest-VolumesListAdminTestJSON-605819604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.828s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:49:31 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1e8b0c7b-1f96-4539-9c5e-8596379f0b37 tempest-VolumesListAdminTestJSON-605819604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca3f5459-72e2-44f0-beb6-e32320215ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-453ba4cf-7830-44c2-9712-ddc79db412fa', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:31 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1e8b0c7b-1f96-4539-9c5e-8596379f0b37 tempest-VolumesListAdminTestJSON-605819604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81a152a3-159d-4ce0-a3a6-57a21301692f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:31 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-1e8b0c7b-1f96-4539-9c5e-8596379f0b37 tempest-VolumesListAdminTestJSON-605819604 None] Volume volume-453ba4cf-7830-44c2-9712-ddc79db412fa (453ba4cf-7830-44c2-9712-ddc79db412fa): created successfully Jul 08 01:49:31 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1e8b0c7b-1f96-4539-9c5e-8596379f0b37 tempest-VolumesListAdminTestJSON-605819604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81a152a3-159d-4ce0-a3a6-57a21301692f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:31 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1e8b0c7b-1f96-4539-9c5e-8596379f0b37 tempest-VolumesListAdminTestJSON-605819604 None] Flow 'volume_create_manager' (54417724-06bc-47e2-8509-a2cab7f46d93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:49:31 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-1e8b0c7b-1f96-4539-9c5e-8596379f0b37 tempest-VolumesListAdminTestJSON-605819604 None] Created volume successfully. Jul 08 01:49:31 devstack sudo[95798]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-eb4628b9-b120-4357-9a77-4e826928d3fc tempest-VolumesImageMetadata-1716837216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d85f0fe5-8496-4fc8-ab6c-110323b36076_zqxtfhzd" returned: 1 in 1.035s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-eb4628b9-b120-4357-9a77-4e826928d3fc tempest-VolumesImageMetadata-1716837216 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d85f0fe5-8496-4fc8-ab6c-110323b36076_zqxtfhzd' failed. Not Retrying. {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:49:31 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[3336bd5a-8c48-456d-95a8-8612f88754f9]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:49:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-eb4628b9-b120-4357-9a77-4e826928d3fc tempest-VolumesImageMetadata-1716837216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d85f0fe5-8496-4fc8-ab6c-110323b36076_rro69vygdevstack@QuobyteHD {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:32 devstack sudo[95807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d85f0fe5-8496-4fc8-ab6c-110323b36076_rro69vygdevstack@QuobyteHD Jul 08 01:49:32 devstack sudo[95807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:32 devstack sudo[95800]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a57b386c-28bb-416e-8e04-b5eda19c6da4 tempest-SnapshotMetadataTestJSON-200518742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8a20c3c5-78c6-41d1-a185-d7db20f205a4" returned: 0 in 1.038s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a57b386c-28bb-416e-8e04-b5eda19c6da4 tempest-SnapshotMetadataTestJSON-200518742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8a20c3c5-78c6-41d1-a185-d7db20f205a4 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:32 devstack sudo[95810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8a20c3c5-78c6-41d1-a185-d7db20f205a4 Jul 08 01:49:32 devstack sudo[95810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:32 devstack sudo[95807]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-eb4628b9-b120-4357-9a77-4e826928d3fc tempest-VolumesImageMetadata-1716837216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d85f0fe5-8496-4fc8-ab6c-110323b36076_rro69vygdevstack@QuobyteHD" returned: 0 in 0.867s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:32 devstack cinder-volume[87134]: DEBUG cinder.image.image_utils [None req-eb4628b9-b120-4357-9a77-4e826928d3fc tempest-VolumesImageMetadata-1716837216 None] d85f0fe5-8496-4fc8-ab6c-110323b36076 was qcow2, converting to raw {{(pid=87134) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 01:49:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-eb4628b9-b120-4357-9a77-4e826928d3fc tempest-VolumesImageMetadata-1716837216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d85f0fe5-8496-4fc8-ab6c-110323b36076_rro69vygdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d4312223-7f73-4624-bbd8-18e280027184 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:32 devstack sudo[95817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d85f0fe5-8496-4fc8-ab6c-110323b36076_rro69vygdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d4312223-7f73-4624-bbd8-18e280027184 Jul 08 01:49:32 devstack sudo[95817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:32 devstack sudo[95810]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a57b386c-28bb-416e-8e04-b5eda19c6da4 tempest-SnapshotMetadataTestJSON-200518742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8a20c3c5-78c6-41d1-a185-d7db20f205a4" returned: 0 in 0.881s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:33 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a57b386c-28bb-416e-8e04-b5eda19c6da4 tempest-SnapshotMetadataTestJSON-200518742 None] Lock "cinder-quobyte-8a20c3c5-78c6-41d1-a185-d7db20f205a4" released by "delete_volume" :: held 2.002s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:49:33 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-a57b386c-28bb-416e-8e04-b5eda19c6da4 tempest-SnapshotMetadataTestJSON-200518742 None] Created reservations ['0cecfb34-7950-4b1b-9348-05269d73b39d', '4278c3e3-639e-46af-8560-61dc247faaeb', '3fbd658c-d727-429a-ad90-c96a1cfe9db5', '02ebb77a-05de-45c0-a005-f618b7782520'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:49:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-a57b386c-28bb-416e-8e04-b5eda19c6da4 tempest-SnapshotMetadataTestJSON-200518742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:49:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-a57b386c-28bb-416e-8e04-b5eda19c6da4 tempest-SnapshotMetadataTestJSON-200518742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:49:33 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-a57b386c-28bb-416e-8e04-b5eda19c6da4 tempest-SnapshotMetadataTestJSON-200518742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:49:33 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-a57b386c-28bb-416e-8e04-b5eda19c6da4 tempest-SnapshotMetadataTestJSON-200518742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:49:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-a57b386c-28bb-416e-8e04-b5eda19c6da4 tempest-SnapshotMetadataTestJSON-200518742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:49:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a57b386c-28bb-416e-8e04-b5eda19c6da4 tempest-SnapshotMetadataTestJSON-200518742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:33 devstack sudo[95820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:49:33 devstack sudo[95820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:33 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd3e604d-6cc3-47a5-88a0-6bacbbad10e2 tempest-VolumesListAdminTestJSON-605819604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:49:33 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-cd3e604d-6cc3-47a5-88a0-6bacbbad10e2 tempest-VolumesListAdminTestJSON-605819604 None] Flow 'volume_create_manager' (86bd63a7-3729-40ed-9ded-85bccb2d0dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:49:33 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-cd3e604d-6cc3-47a5-88a0-6bacbbad10e2 tempest-VolumesListAdminTestJSON-605819604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2a7c9b2-cbd3-4519-8800-bc19e7073be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:33 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-cd3e604d-6cc3-47a5-88a0-6bacbbad10e2 tempest-VolumesListAdminTestJSON-605819604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2a7c9b2-cbd3-4519-8800-bc19e7073be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:49:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1573525971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd867651-de5a-43fa-b647-5e9487cd501a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2775d2facb484ba38bf51b5cfa673119',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:49:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:49:33Z,use_quota=True,user_id='c243f811c5c14fee9a1c494ec6eee887',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:33 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-cd3e604d-6cc3-47a5-88a0-6bacbbad10e2 tempest-VolumesListAdminTestJSON-605819604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bf1250b-1488-4e9e-b59e-3d8932f2336c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:33 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-cd3e604d-6cc3-47a5-88a0-6bacbbad10e2 tempest-VolumesListAdminTestJSON-605819604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bf1250b-1488-4e9e-b59e-3d8932f2336c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:33 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-cd3e604d-6cc3-47a5-88a0-6bacbbad10e2 tempest-VolumesListAdminTestJSON-605819604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fac3b25e-dddf-4b17-9396-0968ccec3982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:33 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-cd3e604d-6cc3-47a5-88a0-6bacbbad10e2 tempest-VolumesListAdminTestJSON-605819604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fac3b25e-dddf-4b17-9396-0968ccec3982) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd867651-de5a-43fa-b647-5e9487cd501a', 'volume_name': 'volume-fd867651-de5a-43fa-b647-5e9487cd501a', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:33 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-cd3e604d-6cc3-47a5-88a0-6bacbbad10e2 tempest-VolumesListAdminTestJSON-605819604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fd5fef2-57a7-4149-8a6e-dc4a2843b3df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:33 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-cd3e604d-6cc3-47a5-88a0-6bacbbad10e2 tempest-VolumesListAdminTestJSON-605819604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fd5fef2-57a7-4149-8a6e-dc4a2843b3df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:33 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-cd3e604d-6cc3-47a5-88a0-6bacbbad10e2 tempest-VolumesListAdminTestJSON-605819604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95b46274-5fe3-46f8-9c20-47e43c17f7eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:33 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-cd3e604d-6cc3-47a5-88a0-6bacbbad10e2 tempest-VolumesListAdminTestJSON-605819604 None] Volume fd867651-de5a-43fa-b647-5e9487cd501a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd867651-de5a-43fa-b647-5e9487cd501a', 'volume_size': 1} Jul 08 01:49:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-cd3e604d-6cc3-47a5-88a0-6bacbbad10e2 tempest-VolumesListAdminTestJSON-605819604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:49:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-cd3e604d-6cc3-47a5-88a0-6bacbbad10e2 tempest-VolumesListAdminTestJSON-605819604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:49:33 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-cd3e604d-6cc3-47a5-88a0-6bacbbad10e2 tempest-VolumesListAdminTestJSON-605819604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:49:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1573525971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd867651-de5a-43fa-b647-5e9487cd501a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2775d2facb484ba38bf51b5cfa673119',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:49:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:49:33Z,use_quota=True,user_id='c243f811c5c14fee9a1c494ec6eee887',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:49:33 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-cd3e604d-6cc3-47a5-88a0-6bacbbad10e2 tempest-VolumesListAdminTestJSON-605819604 None] Creating volume fd867651-de5a-43fa-b647-5e9487cd501a {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:49:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-cd3e604d-6cc3-47a5-88a0-6bacbbad10e2 tempest-VolumesListAdminTestJSON-605819604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:49:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-cd3e604d-6cc3-47a5-88a0-6bacbbad10e2 tempest-VolumesListAdminTestJSON-605819604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:49:33 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-cd3e604d-6cc3-47a5-88a0-6bacbbad10e2 tempest-VolumesListAdminTestJSON-605819604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:49:33 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-cd3e604d-6cc3-47a5-88a0-6bacbbad10e2 tempest-VolumesListAdminTestJSON-605819604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:49:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-cd3e604d-6cc3-47a5-88a0-6bacbbad10e2 tempest-VolumesListAdminTestJSON-605819604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:49:33 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-cd3e604d-6cc3-47a5-88a0-6bacbbad10e2 tempest-VolumesListAdminTestJSON-605819604 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:49:33 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-cd3e604d-6cc3-47a5-88a0-6bacbbad10e2 tempest-VolumesListAdminTestJSON-605819604 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:49:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-cd3e604d-6cc3-47a5-88a0-6bacbbad10e2 tempest-VolumesListAdminTestJSON-605819604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-fd867651-de5a-43fa-b647-5e9487cd501a 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:33 devstack sudo[95822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-fd867651-de5a-43fa-b647-5e9487cd501a 1073741824 Jul 08 01:49:33 devstack sudo[95822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:34 devstack sudo[95820]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a57b386c-28bb-416e-8e04-b5eda19c6da4 tempest-SnapshotMetadataTestJSON-200518742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 1.035s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:34 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-a57b386c-28bb-416e-8e04-b5eda19c6da4 tempest-SnapshotMetadataTestJSON-200518742 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:49:34 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-a57b386c-28bb-416e-8e04-b5eda19c6da4 tempest-SnapshotMetadataTestJSON-200518742 None] Deleted volume successfully. Jul 08 01:49:34 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a57b386c-28bb-416e-8e04-b5eda19c6da4 tempest-SnapshotMetadataTestJSON-200518742 None] Lock "cinder-8a20c3c5-78c6-41d1-a185-d7db20f205a4-delete_volume" released by "delete_volume" :: held 3.379s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:49:34 devstack sudo[95822]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-cd3e604d-6cc3-47a5-88a0-6bacbbad10e2 tempest-VolumesListAdminTestJSON-605819604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-fd867651-de5a-43fa-b647-5e9487cd501a 1073741824" returned: 0 in 1.287s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-cd3e604d-6cc3-47a5-88a0-6bacbbad10e2 tempest-VolumesListAdminTestJSON-605819604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-fd867651-de5a-43fa-b647-5e9487cd501a {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:34 devstack sudo[95857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-fd867651-de5a-43fa-b647-5e9487cd501a Jul 08 01:49:34 devstack sudo[95857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:35 devstack sudo[95817]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-eb4628b9-b120-4357-9a77-4e826928d3fc tempest-VolumesImageMetadata-1716837216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d85f0fe5-8496-4fc8-ab6c-110323b36076_rro69vygdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d4312223-7f73-4624-bbd8-18e280027184" returned: 0 in 2.774s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:35 devstack cinder-volume[87134]: DEBUG cinder.image.image_utils [None req-eb4628b9-b120-4357-9a77-4e826928d3fc tempest-VolumesImageMetadata-1716837216 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d85f0fe5-8496-4fc8-ab6c-110323b36076_rro69vygdevstack@QuobyteHD, size 112.00 MB, duration 2.77 sec, destination /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d4312223-7f73-4624-bbd8-18e280027184 {{(pid=87134) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:49:35 devstack cinder-volume[87134]: INFO cinder.image.image_utils [None req-eb4628b9-b120-4357-9a77-4e826928d3fc tempest-VolumesImageMetadata-1716837216 None] Converted 112.00 MB image at 40.36 MB/s Jul 08 01:49:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-eb4628b9-b120-4357-9a77-4e826928d3fc tempest-VolumesImageMetadata-1716837216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d4312223-7f73-4624-bbd8-18e280027184 1G {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:35 devstack sudo[95861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d4312223-7f73-4624-bbd8-18e280027184 1G Jul 08 01:49:35 devstack sudo[95861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:35 devstack sudo[95857]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-cd3e604d-6cc3-47a5-88a0-6bacbbad10e2 tempest-VolumesListAdminTestJSON-605819604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-fd867651-de5a-43fa-b647-5e9487cd501a" returned: 0 in 0.955s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:35 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-cd3e604d-6cc3-47a5-88a0-6bacbbad10e2 tempest-VolumesListAdminTestJSON-605819604 None] <== create_volume: return (2300ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:49:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-cd3e604d-6cc3-47a5-88a0-6bacbbad10e2 tempest-VolumesListAdminTestJSON-605819604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.304s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:49:35 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-cd3e604d-6cc3-47a5-88a0-6bacbbad10e2 tempest-VolumesListAdminTestJSON-605819604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95b46274-5fe3-46f8-9c20-47e43c17f7eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd867651-de5a-43fa-b647-5e9487cd501a', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:35 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-cd3e604d-6cc3-47a5-88a0-6bacbbad10e2 tempest-VolumesListAdminTestJSON-605819604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4312cda8-0907-429c-9313-a9cd685fd93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:35 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-cd3e604d-6cc3-47a5-88a0-6bacbbad10e2 tempest-VolumesListAdminTestJSON-605819604 None] Volume volume-fd867651-de5a-43fa-b647-5e9487cd501a (fd867651-de5a-43fa-b647-5e9487cd501a): created successfully Jul 08 01:49:35 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-cd3e604d-6cc3-47a5-88a0-6bacbbad10e2 tempest-VolumesListAdminTestJSON-605819604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4312cda8-0907-429c-9313-a9cd685fd93f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:35 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-cd3e604d-6cc3-47a5-88a0-6bacbbad10e2 tempest-VolumesListAdminTestJSON-605819604 None] Flow 'volume_create_manager' (86bd63a7-3729-40ed-9ded-85bccb2d0dc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:49:35 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-cd3e604d-6cc3-47a5-88a0-6bacbbad10e2 tempest-VolumesListAdminTestJSON-605819604 None] Created volume successfully. Jul 08 01:49:36 devstack sudo[95861]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-eb4628b9-b120-4357-9a77-4e826928d3fc tempest-VolumesImageMetadata-1716837216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d4312223-7f73-4624-bbd8-18e280027184 1G" returned: 0 in 0.834s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:36 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[5abf75b4-bfe5-418b-b0cf-dcd614087320]: (4, 'raw') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:49:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-eb4628b9-b120-4357-9a77-4e826928d3fc tempest-VolumesImageMetadata-1716837216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d4312223-7f73-4624-bbd8-18e280027184 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:36 devstack sudo[95866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d4312223-7f73-4624-bbd8-18e280027184 Jul 08 01:49:36 devstack sudo[95866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:37 devstack sudo[95866]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-eb4628b9-b120-4357-9a77-4e826928d3fc tempest-VolumesImageMetadata-1716837216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d4312223-7f73-4624-bbd8-18e280027184" returned: 0 in 0.850s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-eb4628b9-b120-4357-9a77-4e826928d3fc tempest-VolumesImageMetadata-1716837216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d4312223-7f73-4624-bbd8-18e280027184 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:37 devstack sudo[95870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d4312223-7f73-4624-bbd8-18e280027184 Jul 08 01:49:37 devstack sudo[95870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:37 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4e9e038-d159-457d-9ba2-f7a11f974164 tempest-VolumesListAdminTestJSON-1196937071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:49:37 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f4e9e038-d159-457d-9ba2-f7a11f974164 tempest-VolumesListAdminTestJSON-1196937071 None] Flow 'volume_create_manager' (2f84bc05-58fd-4ed3-a19f-d5176f882698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:49:37 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f4e9e038-d159-457d-9ba2-f7a11f974164 tempest-VolumesListAdminTestJSON-1196937071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95ded516-6688-4e9f-9e73-99a66a2c1d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:37 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f4e9e038-d159-457d-9ba2-f7a11f974164 tempest-VolumesListAdminTestJSON-1196937071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95ded516-6688-4e9f-9e73-99a66a2c1d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:49:37Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cb85a18-3376-47b1-924f-c531e2734663,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00633eba23974256a57d08d0686466e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:49:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:49:37Z,use_quota=True,user_id='14cfce0b33aa454297683742c71e4645',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:37 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f4e9e038-d159-457d-9ba2-f7a11f974164 tempest-VolumesListAdminTestJSON-1196937071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67d687be-1d1a-4252-8c16-18b6e4a413d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:37 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f4e9e038-d159-457d-9ba2-f7a11f974164 tempest-VolumesListAdminTestJSON-1196937071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67d687be-1d1a-4252-8c16-18b6e4a413d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:37 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f4e9e038-d159-457d-9ba2-f7a11f974164 tempest-VolumesListAdminTestJSON-1196937071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c9c9da1-c9dc-48ce-9c26-507488d0b876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:37 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f4e9e038-d159-457d-9ba2-f7a11f974164 tempest-VolumesListAdminTestJSON-1196937071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c9c9da1-c9dc-48ce-9c26-507488d0b876) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cb85a18-3376-47b1-924f-c531e2734663', 'volume_name': 'volume-0cb85a18-3376-47b1-924f-c531e2734663', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:37 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f4e9e038-d159-457d-9ba2-f7a11f974164 tempest-VolumesListAdminTestJSON-1196937071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5249362-078d-4b23-955c-487cbc1fc185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:37 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f4e9e038-d159-457d-9ba2-f7a11f974164 tempest-VolumesListAdminTestJSON-1196937071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5249362-078d-4b23-955c-487cbc1fc185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:37 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f4e9e038-d159-457d-9ba2-f7a11f974164 tempest-VolumesListAdminTestJSON-1196937071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fadc5235-a414-4c0b-a5df-23796efc6a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:37 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-f4e9e038-d159-457d-9ba2-f7a11f974164 tempest-VolumesListAdminTestJSON-1196937071 None] Volume 0cb85a18-3376-47b1-924f-c531e2734663: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cb85a18-3376-47b1-924f-c531e2734663', 'volume_size': 1} Jul 08 01:49:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-f4e9e038-d159-457d-9ba2-f7a11f974164 tempest-VolumesListAdminTestJSON-1196937071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:49:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-f4e9e038-d159-457d-9ba2-f7a11f974164 tempest-VolumesListAdminTestJSON-1196937071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:49:37 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-f4e9e038-d159-457d-9ba2-f7a11f974164 tempest-VolumesListAdminTestJSON-1196937071 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:49:37Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cb85a18-3376-47b1-924f-c531e2734663,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00633eba23974256a57d08d0686466e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:49:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:49:37Z,use_quota=True,user_id='14cfce0b33aa454297683742c71e4645',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:49:37 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-f4e9e038-d159-457d-9ba2-f7a11f974164 tempest-VolumesListAdminTestJSON-1196937071 None] Creating volume 0cb85a18-3376-47b1-924f-c531e2734663 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:49:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-f4e9e038-d159-457d-9ba2-f7a11f974164 tempest-VolumesListAdminTestJSON-1196937071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:49:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-f4e9e038-d159-457d-9ba2-f7a11f974164 tempest-VolumesListAdminTestJSON-1196937071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:49:37 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-f4e9e038-d159-457d-9ba2-f7a11f974164 tempest-VolumesListAdminTestJSON-1196937071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:49:37 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-f4e9e038-d159-457d-9ba2-f7a11f974164 tempest-VolumesListAdminTestJSON-1196937071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:49:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-f4e9e038-d159-457d-9ba2-f7a11f974164 tempest-VolumesListAdminTestJSON-1196937071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:49:37 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-f4e9e038-d159-457d-9ba2-f7a11f974164 tempest-VolumesListAdminTestJSON-1196937071 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:49:37 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-f4e9e038-d159-457d-9ba2-f7a11f974164 tempest-VolumesListAdminTestJSON-1196937071 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:49:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f4e9e038-d159-457d-9ba2-f7a11f974164 tempest-VolumesListAdminTestJSON-1196937071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0cb85a18-3376-47b1-924f-c531e2734663 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:37 devstack sudo[95872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0cb85a18-3376-47b1-924f-c531e2734663 1073741824 Jul 08 01:49:37 devstack sudo[95872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:37 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-a729ead9-79f8-44e0-8095-5083c4f5647d tempest-VolumesMetadataTest-1467138846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:49:37 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-a729ead9-79f8-44e0-8095-5083c4f5647d tempest-VolumesMetadataTest-1467138846 None] Flow 'volume_create_manager' (67a4fe57-9089-4961-9498-2aeebefb0b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:49:37 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-a729ead9-79f8-44e0-8095-5083c4f5647d tempest-VolumesMetadataTest-1467138846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4318c72c-85bc-4bdc-a0ba-50508089be63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:38 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-a729ead9-79f8-44e0-8095-5083c4f5647d tempest-VolumesMetadataTest-1467138846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4318c72c-85bc-4bdc-a0ba-50508089be63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:49:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-702546444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=569822c3-2727-47ca-aab6-fc6b09b5fdcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d4953b99f0e4dde872a38b541f19efc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:49:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:49:38Z,use_quota=True,user_id='f7cbbf756556429c8a9296c14e888957',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:38 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-a729ead9-79f8-44e0-8095-5083c4f5647d tempest-VolumesMetadataTest-1467138846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dfd9e2c-cce5-4aff-b856-155838592102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:38 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-a729ead9-79f8-44e0-8095-5083c4f5647d tempest-VolumesMetadataTest-1467138846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dfd9e2c-cce5-4aff-b856-155838592102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:38 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-a729ead9-79f8-44e0-8095-5083c4f5647d tempest-VolumesMetadataTest-1467138846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23912273-b7e1-4411-a33a-19fb2f67a56c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:38 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-a729ead9-79f8-44e0-8095-5083c4f5647d tempest-VolumesMetadataTest-1467138846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23912273-b7e1-4411-a33a-19fb2f67a56c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '569822c3-2727-47ca-aab6-fc6b09b5fdcd', 'volume_name': 'volume-569822c3-2727-47ca-aab6-fc6b09b5fdcd', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:38 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-a729ead9-79f8-44e0-8095-5083c4f5647d tempest-VolumesMetadataTest-1467138846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b26ecec8-be37-479f-9c98-0b8062fb790e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:38 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-a729ead9-79f8-44e0-8095-5083c4f5647d tempest-VolumesMetadataTest-1467138846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b26ecec8-be37-479f-9c98-0b8062fb790e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:38 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-a729ead9-79f8-44e0-8095-5083c4f5647d tempest-VolumesMetadataTest-1467138846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be5a03df-bda6-44a7-b3d3-1245a2d1c7fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:38 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-a729ead9-79f8-44e0-8095-5083c4f5647d tempest-VolumesMetadataTest-1467138846 None] Volume 569822c3-2727-47ca-aab6-fc6b09b5fdcd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-569822c3-2727-47ca-aab6-fc6b09b5fdcd', 'volume_size': 1} Jul 08 01:49:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-a729ead9-79f8-44e0-8095-5083c4f5647d tempest-VolumesMetadataTest-1467138846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:49:38 devstack sudo[95870]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-eb4628b9-b120-4357-9a77-4e826928d3fc tempest-VolumesImageMetadata-1716837216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d4312223-7f73-4624-bbd8-18e280027184" returned: 1 in 0.829s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-eb4628b9-b120-4357-9a77-4e826928d3fc tempest-VolumesImageMetadata-1716837216 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d4312223-7f73-4624-bbd8-18e280027184' failed. Not Retrying. {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:49:38 devstack cinder-volume[87134]: DEBUG cinder.volume.volume_utils [None req-eb4628b9-b120-4357-9a77-4e826928d3fc tempest-VolumesImageMetadata-1716837216 None] Downloaded image d85f0fe5-8496-4fc8-ab6c-110323b36076 ((None, [{'url': 'file:///opt/stack/data/glance/images/d85f0fe5-8496-4fc8-ab6c-110323b36076', 'metadata': {}}])) to volume d4312223-7f73-4624-bbd8-18e280027184 successfully. {{(pid=87134) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 01:49:38 devstack cinder-volume[87134]: DEBUG cinder.image.image_utils [None req-eb4628b9-b120-4357-9a77-4e826928d3fc tempest-VolumesImageMetadata-1716837216 None] Temporary image d85f0fe5-8496-4fc8-ab6c-110323b36076 for user e4594b15493347519d959600515434e9 is deleted. {{(pid=87134) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 01:49:38 devstack cinder-volume[87134]: DEBUG cinder.volume.volume_utils [None req-eb4628b9-b120-4357-9a77-4e826928d3fc tempest-VolumesImageMetadata-1716837216 None] Marking volume d4312223-7f73-4624-bbd8-18e280027184 as bootable. {{(pid=87134) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 01:49:38 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb4628b9-b120-4357-9a77-4e826928d3fc tempest-VolumesImageMetadata-1716837216 None] Copying metadata from image d85f0fe5-8496-4fc8-ab6c-110323b36076 to d4312223-7f73-4624-bbd8-18e280027184. {{(pid=87134) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 01:49:38 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb4628b9-b120-4357-9a77-4e826928d3fc tempest-VolumesImageMetadata-1716837216 None] Creating volume glance metadata for volume d4312223-7f73-4624-bbd8-18e280027184 backed by image d85f0fe5-8496-4fc8-ab6c-110323b36076 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd85f0fe5-8496-4fc8-ab6c-110323b36076', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87134) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 01:49:38 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-eb4628b9-b120-4357-9a77-4e826928d3fc tempest-VolumesImageMetadata-1716837216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (577ad878-589b-4972-941d-5c8e6cbdcbae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4312223-7f73-4624-bbd8-18e280027184', 'volume_size': 1, 'image_id': 'd85f0fe5-8496-4fc8-ab6c-110323b36076', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d85f0fe5-8496-4fc8-ab6c-110323b36076', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '44fe2859624d49239062555b2318d354', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd85f0fe5-8496-4fc8-ab6c-110323b36076', 'created_at': datetime.datetime(2026, 7, 7, 23, 34, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 34, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d85f0fe5-8496-4fc8-ab6c-110323b36076/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:38 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-eb4628b9-b120-4357-9a77-4e826928d3fc tempest-VolumesImageMetadata-1716837216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a741e27a-e8d8-4833-bb78-40f432f22039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:38 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-eb4628b9-b120-4357-9a77-4e826928d3fc tempest-VolumesImageMetadata-1716837216 None] Volume volume-d4312223-7f73-4624-bbd8-18e280027184 (d4312223-7f73-4624-bbd8-18e280027184): created successfully Jul 08 01:49:38 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-eb4628b9-b120-4357-9a77-4e826928d3fc tempest-VolumesImageMetadata-1716837216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a741e27a-e8d8-4833-bb78-40f432f22039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:38 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-eb4628b9-b120-4357-9a77-4e826928d3fc tempest-VolumesImageMetadata-1716837216 None] Flow 'volume_create_manager' (75c454e7-ea07-4f3a-a090-be37d0250d66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:49:38 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-eb4628b9-b120-4357-9a77-4e826928d3fc tempest-VolumesImageMetadata-1716837216 None] Created volume successfully. Jul 08 01:49:38 devstack sudo[95872]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f4e9e038-d159-457d-9ba2-f7a11f974164 tempest-VolumesListAdminTestJSON-1196937071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0cb85a18-3376-47b1-924f-c531e2734663 1073741824" returned: 0 in 1.061s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f4e9e038-d159-457d-9ba2-f7a11f974164 tempest-VolumesListAdminTestJSON-1196937071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0cb85a18-3376-47b1-924f-c531e2734663 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:38 devstack sudo[95881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0cb85a18-3376-47b1-924f-c531e2734663 Jul 08 01:49:38 devstack sudo[95881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:39 devstack sudo[95881]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f4e9e038-d159-457d-9ba2-f7a11f974164 tempest-VolumesListAdminTestJSON-1196937071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0cb85a18-3376-47b1-924f-c531e2734663" returned: 0 in 0.814s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:39 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-f4e9e038-d159-457d-9ba2-f7a11f974164 tempest-VolumesListAdminTestJSON-1196937071 None] <== create_volume: return (1929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:49:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-f4e9e038-d159-457d-9ba2-f7a11f974164 tempest-VolumesListAdminTestJSON-1196937071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.932s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:49:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-a729ead9-79f8-44e0-8095-5083c4f5647d tempest-VolumesMetadataTest-1467138846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.500s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:49:39 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-a729ead9-79f8-44e0-8095-5083c4f5647d tempest-VolumesMetadataTest-1467138846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:49:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-702546444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=569822c3-2727-47ca-aab6-fc6b09b5fdcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d4953b99f0e4dde872a38b541f19efc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:49:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:49:38Z,use_quota=True,user_id='f7cbbf756556429c8a9296c14e888957',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:49:39 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-a729ead9-79f8-44e0-8095-5083c4f5647d tempest-VolumesMetadataTest-1467138846 None] Creating volume 569822c3-2727-47ca-aab6-fc6b09b5fdcd {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:49:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-a729ead9-79f8-44e0-8095-5083c4f5647d tempest-VolumesMetadataTest-1467138846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:49:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-a729ead9-79f8-44e0-8095-5083c4f5647d tempest-VolumesMetadataTest-1467138846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:49:39 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-a729ead9-79f8-44e0-8095-5083c4f5647d tempest-VolumesMetadataTest-1467138846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:49:39 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-a729ead9-79f8-44e0-8095-5083c4f5647d tempest-VolumesMetadataTest-1467138846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:49:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-a729ead9-79f8-44e0-8095-5083c4f5647d tempest-VolumesMetadataTest-1467138846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:49:39 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-a729ead9-79f8-44e0-8095-5083c4f5647d tempest-VolumesMetadataTest-1467138846 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:49:39 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-a729ead9-79f8-44e0-8095-5083c4f5647d tempest-VolumesMetadataTest-1467138846 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:49:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a729ead9-79f8-44e0-8095-5083c4f5647d tempest-VolumesMetadataTest-1467138846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-569822c3-2727-47ca-aab6-fc6b09b5fdcd 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:39 devstack sudo[95884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-569822c3-2727-47ca-aab6-fc6b09b5fdcd 1073741824 Jul 08 01:49:39 devstack sudo[95884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:39 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f4e9e038-d159-457d-9ba2-f7a11f974164 tempest-VolumesListAdminTestJSON-1196937071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fadc5235-a414-4c0b-a5df-23796efc6a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cb85a18-3376-47b1-924f-c531e2734663', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:39 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f4e9e038-d159-457d-9ba2-f7a11f974164 tempest-VolumesListAdminTestJSON-1196937071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a193150-8710-49aa-a287-15c278e131a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:39 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-bab522b5-d52d-4271-886c-13b30f0f4c19 tempest-VolumesImageMetadata-1716837216 None] Acquiring lock "cinder-d4312223-7f73-4624-bbd8-18e280027184-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:49:39 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-f4e9e038-d159-457d-9ba2-f7a11f974164 tempest-VolumesListAdminTestJSON-1196937071 None] Volume volume-0cb85a18-3376-47b1-924f-c531e2734663 (0cb85a18-3376-47b1-924f-c531e2734663): created successfully Jul 08 01:49:39 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f4e9e038-d159-457d-9ba2-f7a11f974164 tempest-VolumesListAdminTestJSON-1196937071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a193150-8710-49aa-a287-15c278e131a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:39 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f4e9e038-d159-457d-9ba2-f7a11f974164 tempest-VolumesListAdminTestJSON-1196937071 None] Flow 'volume_create_manager' (2f84bc05-58fd-4ed3-a19f-d5176f882698) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:49:39 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-bab522b5-d52d-4271-886c-13b30f0f4c19 tempest-VolumesImageMetadata-1716837216 None] Lock "cinder-d4312223-7f73-4624-bbd8-18e280027184-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:49:39 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-f4e9e038-d159-457d-9ba2-f7a11f974164 tempest-VolumesListAdminTestJSON-1196937071 None] Created volume successfully. Jul 08 01:49:39 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-bab522b5-d52d-4271-886c-13b30f0f4c19 tempest-VolumesImageMetadata-1716837216 None] Acquiring lock "cinder-quobyte-d4312223-7f73-4624-bbd8-18e280027184" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:49:39 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-bab522b5-d52d-4271-886c-13b30f0f4c19 tempest-VolumesImageMetadata-1716837216 None] Lock "cinder-quobyte-d4312223-7f73-4624-bbd8-18e280027184" acquired by "delete_volume" :: waited 0.019s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:49:39 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb20980-f17a-4dd9-a973-95ed8319279d]: (4, 'raw') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:49:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-bab522b5-d52d-4271-886c-13b30f0f4c19 tempest-VolumesImageMetadata-1716837216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d4312223-7f73-4624-bbd8-18e280027184 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:39 devstack sudo[95886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d4312223-7f73-4624-bbd8-18e280027184 Jul 08 01:49:39 devstack sudo[95886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:40 devstack sudo[95884]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a729ead9-79f8-44e0-8095-5083c4f5647d tempest-VolumesMetadataTest-1467138846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-569822c3-2727-47ca-aab6-fc6b09b5fdcd 1073741824" returned: 0 in 1.030s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a729ead9-79f8-44e0-8095-5083c4f5647d tempest-VolumesMetadataTest-1467138846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-569822c3-2727-47ca-aab6-fc6b09b5fdcd {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:40 devstack sudo[95893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-569822c3-2727-47ca-aab6-fc6b09b5fdcd Jul 08 01:49:40 devstack sudo[95893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:40 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-6a161643-d14b-42d5-a5db-1569d4156330 tempest-VolumesListAdminTestJSON-1196937071 None] Acquiring lock "cinder-0cb85a18-3376-47b1-924f-c531e2734663-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:49:40 devstack sudo[95886]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-bab522b5-d52d-4271-886c-13b30f0f4c19 tempest-VolumesImageMetadata-1716837216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d4312223-7f73-4624-bbd8-18e280027184" returned: 0 in 1.036s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-bab522b5-d52d-4271-886c-13b30f0f4c19 tempest-VolumesImageMetadata-1716837216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d4312223-7f73-4624-bbd8-18e280027184 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:40 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-6a161643-d14b-42d5-a5db-1569d4156330 tempest-VolumesListAdminTestJSON-1196937071 None] Lock "cinder-0cb85a18-3376-47b1-924f-c531e2734663-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:49:40 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-6a161643-d14b-42d5-a5db-1569d4156330 tempest-VolumesListAdminTestJSON-1196937071 None] Acquiring lock "cinder-quobyte-0cb85a18-3376-47b1-924f-c531e2734663" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:49:40 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-6a161643-d14b-42d5-a5db-1569d4156330 tempest-VolumesListAdminTestJSON-1196937071 None] Lock "cinder-quobyte-0cb85a18-3376-47b1-924f-c531e2734663" acquired by "delete_volume" :: waited 0.016s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:49:41 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1fad603-9c1f-4883-ad13-5753edde901b]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:49:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6a161643-d14b-42d5-a5db-1569d4156330 tempest-VolumesListAdminTestJSON-1196937071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0cb85a18-3376-47b1-924f-c531e2734663 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:41 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-fc382ffb-0e05-43fd-94ae-da8fa717bf7a tempest-VolumesListAdminTestJSON-605819604 None] Acquiring lock "cinder-fd867651-de5a-43fa-b647-5e9487cd501a-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:49:41 devstack sudo[95895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d4312223-7f73-4624-bbd8-18e280027184 Jul 08 01:49:41 devstack sudo[95895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:41 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-fc382ffb-0e05-43fd-94ae-da8fa717bf7a tempest-VolumesListAdminTestJSON-605819604 None] Lock "cinder-fd867651-de5a-43fa-b647-5e9487cd501a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:49:41 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-fc382ffb-0e05-43fd-94ae-da8fa717bf7a tempest-VolumesListAdminTestJSON-605819604 None] Acquiring lock "cinder-quobyte-fd867651-de5a-43fa-b647-5e9487cd501a" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:49:41 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-fc382ffb-0e05-43fd-94ae-da8fa717bf7a tempest-VolumesListAdminTestJSON-605819604 None] Lock "cinder-quobyte-fd867651-de5a-43fa-b647-5e9487cd501a" acquired by "delete_volume" :: waited 0.046s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:49:41 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e10753a-c373-47f0-89e7-20c5eb649849]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:49:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-fc382ffb-0e05-43fd-94ae-da8fa717bf7a tempest-VolumesListAdminTestJSON-605819604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-fd867651-de5a-43fa-b647-5e9487cd501a {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:41 devstack sudo[95896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0cb85a18-3376-47b1-924f-c531e2734663 Jul 08 01:49:41 devstack sudo[95896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:41 devstack sudo[95899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-fd867651-de5a-43fa-b647-5e9487cd501a Jul 08 01:49:41 devstack sudo[95899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:41 devstack sudo[95893]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a729ead9-79f8-44e0-8095-5083c4f5647d tempest-VolumesMetadataTest-1467138846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-569822c3-2727-47ca-aab6-fc6b09b5fdcd" returned: 0 in 1.254s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:41 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-a729ead9-79f8-44e0-8095-5083c4f5647d tempest-VolumesMetadataTest-1467138846 None] <== create_volume: return (2360ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:49:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-a729ead9-79f8-44e0-8095-5083c4f5647d tempest-VolumesMetadataTest-1467138846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.363s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:49:41 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-a729ead9-79f8-44e0-8095-5083c4f5647d tempest-VolumesMetadataTest-1467138846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be5a03df-bda6-44a7-b3d3-1245a2d1c7fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-569822c3-2727-47ca-aab6-fc6b09b5fdcd', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:41 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-a729ead9-79f8-44e0-8095-5083c4f5647d tempest-VolumesMetadataTest-1467138846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a07ba1d4-eae5-4a47-b452-68be0a3163ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:41 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-a729ead9-79f8-44e0-8095-5083c4f5647d tempest-VolumesMetadataTest-1467138846 None] Volume volume-569822c3-2727-47ca-aab6-fc6b09b5fdcd (569822c3-2727-47ca-aab6-fc6b09b5fdcd): created successfully Jul 08 01:49:41 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-a729ead9-79f8-44e0-8095-5083c4f5647d tempest-VolumesMetadataTest-1467138846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a07ba1d4-eae5-4a47-b452-68be0a3163ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:41 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-a729ead9-79f8-44e0-8095-5083c4f5647d tempest-VolumesMetadataTest-1467138846 None] Flow 'volume_create_manager' (67a4fe57-9089-4961-9498-2aeebefb0b42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:49:42 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-a729ead9-79f8-44e0-8095-5083c4f5647d tempest-VolumesMetadataTest-1467138846 None] Created volume successfully. Jul 08 01:49:42 devstack sudo[95895]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-bab522b5-d52d-4271-886c-13b30f0f4c19 tempest-VolumesImageMetadata-1716837216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d4312223-7f73-4624-bbd8-18e280027184" returned: 1 in 1.310s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-bab522b5-d52d-4271-886c-13b30f0f4c19 tempest-VolumesImageMetadata-1716837216 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d4312223-7f73-4624-bbd8-18e280027184' failed. Not Retrying. {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:49:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-bab522b5-d52d-4271-886c-13b30f0f4c19 tempest-VolumesImageMetadata-1716837216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d4312223-7f73-4624-bbd8-18e280027184 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:42 devstack sudo[95896]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6a161643-d14b-42d5-a5db-1569d4156330 tempest-VolumesListAdminTestJSON-1196937071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0cb85a18-3376-47b1-924f-c531e2734663" returned: 0 in 1.173s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6a161643-d14b-42d5-a5db-1569d4156330 tempest-VolumesListAdminTestJSON-1196937071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0cb85a18-3376-47b1-924f-c531e2734663 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:42 devstack sudo[95908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d4312223-7f73-4624-bbd8-18e280027184 Jul 08 01:49:42 devstack sudo[95908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:42 devstack sudo[95910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0cb85a18-3376-47b1-924f-c531e2734663 Jul 08 01:49:42 devstack sudo[95910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:42 devstack sudo[95899]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-fc382ffb-0e05-43fd-94ae-da8fa717bf7a tempest-VolumesListAdminTestJSON-605819604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-fd867651-de5a-43fa-b647-5e9487cd501a" returned: 0 in 1.209s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-fc382ffb-0e05-43fd-94ae-da8fa717bf7a tempest-VolumesListAdminTestJSON-605819604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-fd867651-de5a-43fa-b647-5e9487cd501a {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:42 devstack sudo[95916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-fd867651-de5a-43fa-b647-5e9487cd501a Jul 08 01:49:42 devstack sudo[95916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:42 devstack sudo[95910]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6a161643-d14b-42d5-a5db-1569d4156330 tempest-VolumesListAdminTestJSON-1196937071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0cb85a18-3376-47b1-924f-c531e2734663" returned: 0 in 0.777s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:43 devstack sudo[95908]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-bab522b5-d52d-4271-886c-13b30f0f4c19 tempest-VolumesImageMetadata-1716837216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d4312223-7f73-4624-bbd8-18e280027184" returned: 0 in 0.837s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:43 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-6a161643-d14b-42d5-a5db-1569d4156330 tempest-VolumesListAdminTestJSON-1196937071 None] Lock "cinder-quobyte-0cb85a18-3376-47b1-924f-c531e2734663" released by "delete_volume" :: held 2.031s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:49:43 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-bab522b5-d52d-4271-886c-13b30f0f4c19 tempest-VolumesImageMetadata-1716837216 None] Lock "cinder-quobyte-d4312223-7f73-4624-bbd8-18e280027184" released by "delete_volume" :: held 3.262s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:49:43 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-6a161643-d14b-42d5-a5db-1569d4156330 tempest-VolumesListAdminTestJSON-1196937071 None] Created reservations ['38961fac-4c66-4050-bc6b-bc777ddaaa3a', 'd3eb7c81-a611-4f86-8994-4a4a6ed84133', 'b7dd3779-5a62-4a61-a00b-954d7088a689', '80e8eb81-b1c5-407f-9f97-94b847bb9568'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:49:43 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-bab522b5-d52d-4271-886c-13b30f0f4c19 tempest-VolumesImageMetadata-1716837216 None] Created reservations ['e6e26a43-c36b-4d56-be41-7499c74e7e74', 'c5fe807f-09bb-4508-a460-1e1dec8c6ac9', '78afc65a-2ca1-4dfd-902f-c79310571aad', 'f56c8c13-dd23-4653-a5ac-184721c37914'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:49:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-bab522b5-d52d-4271-886c-13b30f0f4c19 tempest-VolumesImageMetadata-1716837216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:49:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-bab522b5-d52d-4271-886c-13b30f0f4c19 tempest-VolumesImageMetadata-1716837216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:49:43 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-bab522b5-d52d-4271-886c-13b30f0f4c19 tempest-VolumesImageMetadata-1716837216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:49:43 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-bab522b5-d52d-4271-886c-13b30f0f4c19 tempest-VolumesImageMetadata-1716837216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:49:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-bab522b5-d52d-4271-886c-13b30f0f4c19 tempest-VolumesImageMetadata-1716837216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:49:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-bab522b5-d52d-4271-886c-13b30f0f4c19 tempest-VolumesImageMetadata-1716837216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:43 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-c4eb5ab1-f54d-4177-adf1-f36ead2087a5 tempest-VolumesMetadataTest-1467138846 None] Acquiring lock "cinder-569822c3-2727-47ca-aab6-fc6b09b5fdcd-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:49:43 devstack sudo[95921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:49:43 devstack sudo[95921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:43 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-c4eb5ab1-f54d-4177-adf1-f36ead2087a5 tempest-VolumesMetadataTest-1467138846 None] Lock "cinder-569822c3-2727-47ca-aab6-fc6b09b5fdcd-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:49:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6a161643-d14b-42d5-a5db-1569d4156330 tempest-VolumesListAdminTestJSON-1196937071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:49:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6a161643-d14b-42d5-a5db-1569d4156330 tempest-VolumesListAdminTestJSON-1196937071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:49:43 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-6a161643-d14b-42d5-a5db-1569d4156330 tempest-VolumesListAdminTestJSON-1196937071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:49:43 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-6a161643-d14b-42d5-a5db-1569d4156330 tempest-VolumesListAdminTestJSON-1196937071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:49:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6a161643-d14b-42d5-a5db-1569d4156330 tempest-VolumesListAdminTestJSON-1196937071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:49:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6a161643-d14b-42d5-a5db-1569d4156330 tempest-VolumesListAdminTestJSON-1196937071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:43 devstack sudo[95916]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:43 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-c4eb5ab1-f54d-4177-adf1-f36ead2087a5 tempest-VolumesMetadataTest-1467138846 None] Acquiring lock "cinder-quobyte-569822c3-2727-47ca-aab6-fc6b09b5fdcd" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:49:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-fc382ffb-0e05-43fd-94ae-da8fa717bf7a tempest-VolumesListAdminTestJSON-605819604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-fd867651-de5a-43fa-b647-5e9487cd501a" returned: 0 in 0.918s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:43 devstack sudo[95923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:49:43 devstack sudo[95923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:43 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-fc382ffb-0e05-43fd-94ae-da8fa717bf7a tempest-VolumesListAdminTestJSON-605819604 None] Lock "cinder-quobyte-fd867651-de5a-43fa-b647-5e9487cd501a" released by "delete_volume" :: held 2.219s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:49:43 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-c4eb5ab1-f54d-4177-adf1-f36ead2087a5 tempest-VolumesMetadataTest-1467138846 None] Lock "cinder-quobyte-569822c3-2727-47ca-aab6-fc6b09b5fdcd" acquired by "delete_volume" :: waited 0.030s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:49:43 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d3d13e-6a15-495e-bf8b-c6f421d85a18]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:49:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c4eb5ab1-f54d-4177-adf1-f36ead2087a5 tempest-VolumesMetadataTest-1467138846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-569822c3-2727-47ca-aab6-fc6b09b5fdcd {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:43 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-fc382ffb-0e05-43fd-94ae-da8fa717bf7a tempest-VolumesListAdminTestJSON-605819604 None] Created reservations ['08e26dfc-cb9b-443d-86de-940557e268c3', '157d7a11-3e5b-4e41-9b01-7dd91262ca13', '179f9f8b-7295-4b3d-927b-9a4e084c7f8d', '0e4e841c-4c78-4ef6-9fb9-8071c5ddb2e7'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:49:43 devstack sudo[95925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-569822c3-2727-47ca-aab6-fc6b09b5fdcd Jul 08 01:49:43 devstack sudo[95925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-fc382ffb-0e05-43fd-94ae-da8fa717bf7a tempest-VolumesListAdminTestJSON-605819604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:49:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-fc382ffb-0e05-43fd-94ae-da8fa717bf7a tempest-VolumesListAdminTestJSON-605819604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:49:43 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-fc382ffb-0e05-43fd-94ae-da8fa717bf7a tempest-VolumesListAdminTestJSON-605819604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:49:43 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-fc382ffb-0e05-43fd-94ae-da8fa717bf7a tempest-VolumesListAdminTestJSON-605819604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:49:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-fc382ffb-0e05-43fd-94ae-da8fa717bf7a tempest-VolumesListAdminTestJSON-605819604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:49:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-fc382ffb-0e05-43fd-94ae-da8fa717bf7a tempest-VolumesListAdminTestJSON-605819604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:43 devstack sudo[95927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:49:43 devstack sudo[95927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:44 devstack sudo[95921]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-bab522b5-d52d-4271-886c-13b30f0f4c19 tempest-VolumesImageMetadata-1716837216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.849s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:44 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-bab522b5-d52d-4271-886c-13b30f0f4c19 tempest-VolumesImageMetadata-1716837216 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:49:44 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-bab522b5-d52d-4271-886c-13b30f0f4c19 tempest-VolumesImageMetadata-1716837216 None] Deleted volume successfully. Jul 08 01:49:44 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-bab522b5-d52d-4271-886c-13b30f0f4c19 tempest-VolumesImageMetadata-1716837216 None] Lock "cinder-d4312223-7f73-4624-bbd8-18e280027184-delete_volume" released by "delete_volume" :: held 4.483s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:49:44 devstack sudo[95923]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6a161643-d14b-42d5-a5db-1569d4156330 tempest-VolumesListAdminTestJSON-1196937071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.829s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:44 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-6a161643-d14b-42d5-a5db-1569d4156330 tempest-VolumesListAdminTestJSON-1196937071 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:49:44 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-6a161643-d14b-42d5-a5db-1569d4156330 tempest-VolumesListAdminTestJSON-1196937071 None] Deleted volume successfully. Jul 08 01:49:44 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-6a161643-d14b-42d5-a5db-1569d4156330 tempest-VolumesListAdminTestJSON-1196937071 None] Lock "cinder-0cb85a18-3376-47b1-924f-c531e2734663-delete_volume" released by "delete_volume" :: held 3.441s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:49:44 devstack sudo[95927]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-fc382ffb-0e05-43fd-94ae-da8fa717bf7a tempest-VolumesListAdminTestJSON-605819604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.808s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:44 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-fc382ffb-0e05-43fd-94ae-da8fa717bf7a tempest-VolumesListAdminTestJSON-605819604 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:49:44 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-fc382ffb-0e05-43fd-94ae-da8fa717bf7a tempest-VolumesListAdminTestJSON-605819604 None] Deleted volume successfully. Jul 08 01:49:44 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-fc382ffb-0e05-43fd-94ae-da8fa717bf7a tempest-VolumesListAdminTestJSON-605819604 None] Lock "cinder-fd867651-de5a-43fa-b647-5e9487cd501a-delete_volume" released by "delete_volume" :: held 3.354s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:49:44 devstack sudo[95925]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c4eb5ab1-f54d-4177-adf1-f36ead2087a5 tempest-VolumesMetadataTest-1467138846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-569822c3-2727-47ca-aab6-fc6b09b5fdcd" returned: 0 in 1.032s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c4eb5ab1-f54d-4177-adf1-f36ead2087a5 tempest-VolumesMetadataTest-1467138846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-569822c3-2727-47ca-aab6-fc6b09b5fdcd {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:44 devstack sudo[95935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-569822c3-2727-47ca-aab6-fc6b09b5fdcd Jul 08 01:49:44 devstack sudo[95935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:44 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-feb510ae-8200-48d0-9cac-209b4c7b69bd tempest-VolumesListAdminTestJSON-605819604 None] Acquiring lock "cinder-453ba4cf-7830-44c2-9712-ddc79db412fa-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:49:44 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-feb510ae-8200-48d0-9cac-209b4c7b69bd tempest-VolumesListAdminTestJSON-605819604 None] Lock "cinder-453ba4cf-7830-44c2-9712-ddc79db412fa-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:49:44 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-feb510ae-8200-48d0-9cac-209b4c7b69bd tempest-VolumesListAdminTestJSON-605819604 None] Acquiring lock "cinder-quobyte-453ba4cf-7830-44c2-9712-ddc79db412fa" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:49:44 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-feb510ae-8200-48d0-9cac-209b4c7b69bd tempest-VolumesListAdminTestJSON-605819604 None] Lock "cinder-quobyte-453ba4cf-7830-44c2-9712-ddc79db412fa" acquired by "delete_volume" :: waited 0.032s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:49:44 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[314778bb-6fd2-4d92-ae8c-00276a5bbde5]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:49:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-feb510ae-8200-48d0-9cac-209b4c7b69bd tempest-VolumesListAdminTestJSON-605819604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-453ba4cf-7830-44c2-9712-ddc79db412fa {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:45 devstack sudo[95937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-453ba4cf-7830-44c2-9712-ddc79db412fa Jul 08 01:49:45 devstack sudo[95937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:45 devstack sudo[95935]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c4eb5ab1-f54d-4177-adf1-f36ead2087a5 tempest-VolumesMetadataTest-1467138846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-569822c3-2727-47ca-aab6-fc6b09b5fdcd" returned: 0 in 0.897s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:45 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-c4eb5ab1-f54d-4177-adf1-f36ead2087a5 tempest-VolumesMetadataTest-1467138846 None] Lock "cinder-quobyte-569822c3-2727-47ca-aab6-fc6b09b5fdcd" released by "delete_volume" :: held 2.001s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:49:45 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-c4eb5ab1-f54d-4177-adf1-f36ead2087a5 tempest-VolumesMetadataTest-1467138846 None] Created reservations ['b21c5543-44ab-4460-836b-7809473973a9', 'd0169cab-6789-4200-ad73-41b8adcd1461', '3494cd50-7b69-45f3-8ab6-1e6ac0b71ad0', '99921021-72b0-4362-9d1a-f942bc9c7e8e'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:49:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c4eb5ab1-f54d-4177-adf1-f36ead2087a5 tempest-VolumesMetadataTest-1467138846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:49:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c4eb5ab1-f54d-4177-adf1-f36ead2087a5 tempest-VolumesMetadataTest-1467138846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:49:45 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-c4eb5ab1-f54d-4177-adf1-f36ead2087a5 tempest-VolumesMetadataTest-1467138846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:49:45 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-c4eb5ab1-f54d-4177-adf1-f36ead2087a5 tempest-VolumesMetadataTest-1467138846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:49:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c4eb5ab1-f54d-4177-adf1-f36ead2087a5 tempest-VolumesMetadataTest-1467138846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:49:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c4eb5ab1-f54d-4177-adf1-f36ead2087a5 tempest-VolumesMetadataTest-1467138846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:45 devstack sudo[95942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:49:45 devstack sudo[95942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:46 devstack sudo[95937]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-feb510ae-8200-48d0-9cac-209b4c7b69bd tempest-VolumesListAdminTestJSON-605819604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-453ba4cf-7830-44c2-9712-ddc79db412fa" returned: 0 in 1.215s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-feb510ae-8200-48d0-9cac-209b4c7b69bd tempest-VolumesListAdminTestJSON-605819604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-453ba4cf-7830-44c2-9712-ddc79db412fa {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:46 devstack sudo[95947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-453ba4cf-7830-44c2-9712-ddc79db412fa Jul 08 01:49:46 devstack sudo[95947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:46 devstack sudo[95942]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c4eb5ab1-f54d-4177-adf1-f36ead2087a5 tempest-VolumesMetadataTest-1467138846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.989s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:46 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-c4eb5ab1-f54d-4177-adf1-f36ead2087a5 tempest-VolumesMetadataTest-1467138846 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:49:46 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-c4eb5ab1-f54d-4177-adf1-f36ead2087a5 tempest-VolumesMetadataTest-1467138846 None] Deleted volume successfully. Jul 08 01:49:46 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-97bd4eed-200a-4028-ba7c-6585e6bc63b2 tempest-AttachVolumeNegativeTest-677114920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:49:46 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-97bd4eed-200a-4028-ba7c-6585e6bc63b2 tempest-AttachVolumeNegativeTest-677114920 None] Flow 'volume_create_manager' (0be44cbf-936b-473b-b1ae-4b62cee62bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:49:46 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-97bd4eed-200a-4028-ba7c-6585e6bc63b2 tempest-AttachVolumeNegativeTest-677114920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef6fb93b-ee65-4f4b-90a2-fc6b0be17dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:46 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-c4eb5ab1-f54d-4177-adf1-f36ead2087a5 tempest-VolumesMetadataTest-1467138846 None] Lock "cinder-569822c3-2727-47ca-aab6-fc6b09b5fdcd-delete_volume" released by "delete_volume" :: held 3.551s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:49:46 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-97bd4eed-200a-4028-ba7c-6585e6bc63b2 tempest-AttachVolumeNegativeTest-677114920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef6fb93b-ee65-4f4b-90a2-fc6b0be17dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:49:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-249622482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=611b586f-2670-426b-9dcd-ca5aaa791405,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d7bf0ee4dd241ae89007f93f5fbefaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:49:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:49:47Z,use_quota=True,user_id='26133f3fc0794c73a867ebf2d1393d53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:46 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-97bd4eed-200a-4028-ba7c-6585e6bc63b2 tempest-AttachVolumeNegativeTest-677114920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a8ffcdb-1d51-4cd2-88ed-afb883396016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:46 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-97bd4eed-200a-4028-ba7c-6585e6bc63b2 tempest-AttachVolumeNegativeTest-677114920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a8ffcdb-1d51-4cd2-88ed-afb883396016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:46 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-97bd4eed-200a-4028-ba7c-6585e6bc63b2 tempest-AttachVolumeNegativeTest-677114920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60dd6d94-2419-4800-9d4b-5fbebfb7fb85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:46 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-97bd4eed-200a-4028-ba7c-6585e6bc63b2 tempest-AttachVolumeNegativeTest-677114920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60dd6d94-2419-4800-9d4b-5fbebfb7fb85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '611b586f-2670-426b-9dcd-ca5aaa791405', 'volume_name': 'volume-611b586f-2670-426b-9dcd-ca5aaa791405', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:46 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-97bd4eed-200a-4028-ba7c-6585e6bc63b2 tempest-AttachVolumeNegativeTest-677114920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4e3bbeb-7087-4a05-b42d-e3de0712b500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:46 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-97bd4eed-200a-4028-ba7c-6585e6bc63b2 tempest-AttachVolumeNegativeTest-677114920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4e3bbeb-7087-4a05-b42d-e3de0712b500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:46 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-97bd4eed-200a-4028-ba7c-6585e6bc63b2 tempest-AttachVolumeNegativeTest-677114920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4544187-119a-4828-9da3-0377f7b345a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:46 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-97bd4eed-200a-4028-ba7c-6585e6bc63b2 tempest-AttachVolumeNegativeTest-677114920 None] Volume 611b586f-2670-426b-9dcd-ca5aaa791405: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-611b586f-2670-426b-9dcd-ca5aaa791405', 'volume_size': 1} Jul 08 01:49:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-97bd4eed-200a-4028-ba7c-6585e6bc63b2 tempest-AttachVolumeNegativeTest-677114920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:49:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-97bd4eed-200a-4028-ba7c-6585e6bc63b2 tempest-AttachVolumeNegativeTest-677114920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:49:46 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-97bd4eed-200a-4028-ba7c-6585e6bc63b2 tempest-AttachVolumeNegativeTest-677114920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:49:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-249622482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=611b586f-2670-426b-9dcd-ca5aaa791405,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d7bf0ee4dd241ae89007f93f5fbefaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:49:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:49:47Z,use_quota=True,user_id='26133f3fc0794c73a867ebf2d1393d53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:49:46 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-97bd4eed-200a-4028-ba7c-6585e6bc63b2 tempest-AttachVolumeNegativeTest-677114920 None] Creating volume 611b586f-2670-426b-9dcd-ca5aaa791405 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:49:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-97bd4eed-200a-4028-ba7c-6585e6bc63b2 tempest-AttachVolumeNegativeTest-677114920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:49:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-97bd4eed-200a-4028-ba7c-6585e6bc63b2 tempest-AttachVolumeNegativeTest-677114920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:49:46 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-97bd4eed-200a-4028-ba7c-6585e6bc63b2 tempest-AttachVolumeNegativeTest-677114920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:49:46 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-97bd4eed-200a-4028-ba7c-6585e6bc63b2 tempest-AttachVolumeNegativeTest-677114920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:49:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-97bd4eed-200a-4028-ba7c-6585e6bc63b2 tempest-AttachVolumeNegativeTest-677114920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:49:46 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-97bd4eed-200a-4028-ba7c-6585e6bc63b2 tempest-AttachVolumeNegativeTest-677114920 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:49:46 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-97bd4eed-200a-4028-ba7c-6585e6bc63b2 tempest-AttachVolumeNegativeTest-677114920 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:49:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-97bd4eed-200a-4028-ba7c-6585e6bc63b2 tempest-AttachVolumeNegativeTest-677114920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-611b586f-2670-426b-9dcd-ca5aaa791405 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:47 devstack sudo[95952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-611b586f-2670-426b-9dcd-ca5aaa791405 1073741824 Jul 08 01:49:47 devstack sudo[95952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:47 devstack sudo[95947]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-feb510ae-8200-48d0-9cac-209b4c7b69bd tempest-VolumesListAdminTestJSON-605819604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-453ba4cf-7830-44c2-9712-ddc79db412fa" returned: 0 in 1.049s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:47 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-feb510ae-8200-48d0-9cac-209b4c7b69bd tempest-VolumesListAdminTestJSON-605819604 None] Lock "cinder-quobyte-453ba4cf-7830-44c2-9712-ddc79db412fa" released by "delete_volume" :: held 2.373s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:49:47 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-feb510ae-8200-48d0-9cac-209b4c7b69bd tempest-VolumesListAdminTestJSON-605819604 None] Created reservations ['560a9360-075c-45ca-8d04-ea0b1b55da56', 'c1268a9c-7928-40aa-accf-11ac6c034447', '2da102db-26ad-4b5d-a890-1611600a495f', '57352101-a26c-4fd9-9798-678632c7ef34'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:49:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-feb510ae-8200-48d0-9cac-209b4c7b69bd tempest-VolumesListAdminTestJSON-605819604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:49:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-feb510ae-8200-48d0-9cac-209b4c7b69bd tempest-VolumesListAdminTestJSON-605819604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:49:47 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-feb510ae-8200-48d0-9cac-209b4c7b69bd tempest-VolumesListAdminTestJSON-605819604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:49:47 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-feb510ae-8200-48d0-9cac-209b4c7b69bd tempest-VolumesListAdminTestJSON-605819604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:49:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-feb510ae-8200-48d0-9cac-209b4c7b69bd tempest-VolumesListAdminTestJSON-605819604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:49:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-feb510ae-8200-48d0-9cac-209b4c7b69bd tempest-VolumesListAdminTestJSON-605819604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:47 devstack sudo[95954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:49:47 devstack sudo[95954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:48 devstack sudo[95954]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-feb510ae-8200-48d0-9cac-209b4c7b69bd tempest-VolumesListAdminTestJSON-605819604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.891s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:48 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-feb510ae-8200-48d0-9cac-209b4c7b69bd tempest-VolumesListAdminTestJSON-605819604 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:49:48 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-feb510ae-8200-48d0-9cac-209b4c7b69bd tempest-VolumesListAdminTestJSON-605819604 None] Deleted volume successfully. Jul 08 01:49:48 devstack sudo[95952]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-97bd4eed-200a-4028-ba7c-6585e6bc63b2 tempest-AttachVolumeNegativeTest-677114920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-611b586f-2670-426b-9dcd-ca5aaa791405 1073741824" returned: 0 in 1.232s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:48 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7d5dc341-ed54-44ff-93c0-5b3f50435269 tempest-VolumesListAdminTestJSON-605819604 None] Acquiring lock "cinder-a245c3c9-ea62-46ab-abbe-b5593e5f6159-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:49:48 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-feb510ae-8200-48d0-9cac-209b4c7b69bd tempest-VolumesListAdminTestJSON-605819604 None] Lock "cinder-453ba4cf-7830-44c2-9712-ddc79db412fa-delete_volume" released by "delete_volume" :: held 3.603s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:49:48 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7d5dc341-ed54-44ff-93c0-5b3f50435269 tempest-VolumesListAdminTestJSON-605819604 None] Lock "cinder-a245c3c9-ea62-46ab-abbe-b5593e5f6159-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:49:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-97bd4eed-200a-4028-ba7c-6585e6bc63b2 tempest-AttachVolumeNegativeTest-677114920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-611b586f-2670-426b-9dcd-ca5aaa791405 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:48 devstack sudo[95960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-611b586f-2670-426b-9dcd-ca5aaa791405 Jul 08 01:49:48 devstack sudo[95960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:48 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7d5dc341-ed54-44ff-93c0-5b3f50435269 tempest-VolumesListAdminTestJSON-605819604 None] Acquiring lock "cinder-quobyte-a245c3c9-ea62-46ab-abbe-b5593e5f6159" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:49:48 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7d5dc341-ed54-44ff-93c0-5b3f50435269 tempest-VolumesListAdminTestJSON-605819604 None] Lock "cinder-quobyte-a245c3c9-ea62-46ab-abbe-b5593e5f6159" acquired by "delete_volume" :: waited 0.018s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:49:48 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[4351ef39-04b7-40eb-b3bd-26913ffddd8a]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:49:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7d5dc341-ed54-44ff-93c0-5b3f50435269 tempest-VolumesListAdminTestJSON-605819604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a245c3c9-ea62-46ab-abbe-b5593e5f6159 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:48 devstack sudo[95962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a245c3c9-ea62-46ab-abbe-b5593e5f6159 Jul 08 01:49:48 devstack sudo[95962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:49 devstack sudo[95960]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:49 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-97bd4eed-200a-4028-ba7c-6585e6bc63b2 tempest-AttachVolumeNegativeTest-677114920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-611b586f-2670-426b-9dcd-ca5aaa791405" returned: 0 in 0.944s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:49 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-97bd4eed-200a-4028-ba7c-6585e6bc63b2 tempest-AttachVolumeNegativeTest-677114920 None] <== create_volume: return (2262ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:49:49 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-97bd4eed-200a-4028-ba7c-6585e6bc63b2 tempest-AttachVolumeNegativeTest-677114920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.264s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:49:49 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-97bd4eed-200a-4028-ba7c-6585e6bc63b2 tempest-AttachVolumeNegativeTest-677114920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4544187-119a-4828-9da3-0377f7b345a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-611b586f-2670-426b-9dcd-ca5aaa791405', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:49 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-97bd4eed-200a-4028-ba7c-6585e6bc63b2 tempest-AttachVolumeNegativeTest-677114920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e721881-dec6-4044-bf22-7e1cc1ee633d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:49 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-97bd4eed-200a-4028-ba7c-6585e6bc63b2 tempest-AttachVolumeNegativeTest-677114920 None] Volume volume-611b586f-2670-426b-9dcd-ca5aaa791405 (611b586f-2670-426b-9dcd-ca5aaa791405): created successfully Jul 08 01:49:49 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-97bd4eed-200a-4028-ba7c-6585e6bc63b2 tempest-AttachVolumeNegativeTest-677114920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e721881-dec6-4044-bf22-7e1cc1ee633d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:49 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-97bd4eed-200a-4028-ba7c-6585e6bc63b2 tempest-AttachVolumeNegativeTest-677114920 None] Flow 'volume_create_manager' (0be44cbf-936b-473b-b1ae-4b62cee62bb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:49:49 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-97bd4eed-200a-4028-ba7c-6585e6bc63b2 tempest-AttachVolumeNegativeTest-677114920 None] Created volume successfully. Jul 08 01:49:49 devstack sudo[95962]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:49 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7d5dc341-ed54-44ff-93c0-5b3f50435269 tempest-VolumesListAdminTestJSON-605819604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a245c3c9-ea62-46ab-abbe-b5593e5f6159" returned: 0 in 1.033s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:49 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7d5dc341-ed54-44ff-93c0-5b3f50435269 tempest-VolumesListAdminTestJSON-605819604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a245c3c9-ea62-46ab-abbe-b5593e5f6159 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:49 devstack sudo[95968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a245c3c9-ea62-46ab-abbe-b5593e5f6159 Jul 08 01:49:49 devstack sudo[95968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:50 devstack sudo[95968]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:50 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7d5dc341-ed54-44ff-93c0-5b3f50435269 tempest-VolumesListAdminTestJSON-605819604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a245c3c9-ea62-46ab-abbe-b5593e5f6159" returned: 0 in 0.811s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:50 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7d5dc341-ed54-44ff-93c0-5b3f50435269 tempest-VolumesListAdminTestJSON-605819604 None] Lock "cinder-quobyte-a245c3c9-ea62-46ab-abbe-b5593e5f6159" released by "delete_volume" :: held 1.892s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:49:50 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-7d5dc341-ed54-44ff-93c0-5b3f50435269 tempest-VolumesListAdminTestJSON-605819604 None] Created reservations ['7c4c1428-d13e-4ff0-b53b-e1678f608a16', '93f83e6a-8ddf-4207-b0a6-f04df932d0a0', '80c2202e-f180-4711-80d9-0134c1b6a868', '8d60e50a-eefd-46f9-b5ec-97646fed3f62'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:49:50 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7d5dc341-ed54-44ff-93c0-5b3f50435269 tempest-VolumesListAdminTestJSON-605819604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:49:50 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7d5dc341-ed54-44ff-93c0-5b3f50435269 tempest-VolumesListAdminTestJSON-605819604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:49:50 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-7d5dc341-ed54-44ff-93c0-5b3f50435269 tempest-VolumesListAdminTestJSON-605819604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:49:50 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-7d5dc341-ed54-44ff-93c0-5b3f50435269 tempest-VolumesListAdminTestJSON-605819604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:49:50 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7d5dc341-ed54-44ff-93c0-5b3f50435269 tempest-VolumesListAdminTestJSON-605819604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:49:50 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7d5dc341-ed54-44ff-93c0-5b3f50435269 tempest-VolumesListAdminTestJSON-605819604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:50 devstack sudo[95974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:49:50 devstack sudo[95974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:51 devstack sudo[95974]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7d5dc341-ed54-44ff-93c0-5b3f50435269 tempest-VolumesListAdminTestJSON-605819604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.797s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:51 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-7d5dc341-ed54-44ff-93c0-5b3f50435269 tempest-VolumesListAdminTestJSON-605819604 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:49:51 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-7d5dc341-ed54-44ff-93c0-5b3f50435269 tempest-VolumesListAdminTestJSON-605819604 None] Deleted volume successfully. Jul 08 01:49:51 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7d5dc341-ed54-44ff-93c0-5b3f50435269 tempest-VolumesListAdminTestJSON-605819604 None] Lock "cinder-a245c3c9-ea62-46ab-abbe-b5593e5f6159-delete_volume" released by "delete_volume" :: held 2.991s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:49:51 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-87c698e2-2596-4b0b-a12a-26ff3e33fa22 tempest-VolumesTransfersV355Test-1316966888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:49:51 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-87c698e2-2596-4b0b-a12a-26ff3e33fa22 tempest-VolumesTransfersV355Test-1316966888 None] Flow 'volume_create_manager' (034ec538-75c6-480c-8bf1-225d220d9c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:49:51 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-87c698e2-2596-4b0b-a12a-26ff3e33fa22 tempest-VolumesTransfersV355Test-1316966888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (572021fd-c529-46ee-badd-4841005838ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:51 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-87c698e2-2596-4b0b-a12a-26ff3e33fa22 tempest-VolumesTransfersV355Test-1316966888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (572021fd-c529-46ee-badd-4841005838ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:49:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-396790427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e361d17f-f237-41ef-a794-5c0df01212f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcc95b97ee8248fdabe01b9a4c81e760',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:49:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:49:52Z,use_quota=True,user_id='c482fa0edcb244f1a3a55796397e7c53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:51 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-87c698e2-2596-4b0b-a12a-26ff3e33fa22 tempest-VolumesTransfersV355Test-1316966888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1ea73d9-eafd-463d-bcd8-bf4b3044ef0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:51 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-87c698e2-2596-4b0b-a12a-26ff3e33fa22 tempest-VolumesTransfersV355Test-1316966888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1ea73d9-eafd-463d-bcd8-bf4b3044ef0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:51 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-87c698e2-2596-4b0b-a12a-26ff3e33fa22 tempest-VolumesTransfersV355Test-1316966888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f337047-cc00-4b8a-b770-5b3a7b328d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:51 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-87c698e2-2596-4b0b-a12a-26ff3e33fa22 tempest-VolumesTransfersV355Test-1316966888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f337047-cc00-4b8a-b770-5b3a7b328d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e361d17f-f237-41ef-a794-5c0df01212f0', 'volume_name': 'volume-e361d17f-f237-41ef-a794-5c0df01212f0', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:51 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-87c698e2-2596-4b0b-a12a-26ff3e33fa22 tempest-VolumesTransfersV355Test-1316966888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32236a7e-75ad-418e-b4e2-3a61b8ff7935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:51 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-87c698e2-2596-4b0b-a12a-26ff3e33fa22 tempest-VolumesTransfersV355Test-1316966888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32236a7e-75ad-418e-b4e2-3a61b8ff7935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:51 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-87c698e2-2596-4b0b-a12a-26ff3e33fa22 tempest-VolumesTransfersV355Test-1316966888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04cbcebe-7596-41ac-8c70-b2542a430ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:51 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-87c698e2-2596-4b0b-a12a-26ff3e33fa22 tempest-VolumesTransfersV355Test-1316966888 None] Volume e361d17f-f237-41ef-a794-5c0df01212f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e361d17f-f237-41ef-a794-5c0df01212f0', 'volume_size': 1} Jul 08 01:49:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-87c698e2-2596-4b0b-a12a-26ff3e33fa22 tempest-VolumesTransfersV355Test-1316966888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:49:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-87c698e2-2596-4b0b-a12a-26ff3e33fa22 tempest-VolumesTransfersV355Test-1316966888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:49:51 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-87c698e2-2596-4b0b-a12a-26ff3e33fa22 tempest-VolumesTransfersV355Test-1316966888 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:49:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-396790427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e361d17f-f237-41ef-a794-5c0df01212f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcc95b97ee8248fdabe01b9a4c81e760',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:49:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:49:52Z,use_quota=True,user_id='c482fa0edcb244f1a3a55796397e7c53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:49:51 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-87c698e2-2596-4b0b-a12a-26ff3e33fa22 tempest-VolumesTransfersV355Test-1316966888 None] Creating volume e361d17f-f237-41ef-a794-5c0df01212f0 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:49:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-87c698e2-2596-4b0b-a12a-26ff3e33fa22 tempest-VolumesTransfersV355Test-1316966888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:49:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-87c698e2-2596-4b0b-a12a-26ff3e33fa22 tempest-VolumesTransfersV355Test-1316966888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:49:51 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-87c698e2-2596-4b0b-a12a-26ff3e33fa22 tempest-VolumesTransfersV355Test-1316966888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:49:51 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-87c698e2-2596-4b0b-a12a-26ff3e33fa22 tempest-VolumesTransfersV355Test-1316966888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:49:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-87c698e2-2596-4b0b-a12a-26ff3e33fa22 tempest-VolumesTransfersV355Test-1316966888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:49:51 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-87c698e2-2596-4b0b-a12a-26ff3e33fa22 tempest-VolumesTransfersV355Test-1316966888 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:49:51 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-87c698e2-2596-4b0b-a12a-26ff3e33fa22 tempest-VolumesTransfersV355Test-1316966888 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:49:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-87c698e2-2596-4b0b-a12a-26ff3e33fa22 tempest-VolumesTransfersV355Test-1316966888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e361d17f-f237-41ef-a794-5c0df01212f0 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:51 devstack sudo[95977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e361d17f-f237-41ef-a794-5c0df01212f0 1073741824 Jul 08 01:49:51 devstack sudo[95977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:53 devstack sudo[95977]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-87c698e2-2596-4b0b-a12a-26ff3e33fa22 tempest-VolumesTransfersV355Test-1316966888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e361d17f-f237-41ef-a794-5c0df01212f0 1073741824" returned: 0 in 1.264s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-87c698e2-2596-4b0b-a12a-26ff3e33fa22 tempest-VolumesTransfersV355Test-1316966888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e361d17f-f237-41ef-a794-5c0df01212f0 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:53 devstack sudo[95992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e361d17f-f237-41ef-a794-5c0df01212f0 Jul 08 01:49:53 devstack sudo[95992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-500d58c8-7e60-4059-b09f-d2a208654e81 req-2dc07b11-af80-49b3-aeb2-1f23922fe9cb tempest-AttachVolumeNegativeTest-677114920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:49:53 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-77e58177-cf54-431e-ba63-ecc9bc25a79f tempest-VolumesTransfersTest-1927646094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:49:53 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-77e58177-cf54-431e-ba63-ecc9bc25a79f tempest-VolumesTransfersTest-1927646094 None] Flow 'volume_create_manager' (28a0b9ee-445a-4edd-afa3-d74e6b433727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:49:53 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-77e58177-cf54-431e-ba63-ecc9bc25a79f tempest-VolumesTransfersTest-1927646094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5af753c-6e9d-4c2a-89dc-1477e584cfe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:53 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-77e58177-cf54-431e-ba63-ecc9bc25a79f tempest-VolumesTransfersTest-1927646094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5af753c-6e9d-4c2a-89dc-1477e584cfe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:49:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2067069039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b6ee8fa-b0cb-4985-8266-1acc8ee13799,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18e00e9ab90d4b3b85e03a254157202e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:49:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:49:53Z,use_quota=True,user_id='82ad425757c1485c931b9020326a6129',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:53 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-77e58177-cf54-431e-ba63-ecc9bc25a79f tempest-VolumesTransfersTest-1927646094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33890847-81ce-48f0-b416-c95c79cb873e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:53 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-77e58177-cf54-431e-ba63-ecc9bc25a79f tempest-VolumesTransfersTest-1927646094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33890847-81ce-48f0-b416-c95c79cb873e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:53 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-77e58177-cf54-431e-ba63-ecc9bc25a79f tempest-VolumesTransfersTest-1927646094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de40823a-c039-46e2-9436-e112ac9061fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:53 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-77e58177-cf54-431e-ba63-ecc9bc25a79f tempest-VolumesTransfersTest-1927646094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de40823a-c039-46e2-9436-e112ac9061fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b6ee8fa-b0cb-4985-8266-1acc8ee13799', 'volume_name': 'volume-5b6ee8fa-b0cb-4985-8266-1acc8ee13799', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:53 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-77e58177-cf54-431e-ba63-ecc9bc25a79f tempest-VolumesTransfersTest-1927646094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ff6bbb2-53b8-4f84-9733-79b1a8899a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:53 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-77e58177-cf54-431e-ba63-ecc9bc25a79f tempest-VolumesTransfersTest-1927646094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ff6bbb2-53b8-4f84-9733-79b1a8899a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:53 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-77e58177-cf54-431e-ba63-ecc9bc25a79f tempest-VolumesTransfersTest-1927646094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47aa4672-9462-4d82-929c-e60247e7bc62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:53 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-77e58177-cf54-431e-ba63-ecc9bc25a79f tempest-VolumesTransfersTest-1927646094 None] Volume 5b6ee8fa-b0cb-4985-8266-1acc8ee13799: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b6ee8fa-b0cb-4985-8266-1acc8ee13799', 'volume_size': 1} Jul 08 01:49:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-77e58177-cf54-431e-ba63-ecc9bc25a79f tempest-VolumesTransfersTest-1927646094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:49:53 devstack sudo[95992]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-87c698e2-2596-4b0b-a12a-26ff3e33fa22 tempest-VolumesTransfersV355Test-1316966888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e361d17f-f237-41ef-a794-5c0df01212f0" returned: 0 in 0.709s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:53 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-87c698e2-2596-4b0b-a12a-26ff3e33fa22 tempest-VolumesTransfersV355Test-1316966888 None] <== create_volume: return (2051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:49:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-87c698e2-2596-4b0b-a12a-26ff3e33fa22 tempest-VolumesTransfersV355Test-1316966888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.054s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:49:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-500d58c8-7e60-4059-b09f-d2a208654e81 req-2dc07b11-af80-49b3-aeb2-1f23922fe9cb tempest-AttachVolumeNegativeTest-677114920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.662s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:49:53 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-87c698e2-2596-4b0b-a12a-26ff3e33fa22 tempest-VolumesTransfersV355Test-1316966888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04cbcebe-7596-41ac-8c70-b2542a430ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e361d17f-f237-41ef-a794-5c0df01212f0', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:53 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-87c698e2-2596-4b0b-a12a-26ff3e33fa22 tempest-VolumesTransfersV355Test-1316966888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02cfeec3-056e-40d8-a83a-de7b799f40c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:53 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf28240-7ae1-43c3-addb-f3c8e6c4f191]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:49:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-500d58c8-7e60-4059-b09f-d2a208654e81 req-2dc07b11-af80-49b3-aeb2-1f23922fe9cb tempest-AttachVolumeNegativeTest-677114920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-611b586f-2670-426b-9dcd-ca5aaa791405 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:53 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-87c698e2-2596-4b0b-a12a-26ff3e33fa22 tempest-VolumesTransfersV355Test-1316966888 None] Volume volume-e361d17f-f237-41ef-a794-5c0df01212f0 (e361d17f-f237-41ef-a794-5c0df01212f0): created successfully Jul 08 01:49:53 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-87c698e2-2596-4b0b-a12a-26ff3e33fa22 tempest-VolumesTransfersV355Test-1316966888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02cfeec3-056e-40d8-a83a-de7b799f40c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:54 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-87c698e2-2596-4b0b-a12a-26ff3e33fa22 tempest-VolumesTransfersV355Test-1316966888 None] Flow 'volume_create_manager' (034ec538-75c6-480c-8bf1-225d220d9c84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:49:54 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-87c698e2-2596-4b0b-a12a-26ff3e33fa22 tempest-VolumesTransfersV355Test-1316966888 None] Created volume successfully. Jul 08 01:49:54 devstack sudo[95995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-611b586f-2670-426b-9dcd-ca5aaa791405 Jul 08 01:49:54 devstack sudo[95995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:54 devstack sudo[95995]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-500d58c8-7e60-4059-b09f-d2a208654e81 req-2dc07b11-af80-49b3-aeb2-1f23922fe9cb tempest-AttachVolumeNegativeTest-677114920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-611b586f-2670-426b-9dcd-ca5aaa791405" returned: 0 in 0.898s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-500d58c8-7e60-4059-b09f-d2a208654e81 req-2dc07b11-af80-49b3-aeb2-1f23922fe9cb tempest-AttachVolumeNegativeTest-677114920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.934s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:49:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-77e58177-cf54-431e-ba63-ecc9bc25a79f tempest-VolumesTransfersTest-1927646094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.438s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:49:54 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-77e58177-cf54-431e-ba63-ecc9bc25a79f tempest-VolumesTransfersTest-1927646094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:49:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2067069039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b6ee8fa-b0cb-4985-8266-1acc8ee13799,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18e00e9ab90d4b3b85e03a254157202e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:49:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:49:53Z,use_quota=True,user_id='82ad425757c1485c931b9020326a6129',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:49:54 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-77e58177-cf54-431e-ba63-ecc9bc25a79f tempest-VolumesTransfersTest-1927646094 None] Creating volume 5b6ee8fa-b0cb-4985-8266-1acc8ee13799 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:49:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-77e58177-cf54-431e-ba63-ecc9bc25a79f tempest-VolumesTransfersTest-1927646094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:49:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-77e58177-cf54-431e-ba63-ecc9bc25a79f tempest-VolumesTransfersTest-1927646094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:49:54 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-77e58177-cf54-431e-ba63-ecc9bc25a79f tempest-VolumesTransfersTest-1927646094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:49:54 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-77e58177-cf54-431e-ba63-ecc9bc25a79f tempest-VolumesTransfersTest-1927646094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:49:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-77e58177-cf54-431e-ba63-ecc9bc25a79f tempest-VolumesTransfersTest-1927646094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:49:54 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-77e58177-cf54-431e-ba63-ecc9bc25a79f tempest-VolumesTransfersTest-1927646094 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:49:54 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-77e58177-cf54-431e-ba63-ecc9bc25a79f tempest-VolumesTransfersTest-1927646094 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:49:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-77e58177-cf54-431e-ba63-ecc9bc25a79f tempest-VolumesTransfersTest-1927646094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-5b6ee8fa-b0cb-4985-8266-1acc8ee13799 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:54 devstack sudo[96000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-5b6ee8fa-b0cb-4985-8266-1acc8ee13799 1073741824 Jul 08 01:49:54 devstack sudo[96000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:54 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [req-500d58c8-7e60-4059-b09f-d2a208654e81 req-2dc07b11-af80-49b3-aeb2-1f23922fe9cb tempest-AttachVolumeNegativeTest-677114920 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17', 'name': 'volume-611b586f-2670-426b-9dcd-ca5aaa791405', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '893b886f-c996-47ac-9221-6cda66003ad5', 'enforce_multipath': True} {{(pid=87134) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:49:55 devstack cinder-volume[87134]: INFO cinder.volume.manager [req-500d58c8-7e60-4059-b09f-d2a208654e81 req-2dc07b11-af80-49b3-aeb2-1f23922fe9cb tempest-AttachVolumeNegativeTest-677114920 None] attachment_update completed successfully. Jul 08 01:49:56 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-a2cfe818-033e-410b-83c6-08ea08b014f2 tempest-VolumesTransfersV355Test-51582987 None] Transfer volume completed successfully. Jul 08 01:49:56 devstack sudo[96000]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:56 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-77e58177-cf54-431e-ba63-ecc9bc25a79f tempest-VolumesTransfersTest-1927646094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-5b6ee8fa-b0cb-4985-8266-1acc8ee13799 1073741824" returned: 0 in 1.171s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:56 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-77e58177-cf54-431e-ba63-ecc9bc25a79f tempest-VolumesTransfersTest-1927646094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-5b6ee8fa-b0cb-4985-8266-1acc8ee13799 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:56 devstack sudo[96389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-5b6ee8fa-b0cb-4985-8266-1acc8ee13799 Jul 08 01:49:56 devstack sudo[96389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:56 devstack sudo[96389]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:56 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-77e58177-cf54-431e-ba63-ecc9bc25a79f tempest-VolumesTransfersTest-1927646094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-5b6ee8fa-b0cb-4985-8266-1acc8ee13799" returned: 0 in 0.833s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:56 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-77e58177-cf54-431e-ba63-ecc9bc25a79f tempest-VolumesTransfersTest-1927646094 None] <== create_volume: return (2051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:49:56 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-77e58177-cf54-431e-ba63-ecc9bc25a79f tempest-VolumesTransfersTest-1927646094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.056s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:49:56 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-77e58177-cf54-431e-ba63-ecc9bc25a79f tempest-VolumesTransfersTest-1927646094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47aa4672-9462-4d82-929c-e60247e7bc62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b6ee8fa-b0cb-4985-8266-1acc8ee13799', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:56 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-77e58177-cf54-431e-ba63-ecc9bc25a79f tempest-VolumesTransfersTest-1927646094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ce25909-4760-4abe-875a-9891b6a1fe0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:49:56 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-77e58177-cf54-431e-ba63-ecc9bc25a79f tempest-VolumesTransfersTest-1927646094 None] Volume volume-5b6ee8fa-b0cb-4985-8266-1acc8ee13799 (5b6ee8fa-b0cb-4985-8266-1acc8ee13799): created successfully Jul 08 01:49:57 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-77e58177-cf54-431e-ba63-ecc9bc25a79f tempest-VolumesTransfersTest-1927646094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ce25909-4760-4abe-875a-9891b6a1fe0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:49:57 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-77e58177-cf54-431e-ba63-ecc9bc25a79f tempest-VolumesTransfersTest-1927646094 None] Flow 'volume_create_manager' (28a0b9ee-445a-4edd-afa3-d74e6b433727) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:49:57 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-77e58177-cf54-431e-ba63-ecc9bc25a79f tempest-VolumesTransfersTest-1927646094 None] Created volume successfully. Jul 08 01:49:57 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-37434043-862b-48b4-aeed-2d47edcd54a3 tempest-VolumesTransfersV355Test-1671985594 None] Acquiring lock "cinder-e361d17f-f237-41ef-a794-5c0df01212f0-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:49:57 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-37434043-862b-48b4-aeed-2d47edcd54a3 tempest-VolumesTransfersV355Test-1671985594 None] Lock "cinder-e361d17f-f237-41ef-a794-5c0df01212f0-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:49:57 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-37434043-862b-48b4-aeed-2d47edcd54a3 tempest-VolumesTransfersV355Test-1671985594 None] Acquiring lock "cinder-quobyte-e361d17f-f237-41ef-a794-5c0df01212f0" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:49:57 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-37434043-862b-48b4-aeed-2d47edcd54a3 tempest-VolumesTransfersV355Test-1671985594 None] Lock "cinder-quobyte-e361d17f-f237-41ef-a794-5c0df01212f0" acquired by "delete_volume" :: waited 0.037s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:49:57 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a1e720-fbeb-4a86-801d-f30bd07843be]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:49:57 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-37434043-862b-48b4-aeed-2d47edcd54a3 tempest-VolumesTransfersV355Test-1671985594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e361d17f-f237-41ef-a794-5c0df01212f0 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:57 devstack sudo[96392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e361d17f-f237-41ef-a794-5c0df01212f0 Jul 08 01:49:57 devstack sudo[96392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:58 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-2bed34ef-1fd0-4bcd-9d6a-d09b3efc1276 tempest-VolumesTransfersTest-2052180390 None] Transfer volume completed successfully. Jul 08 01:49:58 devstack sudo[96392]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:58 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-37434043-862b-48b4-aeed-2d47edcd54a3 tempest-VolumesTransfersV355Test-1671985594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e361d17f-f237-41ef-a794-5c0df01212f0" returned: 0 in 0.967s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:58 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-37434043-862b-48b4-aeed-2d47edcd54a3 tempest-VolumesTransfersV355Test-1671985594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e361d17f-f237-41ef-a794-5c0df01212f0 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:58 devstack sudo[96397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e361d17f-f237-41ef-a794-5c0df01212f0 Jul 08 01:49:58 devstack sudo[96397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:59 devstack sudo[96397]: pam_unix(sudo:session): session closed for user root Jul 08 01:49:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-37434043-862b-48b4-aeed-2d47edcd54a3 tempest-VolumesTransfersV355Test-1671985594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e361d17f-f237-41ef-a794-5c0df01212f0" returned: 0 in 0.864s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:49:59 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-37434043-862b-48b4-aeed-2d47edcd54a3 tempest-VolumesTransfersV355Test-1671985594 None] Lock "cinder-quobyte-e361d17f-f237-41ef-a794-5c0df01212f0" released by "delete_volume" :: held 1.912s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:49:59 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-37434043-862b-48b4-aeed-2d47edcd54a3 tempest-VolumesTransfersV355Test-1671985594 None] Created reservations ['154a10da-fdd4-40ce-9b86-701c0f3dca27', '3fa58c91-5319-44dc-9f98-8e1b8ebcd402', '878e7dde-3f57-45ac-a03f-ad173d6600dd', 'bf92778b-c604-470f-9614-dcf3213c3f15'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:49:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-37434043-862b-48b4-aeed-2d47edcd54a3 tempest-VolumesTransfersV355Test-1671985594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:49:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-37434043-862b-48b4-aeed-2d47edcd54a3 tempest-VolumesTransfersV355Test-1671985594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:49:59 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-37434043-862b-48b4-aeed-2d47edcd54a3 tempest-VolumesTransfersV355Test-1671985594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:49:59 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-37434043-862b-48b4-aeed-2d47edcd54a3 tempest-VolumesTransfersV355Test-1671985594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:49:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-37434043-862b-48b4-aeed-2d47edcd54a3 tempest-VolumesTransfersV355Test-1671985594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:49:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-37434043-862b-48b4-aeed-2d47edcd54a3 tempest-VolumesTransfersV355Test-1671985594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:49:59 devstack sudo[96400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:49:59 devstack sudo[96400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:49:59 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-9277e8da-f376-47d2-b044-0a8888d13238 tempest-VolumesTransfersTest-1453958986 None] Acquiring lock "cinder-5b6ee8fa-b0cb-4985-8266-1acc8ee13799-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:49:59 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-9277e8da-f376-47d2-b044-0a8888d13238 tempest-VolumesTransfersTest-1453958986 None] Lock "cinder-5b6ee8fa-b0cb-4985-8266-1acc8ee13799-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:50:00 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-9277e8da-f376-47d2-b044-0a8888d13238 tempest-VolumesTransfersTest-1453958986 None] Acquiring lock "cinder-quobyte-5b6ee8fa-b0cb-4985-8266-1acc8ee13799" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:50:00 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-9277e8da-f376-47d2-b044-0a8888d13238 tempest-VolumesTransfersTest-1453958986 None] Lock "cinder-quobyte-5b6ee8fa-b0cb-4985-8266-1acc8ee13799" acquired by "delete_volume" :: waited 0.020s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:50:00 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[905f9963-5e13-4477-98f2-44ce720981ca]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:50:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9277e8da-f376-47d2-b044-0a8888d13238 tempest-VolumesTransfersTest-1453958986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-5b6ee8fa-b0cb-4985-8266-1acc8ee13799 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:00 devstack sudo[96402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-5b6ee8fa-b0cb-4985-8266-1acc8ee13799 Jul 08 01:50:00 devstack sudo[96402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:00 devstack sudo[96400]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-37434043-862b-48b4-aeed-2d47edcd54a3 tempest-VolumesTransfersV355Test-1671985594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.966s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:00 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-37434043-862b-48b4-aeed-2d47edcd54a3 tempest-VolumesTransfersV355Test-1671985594 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:50:00 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-37434043-862b-48b4-aeed-2d47edcd54a3 tempest-VolumesTransfersV355Test-1671985594 None] Deleted volume successfully. Jul 08 01:50:00 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-37434043-862b-48b4-aeed-2d47edcd54a3 tempest-VolumesTransfersV355Test-1671985594 None] Lock "cinder-e361d17f-f237-41ef-a794-5c0df01212f0-delete_volume" released by "delete_volume" :: held 3.242s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:50:00 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-6eb21b74-d5e3-427e-ad09-e43cf404985e tempest-VolumesTransfersV355Test-1316966888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:50:00 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6eb21b74-d5e3-427e-ad09-e43cf404985e tempest-VolumesTransfersV355Test-1316966888 None] Flow 'volume_create_manager' (19710d9b-aa60-42f0-b51f-c653e5faa4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:50:00 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6eb21b74-d5e3-427e-ad09-e43cf404985e tempest-VolumesTransfersV355Test-1316966888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bab90e7e-9a48-4051-bd89-805eb95c5bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:00 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6eb21b74-d5e3-427e-ad09-e43cf404985e tempest-VolumesTransfersV355Test-1316966888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bab90e7e-9a48-4051-bd89-805eb95c5bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:50:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1573136224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8030898-74db-4b05-a03b-202475f767e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcc95b97ee8248fdabe01b9a4c81e760',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:50:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:50:01Z,use_quota=True,user_id='c482fa0edcb244f1a3a55796397e7c53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:00 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6eb21b74-d5e3-427e-ad09-e43cf404985e tempest-VolumesTransfersV355Test-1316966888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97704850-8851-4cef-9fe0-a5acc05de04a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:00 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6eb21b74-d5e3-427e-ad09-e43cf404985e tempest-VolumesTransfersV355Test-1316966888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97704850-8851-4cef-9fe0-a5acc05de04a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:00 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6eb21b74-d5e3-427e-ad09-e43cf404985e tempest-VolumesTransfersV355Test-1316966888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (735cb390-1071-4544-960a-3a28334affcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:00 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6eb21b74-d5e3-427e-ad09-e43cf404985e tempest-VolumesTransfersV355Test-1316966888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (735cb390-1071-4544-960a-3a28334affcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8030898-74db-4b05-a03b-202475f767e4', 'volume_name': 'volume-f8030898-74db-4b05-a03b-202475f767e4', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:00 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6eb21b74-d5e3-427e-ad09-e43cf404985e tempest-VolumesTransfersV355Test-1316966888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d12cfc8-fc96-4d7f-a153-830006f8e076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:00 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6eb21b74-d5e3-427e-ad09-e43cf404985e tempest-VolumesTransfersV355Test-1316966888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d12cfc8-fc96-4d7f-a153-830006f8e076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:00 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6eb21b74-d5e3-427e-ad09-e43cf404985e tempest-VolumesTransfersV355Test-1316966888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f638b202-98dd-4867-bbad-5fd830a2c1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:00 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-6eb21b74-d5e3-427e-ad09-e43cf404985e tempest-VolumesTransfersV355Test-1316966888 None] Volume f8030898-74db-4b05-a03b-202475f767e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8030898-74db-4b05-a03b-202475f767e4', 'volume_size': 1} Jul 08 01:50:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6eb21b74-d5e3-427e-ad09-e43cf404985e tempest-VolumesTransfersV355Test-1316966888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:50:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6eb21b74-d5e3-427e-ad09-e43cf404985e tempest-VolumesTransfersV355Test-1316966888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:50:00 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-6eb21b74-d5e3-427e-ad09-e43cf404985e tempest-VolumesTransfersV355Test-1316966888 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:50:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1573136224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8030898-74db-4b05-a03b-202475f767e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcc95b97ee8248fdabe01b9a4c81e760',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:50:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:50:01Z,use_quota=True,user_id='c482fa0edcb244f1a3a55796397e7c53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:50:00 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-6eb21b74-d5e3-427e-ad09-e43cf404985e tempest-VolumesTransfersV355Test-1316966888 None] Creating volume f8030898-74db-4b05-a03b-202475f767e4 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:50:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6eb21b74-d5e3-427e-ad09-e43cf404985e tempest-VolumesTransfersV355Test-1316966888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:50:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6eb21b74-d5e3-427e-ad09-e43cf404985e tempest-VolumesTransfersV355Test-1316966888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:50:00 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-6eb21b74-d5e3-427e-ad09-e43cf404985e tempest-VolumesTransfersV355Test-1316966888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:50:00 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-6eb21b74-d5e3-427e-ad09-e43cf404985e tempest-VolumesTransfersV355Test-1316966888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:50:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6eb21b74-d5e3-427e-ad09-e43cf404985e tempest-VolumesTransfersV355Test-1316966888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:50:00 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-6eb21b74-d5e3-427e-ad09-e43cf404985e tempest-VolumesTransfersV355Test-1316966888 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:50:00 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-6eb21b74-d5e3-427e-ad09-e43cf404985e tempest-VolumesTransfersV355Test-1316966888 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:50:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6eb21b74-d5e3-427e-ad09-e43cf404985e tempest-VolumesTransfersV355Test-1316966888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f8030898-74db-4b05-a03b-202475f767e4 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:00 devstack sudo[96407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f8030898-74db-4b05-a03b-202475f767e4 1073741824 Jul 08 01:50:00 devstack sudo[96407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:01 devstack sudo[96402]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9277e8da-f376-47d2-b044-0a8888d13238 tempest-VolumesTransfersTest-1453958986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-5b6ee8fa-b0cb-4985-8266-1acc8ee13799" returned: 0 in 1.086s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9277e8da-f376-47d2-b044-0a8888d13238 tempest-VolumesTransfersTest-1453958986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-5b6ee8fa-b0cb-4985-8266-1acc8ee13799 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:01 devstack sudo[96411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-5b6ee8fa-b0cb-4985-8266-1acc8ee13799 Jul 08 01:50:01 devstack sudo[96411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:01 devstack cinder-volume[87134]: INFO cinder.volume.manager [req-55f19efd-3dbf-4577-8830-113790b88c01 req-99493f23-6508-43de-8fa6-f3b242391fee tempest-AttachVolumeNegativeTest-677114920 None] Terminate volume connection completed successfully. Jul 08 01:50:01 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [req-55f19efd-3dbf-4577-8830-113790b88c01 req-99493f23-6508-43de-8fa6-f3b242391fee tempest-AttachVolumeNegativeTest-677114920 None] Deleting attachment 893b886f-c996-47ac-9221-6cda66003ad5. {{(pid=87134) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:50:02 devstack sudo[96411]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9277e8da-f376-47d2-b044-0a8888d13238 tempest-VolumesTransfersTest-1453958986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-5b6ee8fa-b0cb-4985-8266-1acc8ee13799" returned: 0 in 0.897s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:02 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-9277e8da-f376-47d2-b044-0a8888d13238 tempest-VolumesTransfersTest-1453958986 None] Lock "cinder-quobyte-5b6ee8fa-b0cb-4985-8266-1acc8ee13799" released by "delete_volume" :: held 2.061s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:50:02 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-9277e8da-f376-47d2-b044-0a8888d13238 tempest-VolumesTransfersTest-1453958986 None] Created reservations ['928e9ef7-2b65-499a-960f-b74122454354', '0bb06eea-a21a-480d-b6d8-acc28f38efe2', '7f9ac1f4-e042-4323-a1d9-96ae00c1dd00', 'a5e8ed06-5975-4f67-8e38-0ec5cfddb433'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:50:02 devstack sudo[96407]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6eb21b74-d5e3-427e-ad09-e43cf404985e tempest-VolumesTransfersV355Test-1316966888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f8030898-74db-4b05-a03b-202475f767e4 1073741824" returned: 0 in 1.335s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6eb21b74-d5e3-427e-ad09-e43cf404985e tempest-VolumesTransfersV355Test-1316966888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f8030898-74db-4b05-a03b-202475f767e4 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:02 devstack sudo[96446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f8030898-74db-4b05-a03b-202475f767e4 Jul 08 01:50:02 devstack sudo[96446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-9277e8da-f376-47d2-b044-0a8888d13238 tempest-VolumesTransfersTest-1453958986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:50:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-9277e8da-f376-47d2-b044-0a8888d13238 tempest-VolumesTransfersTest-1453958986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:50:02 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-9277e8da-f376-47d2-b044-0a8888d13238 tempest-VolumesTransfersTest-1453958986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:50:02 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-9277e8da-f376-47d2-b044-0a8888d13238 tempest-VolumesTransfersTest-1453958986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:50:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-9277e8da-f376-47d2-b044-0a8888d13238 tempest-VolumesTransfersTest-1453958986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:50:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9277e8da-f376-47d2-b044-0a8888d13238 tempest-VolumesTransfersTest-1453958986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:02 devstack sudo[96448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:50:02 devstack sudo[96448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:03 devstack sudo[96446]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:03 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6eb21b74-d5e3-427e-ad09-e43cf404985e tempest-VolumesTransfersV355Test-1316966888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f8030898-74db-4b05-a03b-202475f767e4" returned: 0 in 0.837s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:03 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-6eb21b74-d5e3-427e-ad09-e43cf404985e tempest-VolumesTransfersV355Test-1316966888 None] <== create_volume: return (2245ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:50:03 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6eb21b74-d5e3-427e-ad09-e43cf404985e tempest-VolumesTransfersV355Test-1316966888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.247s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:50:03 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6eb21b74-d5e3-427e-ad09-e43cf404985e tempest-VolumesTransfersV355Test-1316966888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f638b202-98dd-4867-bbad-5fd830a2c1d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8030898-74db-4b05-a03b-202475f767e4', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:03 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6eb21b74-d5e3-427e-ad09-e43cf404985e tempest-VolumesTransfersV355Test-1316966888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3e8f40f-b050-4946-b634-5ea0a5b26a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:03 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-6eb21b74-d5e3-427e-ad09-e43cf404985e tempest-VolumesTransfersV355Test-1316966888 None] Volume volume-f8030898-74db-4b05-a03b-202475f767e4 (f8030898-74db-4b05-a03b-202475f767e4): created successfully Jul 08 01:50:03 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6eb21b74-d5e3-427e-ad09-e43cf404985e tempest-VolumesTransfersV355Test-1316966888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3e8f40f-b050-4946-b634-5ea0a5b26a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:03 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6eb21b74-d5e3-427e-ad09-e43cf404985e tempest-VolumesTransfersV355Test-1316966888 None] Flow 'volume_create_manager' (19710d9b-aa60-42f0-b51f-c653e5faa4c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:50:03 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-6eb21b74-d5e3-427e-ad09-e43cf404985e tempest-VolumesTransfersV355Test-1316966888 None] Created volume successfully. Jul 08 01:50:03 devstack sudo[96448]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:03 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9277e8da-f376-47d2-b044-0a8888d13238 tempest-VolumesTransfersTest-1453958986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.873s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:03 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-9277e8da-f376-47d2-b044-0a8888d13238 tempest-VolumesTransfersTest-1453958986 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:50:03 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-9277e8da-f376-47d2-b044-0a8888d13238 tempest-VolumesTransfersTest-1453958986 None] Deleted volume successfully. Jul 08 01:50:03 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-9277e8da-f376-47d2-b044-0a8888d13238 tempest-VolumesTransfersTest-1453958986 None] Lock "cinder-5b6ee8fa-b0cb-4985-8266-1acc8ee13799-delete_volume" released by "delete_volume" :: held 3.335s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:50:04 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ff55efc-9d1a-4a56-8d90-0fd729e5e6d5 tempest-VolumesTransfersTest-1927646094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:50:04 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8ff55efc-9d1a-4a56-8d90-0fd729e5e6d5 tempest-VolumesTransfersTest-1927646094 None] Flow 'volume_create_manager' (ed1ab60e-14bf-476c-bd72-e1122f702c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:50:04 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8ff55efc-9d1a-4a56-8d90-0fd729e5e6d5 tempest-VolumesTransfersTest-1927646094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5687534-7677-446d-a2b7-15b049a2d6df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:04 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8ff55efc-9d1a-4a56-8d90-0fd729e5e6d5 tempest-VolumesTransfersTest-1927646094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5687534-7677-446d-a2b7-15b049a2d6df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:50:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-584356956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7be06126-f9cc-46ae-a8a9-573a7e6a51a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18e00e9ab90d4b3b85e03a254157202e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:50:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:50:04Z,use_quota=True,user_id='82ad425757c1485c931b9020326a6129',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:04 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8ff55efc-9d1a-4a56-8d90-0fd729e5e6d5 tempest-VolumesTransfersTest-1927646094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37bc52bf-4ab5-44b6-a638-a2a1e11e58a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:04 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8ff55efc-9d1a-4a56-8d90-0fd729e5e6d5 tempest-VolumesTransfersTest-1927646094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37bc52bf-4ab5-44b6-a638-a2a1e11e58a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:04 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8ff55efc-9d1a-4a56-8d90-0fd729e5e6d5 tempest-VolumesTransfersTest-1927646094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ff10905-8707-4c48-9c85-a4865d4310bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:04 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8ff55efc-9d1a-4a56-8d90-0fd729e5e6d5 tempest-VolumesTransfersTest-1927646094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ff10905-8707-4c48-9c85-a4865d4310bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7be06126-f9cc-46ae-a8a9-573a7e6a51a8', 'volume_name': 'volume-7be06126-f9cc-46ae-a8a9-573a7e6a51a8', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:04 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8ff55efc-9d1a-4a56-8d90-0fd729e5e6d5 tempest-VolumesTransfersTest-1927646094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (443fc680-f52e-4a4e-a370-b5d5bfd64ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:04 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8ff55efc-9d1a-4a56-8d90-0fd729e5e6d5 tempest-VolumesTransfersTest-1927646094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (443fc680-f52e-4a4e-a370-b5d5bfd64ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:04 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8ff55efc-9d1a-4a56-8d90-0fd729e5e6d5 tempest-VolumesTransfersTest-1927646094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (986b4f2b-ce75-40e2-ac2d-ccf9039892df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:04 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-8ff55efc-9d1a-4a56-8d90-0fd729e5e6d5 tempest-VolumesTransfersTest-1927646094 None] Volume 7be06126-f9cc-46ae-a8a9-573a7e6a51a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7be06126-f9cc-46ae-a8a9-573a7e6a51a8', 'volume_size': 1} Jul 08 01:50:04 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-8ff55efc-9d1a-4a56-8d90-0fd729e5e6d5 tempest-VolumesTransfersTest-1927646094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:50:04 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-8ff55efc-9d1a-4a56-8d90-0fd729e5e6d5 tempest-VolumesTransfersTest-1927646094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:50:04 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-8ff55efc-9d1a-4a56-8d90-0fd729e5e6d5 tempest-VolumesTransfersTest-1927646094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:50:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-584356956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7be06126-f9cc-46ae-a8a9-573a7e6a51a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18e00e9ab90d4b3b85e03a254157202e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:50:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:50:04Z,use_quota=True,user_id='82ad425757c1485c931b9020326a6129',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:50:04 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-8ff55efc-9d1a-4a56-8d90-0fd729e5e6d5 tempest-VolumesTransfersTest-1927646094 None] Creating volume 7be06126-f9cc-46ae-a8a9-573a7e6a51a8 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:50:04 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-8ff55efc-9d1a-4a56-8d90-0fd729e5e6d5 tempest-VolumesTransfersTest-1927646094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:50:04 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-8ff55efc-9d1a-4a56-8d90-0fd729e5e6d5 tempest-VolumesTransfersTest-1927646094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:50:04 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-8ff55efc-9d1a-4a56-8d90-0fd729e5e6d5 tempest-VolumesTransfersTest-1927646094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:50:04 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-8ff55efc-9d1a-4a56-8d90-0fd729e5e6d5 tempest-VolumesTransfersTest-1927646094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:50:04 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-8ff55efc-9d1a-4a56-8d90-0fd729e5e6d5 tempest-VolumesTransfersTest-1927646094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:50:04 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-8ff55efc-9d1a-4a56-8d90-0fd729e5e6d5 tempest-VolumesTransfersTest-1927646094 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:50:04 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-8ff55efc-9d1a-4a56-8d90-0fd729e5e6d5 tempest-VolumesTransfersTest-1927646094 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:50:04 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8ff55efc-9d1a-4a56-8d90-0fd729e5e6d5 tempest-VolumesTransfersTest-1927646094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7be06126-f9cc-46ae-a8a9-573a7e6a51a8 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:04 devstack sudo[96462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7be06126-f9cc-46ae-a8a9-573a7e6a51a8 1073741824 Jul 08 01:50:04 devstack sudo[96462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:04 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-952060b0-7de8-42fd-bfec-720a3d06b573 tempest-VolumesTransfersV355Test-1671985594 None] Acquiring lock "cinder-f8030898-74db-4b05-a03b-202475f767e4-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:50:04 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-952060b0-7de8-42fd-bfec-720a3d06b573 tempest-VolumesTransfersV355Test-1671985594 None] Lock "cinder-f8030898-74db-4b05-a03b-202475f767e4-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:50:04 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-952060b0-7de8-42fd-bfec-720a3d06b573 tempest-VolumesTransfersV355Test-1671985594 None] Acquiring lock "cinder-quobyte-f8030898-74db-4b05-a03b-202475f767e4" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:50:04 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-952060b0-7de8-42fd-bfec-720a3d06b573 tempest-VolumesTransfersV355Test-1671985594 None] Lock "cinder-quobyte-f8030898-74db-4b05-a03b-202475f767e4" acquired by "delete_volume" :: waited 0.019s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:50:04 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb0b22b-1c15-4468-af35-851c710604ff]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:50:04 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-952060b0-7de8-42fd-bfec-720a3d06b573 tempest-VolumesTransfersV355Test-1671985594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f8030898-74db-4b05-a03b-202475f767e4 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:04 devstack sudo[96464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f8030898-74db-4b05-a03b-202475f767e4 Jul 08 01:50:04 devstack sudo[96464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:05 devstack sudo[96462]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:05 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8ff55efc-9d1a-4a56-8d90-0fd729e5e6d5 tempest-VolumesTransfersTest-1927646094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7be06126-f9cc-46ae-a8a9-573a7e6a51a8 1073741824" returned: 0 in 1.277s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:05 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8ff55efc-9d1a-4a56-8d90-0fd729e5e6d5 tempest-VolumesTransfersTest-1927646094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7be06126-f9cc-46ae-a8a9-573a7e6a51a8 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:05 devstack sudo[96485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7be06126-f9cc-46ae-a8a9-573a7e6a51a8 Jul 08 01:50:05 devstack sudo[96485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:05 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-286034d1-f9e3-4d24-b706-b7fc8627c2b0 tempest-VolumesTransfersV357Test-147694162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:50:05 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-286034d1-f9e3-4d24-b706-b7fc8627c2b0 tempest-VolumesTransfersV357Test-147694162 None] Flow 'volume_create_manager' (3cbf9b71-1407-4428-b58e-4a8caf226a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:50:05 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-286034d1-f9e3-4d24-b706-b7fc8627c2b0 tempest-VolumesTransfersV357Test-147694162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f61d9c39-9aa4-43e6-a80c-6dab1e92013b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:05 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-286034d1-f9e3-4d24-b706-b7fc8627c2b0 tempest-VolumesTransfersV357Test-147694162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f61d9c39-9aa4-43e6-a80c-6dab1e92013b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:50:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1851077386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a595e5d-1aa2-4fa1-a0f7-a2d34a4ef6e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fe744794104490da3e80dd4ccaaf2dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:50:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:50:06Z,use_quota=True,user_id='8c2fdfd513604fc3b5cea692151fab76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:05 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-286034d1-f9e3-4d24-b706-b7fc8627c2b0 tempest-VolumesTransfersV357Test-147694162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (844b15c2-db6b-49c1-bb0a-ad4efb74364e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:05 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-286034d1-f9e3-4d24-b706-b7fc8627c2b0 tempest-VolumesTransfersV357Test-147694162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (844b15c2-db6b-49c1-bb0a-ad4efb74364e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:05 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-286034d1-f9e3-4d24-b706-b7fc8627c2b0 tempest-VolumesTransfersV357Test-147694162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f1ca233-1b44-404d-b304-a9d57da9571d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:06 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-286034d1-f9e3-4d24-b706-b7fc8627c2b0 tempest-VolumesTransfersV357Test-147694162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f1ca233-1b44-404d-b304-a9d57da9571d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a595e5d-1aa2-4fa1-a0f7-a2d34a4ef6e8', 'volume_name': 'volume-0a595e5d-1aa2-4fa1-a0f7-a2d34a4ef6e8', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:06 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-286034d1-f9e3-4d24-b706-b7fc8627c2b0 tempest-VolumesTransfersV357Test-147694162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a5cc2c3-595f-41ca-831a-85e0a13fd03c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:06 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-286034d1-f9e3-4d24-b706-b7fc8627c2b0 tempest-VolumesTransfersV357Test-147694162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a5cc2c3-595f-41ca-831a-85e0a13fd03c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:06 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-286034d1-f9e3-4d24-b706-b7fc8627c2b0 tempest-VolumesTransfersV357Test-147694162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75dff9d9-a963-4fa5-9953-2e2591c7cac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:06 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-286034d1-f9e3-4d24-b706-b7fc8627c2b0 tempest-VolumesTransfersV357Test-147694162 None] Volume 0a595e5d-1aa2-4fa1-a0f7-a2d34a4ef6e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a595e5d-1aa2-4fa1-a0f7-a2d34a4ef6e8', 'volume_size': 1} Jul 08 01:50:06 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-286034d1-f9e3-4d24-b706-b7fc8627c2b0 tempest-VolumesTransfersV357Test-147694162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:50:06 devstack sudo[96464]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:06 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-952060b0-7de8-42fd-bfec-720a3d06b573 tempest-VolumesTransfersV355Test-1671985594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f8030898-74db-4b05-a03b-202475f767e4" returned: 0 in 1.564s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:06 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-952060b0-7de8-42fd-bfec-720a3d06b573 tempest-VolumesTransfersV355Test-1671985594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f8030898-74db-4b05-a03b-202475f767e4 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:06 devstack sudo[96496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f8030898-74db-4b05-a03b-202475f767e4 Jul 08 01:50:06 devstack sudo[96496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:06 devstack sudo[96485]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:06 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8ff55efc-9d1a-4a56-8d90-0fd729e5e6d5 tempest-VolumesTransfersTest-1927646094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7be06126-f9cc-46ae-a8a9-573a7e6a51a8" returned: 0 in 0.917s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:06 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-8ff55efc-9d1a-4a56-8d90-0fd729e5e6d5 tempest-VolumesTransfersTest-1927646094 None] <== create_volume: return (2388ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:50:06 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-8ff55efc-9d1a-4a56-8d90-0fd729e5e6d5 tempest-VolumesTransfersTest-1927646094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.391s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:50:06 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-286034d1-f9e3-4d24-b706-b7fc8627c2b0 tempest-VolumesTransfersV357Test-147694162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.628s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:50:06 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-286034d1-f9e3-4d24-b706-b7fc8627c2b0 tempest-VolumesTransfersV357Test-147694162 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:50:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1851077386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a595e5d-1aa2-4fa1-a0f7-a2d34a4ef6e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fe744794104490da3e80dd4ccaaf2dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:50:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:50:06Z,use_quota=True,user_id='8c2fdfd513604fc3b5cea692151fab76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:50:06 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-286034d1-f9e3-4d24-b706-b7fc8627c2b0 tempest-VolumesTransfersV357Test-147694162 None] Creating volume 0a595e5d-1aa2-4fa1-a0f7-a2d34a4ef6e8 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:50:06 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-286034d1-f9e3-4d24-b706-b7fc8627c2b0 tempest-VolumesTransfersV357Test-147694162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:50:06 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-286034d1-f9e3-4d24-b706-b7fc8627c2b0 tempest-VolumesTransfersV357Test-147694162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:50:06 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-286034d1-f9e3-4d24-b706-b7fc8627c2b0 tempest-VolumesTransfersV357Test-147694162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:50:06 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-286034d1-f9e3-4d24-b706-b7fc8627c2b0 tempest-VolumesTransfersV357Test-147694162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:50:06 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-286034d1-f9e3-4d24-b706-b7fc8627c2b0 tempest-VolumesTransfersV357Test-147694162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:50:06 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-286034d1-f9e3-4d24-b706-b7fc8627c2b0 tempest-VolumesTransfersV357Test-147694162 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:50:06 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-286034d1-f9e3-4d24-b706-b7fc8627c2b0 tempest-VolumesTransfersV357Test-147694162 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:50:06 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-286034d1-f9e3-4d24-b706-b7fc8627c2b0 tempest-VolumesTransfersV357Test-147694162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0a595e5d-1aa2-4fa1-a0f7-a2d34a4ef6e8 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:06 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8ff55efc-9d1a-4a56-8d90-0fd729e5e6d5 tempest-VolumesTransfersTest-1927646094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (986b4f2b-ce75-40e2-ac2d-ccf9039892df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7be06126-f9cc-46ae-a8a9-573a7e6a51a8', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:06 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8ff55efc-9d1a-4a56-8d90-0fd729e5e6d5 tempest-VolumesTransfersTest-1927646094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (637c743b-0883-41a3-bf6f-215b8dae9489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:06 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-8ff55efc-9d1a-4a56-8d90-0fd729e5e6d5 tempest-VolumesTransfersTest-1927646094 None] Volume volume-7be06126-f9cc-46ae-a8a9-573a7e6a51a8 (7be06126-f9cc-46ae-a8a9-573a7e6a51a8): created successfully Jul 08 01:50:06 devstack sudo[96500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0a595e5d-1aa2-4fa1-a0f7-a2d34a4ef6e8 1073741824 Jul 08 01:50:06 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8ff55efc-9d1a-4a56-8d90-0fd729e5e6d5 tempest-VolumesTransfersTest-1927646094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (637c743b-0883-41a3-bf6f-215b8dae9489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:06 devstack sudo[96500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:06 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8ff55efc-9d1a-4a56-8d90-0fd729e5e6d5 tempest-VolumesTransfersTest-1927646094 None] Flow 'volume_create_manager' (ed1ab60e-14bf-476c-bd72-e1122f702c93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:50:06 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-8ff55efc-9d1a-4a56-8d90-0fd729e5e6d5 tempest-VolumesTransfersTest-1927646094 None] Created volume successfully. Jul 08 01:50:07 devstack sudo[96496]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:07 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-952060b0-7de8-42fd-bfec-720a3d06b573 tempest-VolumesTransfersV355Test-1671985594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f8030898-74db-4b05-a03b-202475f767e4" returned: 0 in 0.976s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:07 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-952060b0-7de8-42fd-bfec-720a3d06b573 tempest-VolumesTransfersV355Test-1671985594 None] Lock "cinder-quobyte-f8030898-74db-4b05-a03b-202475f767e4" released by "delete_volume" :: held 2.619s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:50:07 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-952060b0-7de8-42fd-bfec-720a3d06b573 tempest-VolumesTransfersV355Test-1671985594 None] Created reservations ['d631a094-41ee-4362-b05e-1ea04bd8eee3', '75749cbb-c29a-4ecb-9c49-820429434f00', '364116dd-b300-4630-99e5-6833900aafd8', '9ed60908-9617-49b7-8d00-dbf0baa58edc'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:50:07 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-952060b0-7de8-42fd-bfec-720a3d06b573 tempest-VolumesTransfersV355Test-1671985594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:50:07 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-952060b0-7de8-42fd-bfec-720a3d06b573 tempest-VolumesTransfersV355Test-1671985594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:50:07 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-952060b0-7de8-42fd-bfec-720a3d06b573 tempest-VolumesTransfersV355Test-1671985594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:50:07 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-952060b0-7de8-42fd-bfec-720a3d06b573 tempest-VolumesTransfersV355Test-1671985594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:50:07 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-952060b0-7de8-42fd-bfec-720a3d06b573 tempest-VolumesTransfersV355Test-1671985594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:50:07 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-952060b0-7de8-42fd-bfec-720a3d06b573 tempest-VolumesTransfersV355Test-1671985594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:07 devstack sudo[96507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:50:07 devstack sudo[96507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:07 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-de065290-9971-41a4-aa9d-4ecc581eab1f tempest-VolumesTransfersTest-1453958986 None] Acquiring lock "cinder-7be06126-f9cc-46ae-a8a9-573a7e6a51a8-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:50:07 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-de065290-9971-41a4-aa9d-4ecc581eab1f tempest-VolumesTransfersTest-1453958986 None] Lock "cinder-7be06126-f9cc-46ae-a8a9-573a7e6a51a8-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:50:07 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-de065290-9971-41a4-aa9d-4ecc581eab1f tempest-VolumesTransfersTest-1453958986 None] Acquiring lock "cinder-quobyte-7be06126-f9cc-46ae-a8a9-573a7e6a51a8" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:50:07 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-de065290-9971-41a4-aa9d-4ecc581eab1f tempest-VolumesTransfersTest-1453958986 None] Lock "cinder-quobyte-7be06126-f9cc-46ae-a8a9-573a7e6a51a8" acquired by "delete_volume" :: waited 0.031s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:50:07 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[d248d460-a10b-4ada-9b04-f8d87e2c5740]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:50:07 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-de065290-9971-41a4-aa9d-4ecc581eab1f tempest-VolumesTransfersTest-1453958986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7be06126-f9cc-46ae-a8a9-573a7e6a51a8 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:08 devstack sudo[96500]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:08 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-286034d1-f9e3-4d24-b706-b7fc8627c2b0 tempest-VolumesTransfersV357Test-147694162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0a595e5d-1aa2-4fa1-a0f7-a2d34a4ef6e8 1073741824" returned: 0 in 1.359s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:08 devstack sudo[96511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7be06126-f9cc-46ae-a8a9-573a7e6a51a8 Jul 08 01:50:08 devstack sudo[96511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:08 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-286034d1-f9e3-4d24-b706-b7fc8627c2b0 tempest-VolumesTransfersV357Test-147694162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0a595e5d-1aa2-4fa1-a0f7-a2d34a4ef6e8 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:08 devstack sudo[96513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0a595e5d-1aa2-4fa1-a0f7-a2d34a4ef6e8 Jul 08 01:50:08 devstack sudo[96513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:08 devstack sudo[96507]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:08 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-952060b0-7de8-42fd-bfec-720a3d06b573 tempest-VolumesTransfersV355Test-1671985594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 1.123s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:08 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-952060b0-7de8-42fd-bfec-720a3d06b573 tempest-VolumesTransfersV355Test-1671985594 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:50:08 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-952060b0-7de8-42fd-bfec-720a3d06b573 tempest-VolumesTransfersV355Test-1671985594 None] Deleted volume successfully. Jul 08 01:50:08 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-952060b0-7de8-42fd-bfec-720a3d06b573 tempest-VolumesTransfersV355Test-1671985594 None] Lock "cinder-f8030898-74db-4b05-a03b-202475f767e4-delete_volume" released by "delete_volume" :: held 4.106s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:50:08 devstack sudo[96513]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:08 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-286034d1-f9e3-4d24-b706-b7fc8627c2b0 tempest-VolumesTransfersV357Test-147694162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0a595e5d-1aa2-4fa1-a0f7-a2d34a4ef6e8" returned: 0 in 0.869s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:08 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-286034d1-f9e3-4d24-b706-b7fc8627c2b0 tempest-VolumesTransfersV357Test-147694162 None] <== create_volume: return (2300ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:50:08 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-286034d1-f9e3-4d24-b706-b7fc8627c2b0 tempest-VolumesTransfersV357Test-147694162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.305s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:50:08 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-286034d1-f9e3-4d24-b706-b7fc8627c2b0 tempest-VolumesTransfersV357Test-147694162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75dff9d9-a963-4fa5-9953-2e2591c7cac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a595e5d-1aa2-4fa1-a0f7-a2d34a4ef6e8', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:08 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-286034d1-f9e3-4d24-b706-b7fc8627c2b0 tempest-VolumesTransfersV357Test-147694162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42d6044c-462b-47ac-bac3-c6d5ef070ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:09 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-286034d1-f9e3-4d24-b706-b7fc8627c2b0 tempest-VolumesTransfersV357Test-147694162 None] Volume volume-0a595e5d-1aa2-4fa1-a0f7-a2d34a4ef6e8 (0a595e5d-1aa2-4fa1-a0f7-a2d34a4ef6e8): created successfully Jul 08 01:50:09 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-286034d1-f9e3-4d24-b706-b7fc8627c2b0 tempest-VolumesTransfersV357Test-147694162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42d6044c-462b-47ac-bac3-c6d5ef070ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:09 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-286034d1-f9e3-4d24-b706-b7fc8627c2b0 tempest-VolumesTransfersV357Test-147694162 None] Flow 'volume_create_manager' (3cbf9b71-1407-4428-b58e-4a8caf226a1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:50:09 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-286034d1-f9e3-4d24-b706-b7fc8627c2b0 tempest-VolumesTransfersV357Test-147694162 None] Created volume successfully. Jul 08 01:50:09 devstack sudo[96511]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:09 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-de065290-9971-41a4-aa9d-4ecc581eab1f tempest-VolumesTransfersTest-1453958986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7be06126-f9cc-46ae-a8a9-573a7e6a51a8" returned: 0 in 1.149s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:09 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-de065290-9971-41a4-aa9d-4ecc581eab1f tempest-VolumesTransfersTest-1453958986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7be06126-f9cc-46ae-a8a9-573a7e6a51a8 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:09 devstack sudo[96521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7be06126-f9cc-46ae-a8a9-573a7e6a51a8 Jul 08 01:50:09 devstack sudo[96521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:09 devstack sudo[96521]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:09 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-de065290-9971-41a4-aa9d-4ecc581eab1f tempest-VolumesTransfersTest-1453958986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7be06126-f9cc-46ae-a8a9-573a7e6a51a8" returned: 0 in 0.744s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:09 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-de065290-9971-41a4-aa9d-4ecc581eab1f tempest-VolumesTransfersTest-1453958986 None] Lock "cinder-quobyte-7be06126-f9cc-46ae-a8a9-573a7e6a51a8" released by "delete_volume" :: held 1.969s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:50:09 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-de065290-9971-41a4-aa9d-4ecc581eab1f tempest-VolumesTransfersTest-1453958986 None] Created reservations ['3832e066-ed57-497b-8e42-8b5b73c985b4', 'acbac15f-c7bc-4e28-bfd2-721eab6339e3', '3838dd6e-f31e-4531-9b36-0c6ef85da00e', '7507fd4a-19b4-4798-8481-02020021ed58'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:50:09 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-de065290-9971-41a4-aa9d-4ecc581eab1f tempest-VolumesTransfersTest-1453958986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:50:09 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-de065290-9971-41a4-aa9d-4ecc581eab1f tempest-VolumesTransfersTest-1453958986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:50:09 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-de065290-9971-41a4-aa9d-4ecc581eab1f tempest-VolumesTransfersTest-1453958986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:50:09 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-de065290-9971-41a4-aa9d-4ecc581eab1f tempest-VolumesTransfersTest-1453958986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:50:09 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-de065290-9971-41a4-aa9d-4ecc581eab1f tempest-VolumesTransfersTest-1453958986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:50:09 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-de065290-9971-41a4-aa9d-4ecc581eab1f tempest-VolumesTransfersTest-1453958986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:10 devstack sudo[96524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:50:10 devstack sudo[96524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:10 devstack sudo[96524]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:10 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-de065290-9971-41a4-aa9d-4ecc581eab1f tempest-VolumesTransfersTest-1453958986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.928s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:10 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-de065290-9971-41a4-aa9d-4ecc581eab1f tempest-VolumesTransfersTest-1453958986 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:50:10 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-de065290-9971-41a4-aa9d-4ecc581eab1f tempest-VolumesTransfersTest-1453958986 None] Deleted volume successfully. Jul 08 01:50:10 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-de065290-9971-41a4-aa9d-4ecc581eab1f tempest-VolumesTransfersTest-1453958986 None] Lock "cinder-7be06126-f9cc-46ae-a8a9-573a7e6a51a8-delete_volume" released by "delete_volume" :: held 3.243s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:50:11 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-504fedc1-2812-44a7-9d15-2d0194a46399 tempest-VolumesTransfersV357Test-389412493 None] Transfer volume completed successfully. Jul 08 01:50:12 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-670a5701-4cb7-47f3-8f30-8c1d754b2ff7 tempest-VolumesTransfersV357Test-300790154 None] Acquiring lock "cinder-0a595e5d-1aa2-4fa1-a0f7-a2d34a4ef6e8-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:50:13 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-670a5701-4cb7-47f3-8f30-8c1d754b2ff7 tempest-VolumesTransfersV357Test-300790154 None] Lock "cinder-0a595e5d-1aa2-4fa1-a0f7-a2d34a4ef6e8-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:50:13 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-670a5701-4cb7-47f3-8f30-8c1d754b2ff7 tempest-VolumesTransfersV357Test-300790154 None] Acquiring lock "cinder-quobyte-0a595e5d-1aa2-4fa1-a0f7-a2d34a4ef6e8" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:50:13 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-670a5701-4cb7-47f3-8f30-8c1d754b2ff7 tempest-VolumesTransfersV357Test-300790154 None] Lock "cinder-quobyte-0a595e5d-1aa2-4fa1-a0f7-a2d34a4ef6e8" acquired by "delete_volume" :: waited 0.025s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:50:13 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46ab060-5ffa-4ad8-b920-7fd5f5bf449a]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:50:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-670a5701-4cb7-47f3-8f30-8c1d754b2ff7 tempest-VolumesTransfersV357Test-300790154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0a595e5d-1aa2-4fa1-a0f7-a2d34a4ef6e8 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:13 devstack sudo[96530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0a595e5d-1aa2-4fa1-a0f7-a2d34a4ef6e8 Jul 08 01:50:13 devstack sudo[96530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:13 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-62466ee0-50f9-4864-8576-7a6bdbd99440 tempest-AttachVolumeNegativeTest-677114920 None] Acquiring lock "cinder-611b586f-2670-426b-9dcd-ca5aaa791405-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:50:13 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-62466ee0-50f9-4864-8576-7a6bdbd99440 tempest-AttachVolumeNegativeTest-677114920 None] Lock "cinder-611b586f-2670-426b-9dcd-ca5aaa791405-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:50:14 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-62466ee0-50f9-4864-8576-7a6bdbd99440 tempest-AttachVolumeNegativeTest-677114920 None] Acquiring lock "cinder-quobyte-611b586f-2670-426b-9dcd-ca5aaa791405" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:50:14 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-62466ee0-50f9-4864-8576-7a6bdbd99440 tempest-AttachVolumeNegativeTest-677114920 None] Lock "cinder-quobyte-611b586f-2670-426b-9dcd-ca5aaa791405" acquired by "delete_volume" :: waited 0.036s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:50:14 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4fd3c7b-9547-4e43-a2ea-bea646906b45]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:50:14 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-62466ee0-50f9-4864-8576-7a6bdbd99440 tempest-AttachVolumeNegativeTest-677114920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-611b586f-2670-426b-9dcd-ca5aaa791405 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:14 devstack sudo[96532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-611b586f-2670-426b-9dcd-ca5aaa791405 Jul 08 01:50:14 devstack sudo[96532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:14 devstack sudo[96530]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:14 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-670a5701-4cb7-47f3-8f30-8c1d754b2ff7 tempest-VolumesTransfersV357Test-300790154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0a595e5d-1aa2-4fa1-a0f7-a2d34a4ef6e8" returned: 0 in 1.303s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:14 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-670a5701-4cb7-47f3-8f30-8c1d754b2ff7 tempest-VolumesTransfersV357Test-300790154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0a595e5d-1aa2-4fa1-a0f7-a2d34a4ef6e8 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:14 devstack sudo[96538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0a595e5d-1aa2-4fa1-a0f7-a2d34a4ef6e8 Jul 08 01:50:14 devstack sudo[96538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:15 devstack sudo[96532]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-62466ee0-50f9-4864-8576-7a6bdbd99440 tempest-AttachVolumeNegativeTest-677114920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-611b586f-2670-426b-9dcd-ca5aaa791405" returned: 0 in 1.086s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-62466ee0-50f9-4864-8576-7a6bdbd99440 tempest-AttachVolumeNegativeTest-677114920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-611b586f-2670-426b-9dcd-ca5aaa791405 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:15 devstack sudo[96544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-611b586f-2670-426b-9dcd-ca5aaa791405 Jul 08 01:50:15 devstack sudo[96544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:15 devstack sudo[96538]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-670a5701-4cb7-47f3-8f30-8c1d754b2ff7 tempest-VolumesTransfersV357Test-300790154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0a595e5d-1aa2-4fa1-a0f7-a2d34a4ef6e8" returned: 0 in 0.958s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:15 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-670a5701-4cb7-47f3-8f30-8c1d754b2ff7 tempest-VolumesTransfersV357Test-300790154 None] Lock "cinder-quobyte-0a595e5d-1aa2-4fa1-a0f7-a2d34a4ef6e8" released by "delete_volume" :: held 2.341s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:50:15 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-670a5701-4cb7-47f3-8f30-8c1d754b2ff7 tempest-VolumesTransfersV357Test-300790154 None] Created reservations ['f669d92a-74a6-4e84-b58c-a641a2bd4af3', '52b36763-f2e0-427e-b913-9018fe9daf6e', 'b36bc063-559a-4f21-b7b0-5922cd4f65ac', '34360848-7fb1-462b-ab0f-22097d7fc690'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:50:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-670a5701-4cb7-47f3-8f30-8c1d754b2ff7 tempest-VolumesTransfersV357Test-300790154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:50:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-670a5701-4cb7-47f3-8f30-8c1d754b2ff7 tempest-VolumesTransfersV357Test-300790154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:50:15 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-670a5701-4cb7-47f3-8f30-8c1d754b2ff7 tempest-VolumesTransfersV357Test-300790154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:50:15 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-670a5701-4cb7-47f3-8f30-8c1d754b2ff7 tempest-VolumesTransfersV357Test-300790154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:50:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-670a5701-4cb7-47f3-8f30-8c1d754b2ff7 tempest-VolumesTransfersV357Test-300790154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:50:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-670a5701-4cb7-47f3-8f30-8c1d754b2ff7 tempest-VolumesTransfersV357Test-300790154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:15 devstack sudo[96547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:50:15 devstack sudo[96547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:16 devstack sudo[96544]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-62466ee0-50f9-4864-8576-7a6bdbd99440 tempest-AttachVolumeNegativeTest-677114920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-611b586f-2670-426b-9dcd-ca5aaa791405" returned: 0 in 1.101s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:16 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-62466ee0-50f9-4864-8576-7a6bdbd99440 tempest-AttachVolumeNegativeTest-677114920 None] Lock "cinder-quobyte-611b586f-2670-426b-9dcd-ca5aaa791405" released by "delete_volume" :: held 2.295s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:50:16 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-62466ee0-50f9-4864-8576-7a6bdbd99440 tempest-AttachVolumeNegativeTest-677114920 None] Created reservations ['b0f3ad97-ab9f-41c2-bc2f-9a1edf6f8ca2', 'c29d50f2-abe7-48d7-ad58-93848741dbd9', '2fede414-9999-482c-9c9e-147786ab8779', '51916e6f-589f-4c9e-b0a4-00dc8c9d067e'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:50:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-62466ee0-50f9-4864-8576-7a6bdbd99440 tempest-AttachVolumeNegativeTest-677114920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:50:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-62466ee0-50f9-4864-8576-7a6bdbd99440 tempest-AttachVolumeNegativeTest-677114920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:50:16 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-62466ee0-50f9-4864-8576-7a6bdbd99440 tempest-AttachVolumeNegativeTest-677114920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:50:16 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-62466ee0-50f9-4864-8576-7a6bdbd99440 tempest-AttachVolumeNegativeTest-677114920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:50:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-62466ee0-50f9-4864-8576-7a6bdbd99440 tempest-AttachVolumeNegativeTest-677114920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:50:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-62466ee0-50f9-4864-8576-7a6bdbd99440 tempest-AttachVolumeNegativeTest-677114920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:16 devstack sudo[96551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:50:16 devstack sudo[96551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:16 devstack sudo[96547]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-670a5701-4cb7-47f3-8f30-8c1d754b2ff7 tempest-VolumesTransfersV357Test-300790154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 1.029s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:16 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-670a5701-4cb7-47f3-8f30-8c1d754b2ff7 tempest-VolumesTransfersV357Test-300790154 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:50:16 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-670a5701-4cb7-47f3-8f30-8c1d754b2ff7 tempest-VolumesTransfersV357Test-300790154 None] Deleted volume successfully. Jul 08 01:50:16 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-670a5701-4cb7-47f3-8f30-8c1d754b2ff7 tempest-VolumesTransfersV357Test-300790154 None] Lock "cinder-0a595e5d-1aa2-4fa1-a0f7-a2d34a4ef6e8-delete_volume" released by "delete_volume" :: held 3.815s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:50:17 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-88c65b10-5c1d-498c-838a-323bda632f36 tempest-VolumesTransfersV357Test-147694162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:50:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-88c65b10-5c1d-498c-838a-323bda632f36 tempest-VolumesTransfersV357Test-147694162 None] Flow 'volume_create_manager' (5a1a9f7d-ba50-457a-b867-a71e6943cd49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:50:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-88c65b10-5c1d-498c-838a-323bda632f36 tempest-VolumesTransfersV357Test-147694162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8c631e3-6b8b-40af-9883-8b3185742f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-88c65b10-5c1d-498c-838a-323bda632f36 tempest-VolumesTransfersV357Test-147694162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8c631e3-6b8b-40af-9883-8b3185742f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:50:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1703712006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81497567-aea5-4150-aff6-54b832bb448b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fe744794104490da3e80dd4ccaaf2dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:50:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:50:17Z,use_quota=True,user_id='8c2fdfd513604fc3b5cea692151fab76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-88c65b10-5c1d-498c-838a-323bda632f36 tempest-VolumesTransfersV357Test-147694162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7c919fd-416b-4fe2-bcbf-ae182a93b4bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-88c65b10-5c1d-498c-838a-323bda632f36 tempest-VolumesTransfersV357Test-147694162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7c919fd-416b-4fe2-bcbf-ae182a93b4bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-88c65b10-5c1d-498c-838a-323bda632f36 tempest-VolumesTransfersV357Test-147694162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c2182eb-6829-4df3-a494-0f00e5bff3b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-88c65b10-5c1d-498c-838a-323bda632f36 tempest-VolumesTransfersV357Test-147694162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c2182eb-6829-4df3-a494-0f00e5bff3b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81497567-aea5-4150-aff6-54b832bb448b', 'volume_name': 'volume-81497567-aea5-4150-aff6-54b832bb448b', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-88c65b10-5c1d-498c-838a-323bda632f36 tempest-VolumesTransfersV357Test-147694162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cf5daaa-79bf-4c0e-aa48-b01d9ae05d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-88c65b10-5c1d-498c-838a-323bda632f36 tempest-VolumesTransfersV357Test-147694162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cf5daaa-79bf-4c0e-aa48-b01d9ae05d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-88c65b10-5c1d-498c-838a-323bda632f36 tempest-VolumesTransfersV357Test-147694162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da331251-2eae-42f5-8119-1ec043c7f570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:17 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-88c65b10-5c1d-498c-838a-323bda632f36 tempest-VolumesTransfersV357Test-147694162 None] Volume 81497567-aea5-4150-aff6-54b832bb448b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81497567-aea5-4150-aff6-54b832bb448b', 'volume_size': 1} Jul 08 01:50:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-88c65b10-5c1d-498c-838a-323bda632f36 tempest-VolumesTransfersV357Test-147694162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:50:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-88c65b10-5c1d-498c-838a-323bda632f36 tempest-VolumesTransfersV357Test-147694162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:50:17 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-88c65b10-5c1d-498c-838a-323bda632f36 tempest-VolumesTransfersV357Test-147694162 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:50:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1703712006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81497567-aea5-4150-aff6-54b832bb448b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fe744794104490da3e80dd4ccaaf2dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:50:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:50:17Z,use_quota=True,user_id='8c2fdfd513604fc3b5cea692151fab76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:50:17 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-88c65b10-5c1d-498c-838a-323bda632f36 tempest-VolumesTransfersV357Test-147694162 None] Creating volume 81497567-aea5-4150-aff6-54b832bb448b {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:50:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-88c65b10-5c1d-498c-838a-323bda632f36 tempest-VolumesTransfersV357Test-147694162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:50:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-88c65b10-5c1d-498c-838a-323bda632f36 tempest-VolumesTransfersV357Test-147694162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:50:17 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-88c65b10-5c1d-498c-838a-323bda632f36 tempest-VolumesTransfersV357Test-147694162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:50:17 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-88c65b10-5c1d-498c-838a-323bda632f36 tempest-VolumesTransfersV357Test-147694162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:50:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-88c65b10-5c1d-498c-838a-323bda632f36 tempest-VolumesTransfersV357Test-147694162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:50:17 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-88c65b10-5c1d-498c-838a-323bda632f36 tempest-VolumesTransfersV357Test-147694162 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:50:17 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-88c65b10-5c1d-498c-838a-323bda632f36 tempest-VolumesTransfersV357Test-147694162 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:50:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-88c65b10-5c1d-498c-838a-323bda632f36 tempest-VolumesTransfersV357Test-147694162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-81497567-aea5-4150-aff6-54b832bb448b 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:17 devstack sudo[96554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-81497567-aea5-4150-aff6-54b832bb448b 1073741824 Jul 08 01:50:17 devstack sudo[96554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:17 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-f4cd624d-6b8d-40b8-b63f-cb5b4d5a87c3 tempest-AttachVolumeNegativeTest-677114920 None] Acquiring lock "cinder-22712370-5615-4367-be20-43de0edd73b6-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:50:17 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-f4cd624d-6b8d-40b8-b63f-cb5b4d5a87c3 tempest-AttachVolumeNegativeTest-677114920 None] Lock "cinder-22712370-5615-4367-be20-43de0edd73b6-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:50:17 devstack sudo[96551]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-62466ee0-50f9-4864-8576-7a6bdbd99440 tempest-AttachVolumeNegativeTest-677114920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 1.022s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:17 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-62466ee0-50f9-4864-8576-7a6bdbd99440 tempest-AttachVolumeNegativeTest-677114920 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:50:17 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-62466ee0-50f9-4864-8576-7a6bdbd99440 tempest-AttachVolumeNegativeTest-677114920 None] Deleted volume successfully. Jul 08 01:50:17 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-f4cd624d-6b8d-40b8-b63f-cb5b4d5a87c3 tempest-AttachVolumeNegativeTest-677114920 None] Acquiring lock "cinder-quobyte-22712370-5615-4367-be20-43de0edd73b6" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:50:17 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-62466ee0-50f9-4864-8576-7a6bdbd99440 tempest-AttachVolumeNegativeTest-677114920 None] Lock "cinder-611b586f-2670-426b-9dcd-ca5aaa791405-delete_volume" released by "delete_volume" :: held 3.823s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:50:17 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-f4cd624d-6b8d-40b8-b63f-cb5b4d5a87c3 tempest-AttachVolumeNegativeTest-677114920 None] Lock "cinder-quobyte-22712370-5615-4367-be20-43de0edd73b6" acquired by "delete_volume" :: waited 0.031s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:50:17 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e983db-83ae-49e8-ad88-c63b7764be04]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:50:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f4cd624d-6b8d-40b8-b63f-cb5b4d5a87c3 tempest-AttachVolumeNegativeTest-677114920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-22712370-5615-4367-be20-43de0edd73b6 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:17 devstack sudo[96556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-22712370-5615-4367-be20-43de0edd73b6 Jul 08 01:50:17 devstack sudo[96556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:18 devstack sudo[96554]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-88c65b10-5c1d-498c-838a-323bda632f36 tempest-VolumesTransfersV357Test-147694162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-81497567-aea5-4150-aff6-54b832bb448b 1073741824" returned: 0 in 1.349s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:18 devstack sudo[96556]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f4cd624d-6b8d-40b8-b63f-cb5b4d5a87c3 tempest-AttachVolumeNegativeTest-677114920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-22712370-5615-4367-be20-43de0edd73b6" returned: 0 in 1.107s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f4cd624d-6b8d-40b8-b63f-cb5b4d5a87c3 tempest-AttachVolumeNegativeTest-677114920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-22712370-5615-4367-be20-43de0edd73b6 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-88c65b10-5c1d-498c-838a-323bda632f36 tempest-VolumesTransfersV357Test-147694162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-81497567-aea5-4150-aff6-54b832bb448b {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:18 devstack sudo[96566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-22712370-5615-4367-be20-43de0edd73b6 Jul 08 01:50:18 devstack sudo[96566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:18 devstack sudo[96567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-81497567-aea5-4150-aff6-54b832bb448b Jul 08 01:50:18 devstack sudo[96567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:19 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-e96a4979-047a-4893-870b-a2aae075796f tempest-VolumesSnapshotListTestJSON-611841005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:50:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e96a4979-047a-4893-870b-a2aae075796f tempest-VolumesSnapshotListTestJSON-611841005 None] Flow 'volume_create_manager' (201c8981-654d-482c-9c05-8bb71a7ed0d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:50:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e96a4979-047a-4893-870b-a2aae075796f tempest-VolumesSnapshotListTestJSON-611841005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f83eb71-2ffb-4896-9ca8-13e126872098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e96a4979-047a-4893-870b-a2aae075796f tempest-VolumesSnapshotListTestJSON-611841005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f83eb71-2ffb-4896-9ca8-13e126872098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:50:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1805650690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08fef4a7-dcc8-42c7-8e2e-60a8d44b4022,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29070db7773c4ef5b5f331128af07bc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:50:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:50:19Z,use_quota=True,user_id='e1752b0f931249e1b38217327908ccfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e96a4979-047a-4893-870b-a2aae075796f tempest-VolumesSnapshotListTestJSON-611841005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d7d265e-7ce6-4ff1-b479-ea818f38cc06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e96a4979-047a-4893-870b-a2aae075796f tempest-VolumesSnapshotListTestJSON-611841005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d7d265e-7ce6-4ff1-b479-ea818f38cc06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e96a4979-047a-4893-870b-a2aae075796f tempest-VolumesSnapshotListTestJSON-611841005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (028facaa-1cfa-48d2-bbcd-3704efdeac82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e96a4979-047a-4893-870b-a2aae075796f tempest-VolumesSnapshotListTestJSON-611841005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (028facaa-1cfa-48d2-bbcd-3704efdeac82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08fef4a7-dcc8-42c7-8e2e-60a8d44b4022', 'volume_name': 'volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e96a4979-047a-4893-870b-a2aae075796f tempest-VolumesSnapshotListTestJSON-611841005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba333fc4-e703-447a-bfea-75c40aec22be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e96a4979-047a-4893-870b-a2aae075796f tempest-VolumesSnapshotListTestJSON-611841005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba333fc4-e703-447a-bfea-75c40aec22be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e96a4979-047a-4893-870b-a2aae075796f tempest-VolumesSnapshotListTestJSON-611841005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (939b349b-1cd3-44f8-8ac5-c8439cbded33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:19 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-e96a4979-047a-4893-870b-a2aae075796f tempest-VolumesSnapshotListTestJSON-611841005 None] Volume 08fef4a7-dcc8-42c7-8e2e-60a8d44b4022: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022', 'volume_size': 1} Jul 08 01:50:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e96a4979-047a-4893-870b-a2aae075796f tempest-VolumesSnapshotListTestJSON-611841005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:50:19 devstack sudo[96566]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f4cd624d-6b8d-40b8-b63f-cb5b4d5a87c3 tempest-AttachVolumeNegativeTest-677114920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-22712370-5615-4367-be20-43de0edd73b6" returned: 0 in 0.953s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:19 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-f4cd624d-6b8d-40b8-b63f-cb5b4d5a87c3 tempest-AttachVolumeNegativeTest-677114920 None] Lock "cinder-quobyte-22712370-5615-4367-be20-43de0edd73b6" released by "delete_volume" :: held 2.141s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:50:19 devstack sudo[96567]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-88c65b10-5c1d-498c-838a-323bda632f36 tempest-VolumesTransfersV357Test-147694162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-81497567-aea5-4150-aff6-54b832bb448b" returned: 0 in 0.965s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:19 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-88c65b10-5c1d-498c-838a-323bda632f36 tempest-VolumesTransfersV357Test-147694162 None] <== create_volume: return (2410ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:50:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-88c65b10-5c1d-498c-838a-323bda632f36 tempest-VolumesTransfersV357Test-147694162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.416s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:50:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e96a4979-047a-4893-870b-a2aae075796f tempest-VolumesSnapshotListTestJSON-611841005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.257s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:50:19 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-e96a4979-047a-4893-870b-a2aae075796f tempest-VolumesSnapshotListTestJSON-611841005 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:50:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1805650690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08fef4a7-dcc8-42c7-8e2e-60a8d44b4022,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29070db7773c4ef5b5f331128af07bc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:50:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:50:19Z,use_quota=True,user_id='e1752b0f931249e1b38217327908ccfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:50:19 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-e96a4979-047a-4893-870b-a2aae075796f tempest-VolumesSnapshotListTestJSON-611841005 None] Creating volume 08fef4a7-dcc8-42c7-8e2e-60a8d44b4022 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:50:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e96a4979-047a-4893-870b-a2aae075796f tempest-VolumesSnapshotListTestJSON-611841005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:50:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e96a4979-047a-4893-870b-a2aae075796f tempest-VolumesSnapshotListTestJSON-611841005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:50:19 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-e96a4979-047a-4893-870b-a2aae075796f tempest-VolumesSnapshotListTestJSON-611841005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:50:19 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-e96a4979-047a-4893-870b-a2aae075796f tempest-VolumesSnapshotListTestJSON-611841005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:50:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e96a4979-047a-4893-870b-a2aae075796f tempest-VolumesSnapshotListTestJSON-611841005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:50:19 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-e96a4979-047a-4893-870b-a2aae075796f tempest-VolumesSnapshotListTestJSON-611841005 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:50:19 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-e96a4979-047a-4893-870b-a2aae075796f tempest-VolumesSnapshotListTestJSON-611841005 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:50:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e96a4979-047a-4893-870b-a2aae075796f tempest-VolumesSnapshotListTestJSON-611841005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-88c65b10-5c1d-498c-838a-323bda632f36 tempest-VolumesTransfersV357Test-147694162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da331251-2eae-42f5-8119-1ec043c7f570) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81497567-aea5-4150-aff6-54b832bb448b', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:19 devstack sudo[96572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022 1073741824 Jul 08 01:50:19 devstack sudo[96572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-88c65b10-5c1d-498c-838a-323bda632f36 tempest-VolumesTransfersV357Test-147694162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0948fe6-2ced-45df-861d-8bec06f0ccc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:19 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-88c65b10-5c1d-498c-838a-323bda632f36 tempest-VolumesTransfersV357Test-147694162 None] Volume volume-81497567-aea5-4150-aff6-54b832bb448b (81497567-aea5-4150-aff6-54b832bb448b): created successfully Jul 08 01:50:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-88c65b10-5c1d-498c-838a-323bda632f36 tempest-VolumesTransfersV357Test-147694162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0948fe6-2ced-45df-861d-8bec06f0ccc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-88c65b10-5c1d-498c-838a-323bda632f36 tempest-VolumesTransfersV357Test-147694162 None] Flow 'volume_create_manager' (5a1a9f7d-ba50-457a-b867-a71e6943cd49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:50:19 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-88c65b10-5c1d-498c-838a-323bda632f36 tempest-VolumesTransfersV357Test-147694162 None] Created volume successfully. Jul 08 01:50:19 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-f4cd624d-6b8d-40b8-b63f-cb5b4d5a87c3 tempest-AttachVolumeNegativeTest-677114920 None] Created reservations ['c377df66-a826-4fa1-b78f-b43936042d84', 'b52ba7bf-2c59-412b-84ff-68e9e86f9d76', 'e9c78d5a-db58-4dc0-9826-7af7e0e181a0', '168c2595-0360-4c07-964c-eb74d777a99d'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:50:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-f4cd624d-6b8d-40b8-b63f-cb5b4d5a87c3 tempest-AttachVolumeNegativeTest-677114920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:50:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-f4cd624d-6b8d-40b8-b63f-cb5b4d5a87c3 tempest-AttachVolumeNegativeTest-677114920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:50:20 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-f4cd624d-6b8d-40b8-b63f-cb5b4d5a87c3 tempest-AttachVolumeNegativeTest-677114920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:50:20 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-f4cd624d-6b8d-40b8-b63f-cb5b4d5a87c3 tempest-AttachVolumeNegativeTest-677114920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:50:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-f4cd624d-6b8d-40b8-b63f-cb5b4d5a87c3 tempest-AttachVolumeNegativeTest-677114920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:50:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f4cd624d-6b8d-40b8-b63f-cb5b4d5a87c3 tempest-AttachVolumeNegativeTest-677114920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:20 devstack sudo[96574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:50:20 devstack sudo[96574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:20 devstack cinder-volume[87134]: DEBUG oslo_service.periodic_task [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87134) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:50:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:50:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:50:20 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:50:20 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:50:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:50:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:20 devstack sudo[96580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:50:20 devstack sudo[96580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:21 devstack sudo[96574]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f4cd624d-6b8d-40b8-b63f-cb5b4d5a87c3 tempest-AttachVolumeNegativeTest-677114920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.959s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:21 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-f4cd624d-6b8d-40b8-b63f-cb5b4d5a87c3 tempest-AttachVolumeNegativeTest-677114920 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:50:21 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-f4cd624d-6b8d-40b8-b63f-cb5b4d5a87c3 tempest-AttachVolumeNegativeTest-677114920 None] Deleted volume successfully. Jul 08 01:50:21 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-f4cd624d-6b8d-40b8-b63f-cb5b4d5a87c3 tempest-AttachVolumeNegativeTest-677114920 None] Lock "cinder-22712370-5615-4367-be20-43de0edd73b6-delete_volume" released by "delete_volume" :: held 3.523s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:50:21 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-f582c785-0185-4e75-800c-45fafcc8ec93 tempest-VolumesTransfersV357Test-300790154 None] Acquiring lock "cinder-81497567-aea5-4150-aff6-54b832bb448b-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:50:21 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-f582c785-0185-4e75-800c-45fafcc8ec93 tempest-VolumesTransfersV357Test-300790154 None] Lock "cinder-81497567-aea5-4150-aff6-54b832bb448b-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:50:21 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-f582c785-0185-4e75-800c-45fafcc8ec93 tempest-VolumesTransfersV357Test-300790154 None] Acquiring lock "cinder-quobyte-81497567-aea5-4150-aff6-54b832bb448b" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:50:21 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-f582c785-0185-4e75-800c-45fafcc8ec93 tempest-VolumesTransfersV357Test-300790154 None] Lock "cinder-quobyte-81497567-aea5-4150-aff6-54b832bb448b" acquired by "delete_volume" :: waited 0.025s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:50:21 devstack sudo[96572]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e96a4979-047a-4893-870b-a2aae075796f tempest-VolumesSnapshotListTestJSON-611841005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022 1073741824" returned: 0 in 1.500s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:21 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[0acf518f-adf8-4188-a464-1db38ff37229]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:50:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f582c785-0185-4e75-800c-45fafcc8ec93 tempest-VolumesTransfersV357Test-300790154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-81497567-aea5-4150-aff6-54b832bb448b {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e96a4979-047a-4893-870b-a2aae075796f tempest-VolumesSnapshotListTestJSON-611841005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:21 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-690f33a4-1b8d-4fe1-accc-7aaf45c9f682 tempest-AttachVolumeNegativeTest-677114920 None] Acquiring lock "cinder-817c387c-1811-4c4a-aefe-b56d7d98de48-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:50:21 devstack sudo[96583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022 Jul 08 01:50:21 devstack sudo[96583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:21 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-690f33a4-1b8d-4fe1-accc-7aaf45c9f682 tempest-AttachVolumeNegativeTest-677114920 None] Lock "cinder-817c387c-1811-4c4a-aefe-b56d7d98de48-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:50:21 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-690f33a4-1b8d-4fe1-accc-7aaf45c9f682 tempest-AttachVolumeNegativeTest-677114920 None] Acquiring lock "cinder-quobyte-817c387c-1811-4c4a-aefe-b56d7d98de48" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:50:21 devstack sudo[96582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-81497567-aea5-4150-aff6-54b832bb448b Jul 08 01:50:21 devstack sudo[96582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:21 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-690f33a4-1b8d-4fe1-accc-7aaf45c9f682 tempest-AttachVolumeNegativeTest-677114920 None] Lock "cinder-quobyte-817c387c-1811-4c4a-aefe-b56d7d98de48" acquired by "delete_volume" :: waited 0.032s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:50:21 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[678253b0-1668-470b-8f96-13149ce19e85]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:50:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-690f33a4-1b8d-4fe1-accc-7aaf45c9f682 tempest-AttachVolumeNegativeTest-677114920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-817c387c-1811-4c4a-aefe-b56d7d98de48 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:21 devstack sudo[96586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-817c387c-1811-4c4a-aefe-b56d7d98de48 Jul 08 01:50:21 devstack sudo[96586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:22 devstack sudo[96580]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 1.237s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:22 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:50:22 devstack cinder-volume[87134]: DEBUG oslo_service.periodic_task [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running periodic task VolumeManager._thread_info {{(pid=87134) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:50:22 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] thread count: 28 {{(pid=87134) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:50:22 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] thread info: [<_MainThread(MainThread, started 129378964615296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87134) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:50:22 devstack sudo[96583]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e96a4979-047a-4893-870b-a2aae075796f tempest-VolumesSnapshotListTestJSON-611841005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022" returned: 0 in 0.955s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:22 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-e96a4979-047a-4893-870b-a2aae075796f tempest-VolumesSnapshotListTestJSON-611841005 None] <== create_volume: return (2554ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:50:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e96a4979-047a-4893-870b-a2aae075796f tempest-VolumesSnapshotListTestJSON-611841005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.559s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:50:22 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e96a4979-047a-4893-870b-a2aae075796f tempest-VolumesSnapshotListTestJSON-611841005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (939b349b-1cd3-44f8-8ac5-c8439cbded33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:22 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e96a4979-047a-4893-870b-a2aae075796f tempest-VolumesSnapshotListTestJSON-611841005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47972424-0843-4290-bd36-1cfe40ef484c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:22 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-e96a4979-047a-4893-870b-a2aae075796f tempest-VolumesSnapshotListTestJSON-611841005 None] Volume volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022 (08fef4a7-dcc8-42c7-8e2e-60a8d44b4022): created successfully Jul 08 01:50:22 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e96a4979-047a-4893-870b-a2aae075796f tempest-VolumesSnapshotListTestJSON-611841005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47972424-0843-4290-bd36-1cfe40ef484c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:22 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e96a4979-047a-4893-870b-a2aae075796f tempest-VolumesSnapshotListTestJSON-611841005 None] Flow 'volume_create_manager' (201c8981-654d-482c-9c05-8bb71a7ed0d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:50:22 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-e96a4979-047a-4893-870b-a2aae075796f tempest-VolumesSnapshotListTestJSON-611841005 None] Created volume successfully. Jul 08 01:50:22 devstack sudo[96582]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f582c785-0185-4e75-800c-45fafcc8ec93 tempest-VolumesTransfersV357Test-300790154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-81497567-aea5-4150-aff6-54b832bb448b" returned: 0 in 1.344s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f582c785-0185-4e75-800c-45fafcc8ec93 tempest-VolumesTransfersV357Test-300790154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-81497567-aea5-4150-aff6-54b832bb448b {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:22 devstack sudo[96598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-81497567-aea5-4150-aff6-54b832bb448b Jul 08 01:50:22 devstack sudo[96598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:22 devstack sudo[96586]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-690f33a4-1b8d-4fe1-accc-7aaf45c9f682 tempest-AttachVolumeNegativeTest-677114920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-817c387c-1811-4c4a-aefe-b56d7d98de48" returned: 0 in 1.183s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-690f33a4-1b8d-4fe1-accc-7aaf45c9f682 tempest-AttachVolumeNegativeTest-677114920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-817c387c-1811-4c4a-aefe-b56d7d98de48 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:22 devstack sudo[96600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-817c387c-1811-4c4a-aefe-b56d7d98de48 Jul 08 01:50:22 devstack sudo[96600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:23 devstack sudo[96598]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:23 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f582c785-0185-4e75-800c-45fafcc8ec93 tempest-VolumesTransfersV357Test-300790154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-81497567-aea5-4150-aff6-54b832bb448b" returned: 0 in 1.146s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:23 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-f582c785-0185-4e75-800c-45fafcc8ec93 tempest-VolumesTransfersV357Test-300790154 None] Lock "cinder-quobyte-81497567-aea5-4150-aff6-54b832bb448b" released by "delete_volume" :: held 2.605s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:50:23 devstack cinder-volume[87134]: DEBUG dbcounter [-] [87134] Writing DB stats cinder:DELETE=14,cinder:SELECT=114,cinder:UPDATE=172,cinder:INSERT=42 {{(pid=87134) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:50:23 devstack sudo[96600]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:23 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-690f33a4-1b8d-4fe1-accc-7aaf45c9f682 tempest-AttachVolumeNegativeTest-677114920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-817c387c-1811-4c4a-aefe-b56d7d98de48" returned: 0 in 1.042s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:23 devstack cinder-volume[87134]: DEBUG dbcounter [-] [87134] Writing DB stats cinder:UPDATE=155,cinder:SELECT=129,cinder:DELETE=15,cinder:INSERT=45 {{(pid=87134) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:50:24 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-690f33a4-1b8d-4fe1-accc-7aaf45c9f682 tempest-AttachVolumeNegativeTest-677114920 None] Lock "cinder-quobyte-817c387c-1811-4c4a-aefe-b56d7d98de48" released by "delete_volume" :: held 2.328s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:50:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e4a1684e-f0c2-4419-a24f-c4710331f426 tempest-VolumesSnapshotListTestJSON-611841005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:50:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e4a1684e-f0c2-4419-a24f-c4710331f426 tempest-VolumesSnapshotListTestJSON-611841005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:50:24 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-e4a1684e-f0c2-4419-a24f-c4710331f426 tempest-VolumesSnapshotListTestJSON-611841005 None] Creating offline snapshot bb04b6a9-7e92-46ad-93d3-87ea2f5413be of volume 08fef4a7-dcc8-42c7-8e2e-60a8d44b4022 {{(pid=87134) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:50:24 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-f582c785-0185-4e75-800c-45fafcc8ec93 tempest-VolumesTransfersV357Test-300790154 None] Created reservations ['e4a0efec-54ea-491b-b794-9bd379df7f06', '970d4a95-96e7-451b-8677-cf69f21b3885', '0adad416-78bc-4740-b5e2-0ff6ca4aac3c', 'c5386ef4-8c58-45a6-a6f2-c64fb8d4bcaa'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:50:24 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67a8cb3-611f-4025-aa4c-4b271b5fda28]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:50:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e4a1684e-f0c2-4419-a24f-c4710331f426 tempest-VolumesSnapshotListTestJSON-611841005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:24 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-690f33a4-1b8d-4fe1-accc-7aaf45c9f682 tempest-AttachVolumeNegativeTest-677114920 None] Created reservations ['d73c1f91-9aa2-4730-921d-32edb7e9f4ee', '1d486f6d-01ff-4efc-b9b2-9b50ba062561', '751c2983-cdef-414f-9214-b5e02deee39e', '0b42e766-31b0-437a-b7bf-f23d73098e69'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:50:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-f582c785-0185-4e75-800c-45fafcc8ec93 tempest-VolumesTransfersV357Test-300790154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:50:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-f582c785-0185-4e75-800c-45fafcc8ec93 tempest-VolumesTransfersV357Test-300790154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:50:24 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-f582c785-0185-4e75-800c-45fafcc8ec93 tempest-VolumesTransfersV357Test-300790154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:50:24 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-f582c785-0185-4e75-800c-45fafcc8ec93 tempest-VolumesTransfersV357Test-300790154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:50:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-f582c785-0185-4e75-800c-45fafcc8ec93 tempest-VolumesTransfersV357Test-300790154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:50:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f582c785-0185-4e75-800c-45fafcc8ec93 tempest-VolumesTransfersV357Test-300790154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:24 devstack sudo[96604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022 Jul 08 01:50:24 devstack sudo[96604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:24 devstack sudo[96605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:50:24 devstack sudo[96605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-690f33a4-1b8d-4fe1-accc-7aaf45c9f682 tempest-AttachVolumeNegativeTest-677114920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:50:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-690f33a4-1b8d-4fe1-accc-7aaf45c9f682 tempest-AttachVolumeNegativeTest-677114920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:50:24 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-690f33a4-1b8d-4fe1-accc-7aaf45c9f682 tempest-AttachVolumeNegativeTest-677114920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:50:24 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-690f33a4-1b8d-4fe1-accc-7aaf45c9f682 tempest-AttachVolumeNegativeTest-677114920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:50:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-690f33a4-1b8d-4fe1-accc-7aaf45c9f682 tempest-AttachVolumeNegativeTest-677114920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:50:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-690f33a4-1b8d-4fe1-accc-7aaf45c9f682 tempest-AttachVolumeNegativeTest-677114920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:24 devstack sudo[96608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:50:24 devstack sudo[96608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:25 devstack sudo[96604]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:25 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e4a1684e-f0c2-4419-a24f-c4710331f426 tempest-VolumesSnapshotListTestJSON-611841005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022" returned: 0 in 1.300s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:25 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e4a1684e-f0c2-4419-a24f-c4710331f426 tempest-VolumesSnapshotListTestJSON-611841005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.bb04b6a9-7e92-46ad-93d3-87ea2f5413be 1G {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:25 devstack sudo[96650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.bb04b6a9-7e92-46ad-93d3-87ea2f5413be 1G Jul 08 01:50:25 devstack sudo[96650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:25 devstack sudo[96608]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:25 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-690f33a4-1b8d-4fe1-accc-7aaf45c9f682 tempest-AttachVolumeNegativeTest-677114920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 1.200s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:25 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-690f33a4-1b8d-4fe1-accc-7aaf45c9f682 tempest-AttachVolumeNegativeTest-677114920 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:50:25 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-690f33a4-1b8d-4fe1-accc-7aaf45c9f682 tempest-AttachVolumeNegativeTest-677114920 None] Deleted volume successfully. Jul 08 01:50:25 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-690f33a4-1b8d-4fe1-accc-7aaf45c9f682 tempest-AttachVolumeNegativeTest-677114920 None] Lock "cinder-817c387c-1811-4c4a-aefe-b56d7d98de48-delete_volume" released by "delete_volume" :: held 4.067s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:50:25 devstack sudo[96605]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:25 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f582c785-0185-4e75-800c-45fafcc8ec93 tempest-VolumesTransfersV357Test-300790154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 1.629s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:25 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-f582c785-0185-4e75-800c-45fafcc8ec93 tempest-VolumesTransfersV357Test-300790154 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:50:25 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-f582c785-0185-4e75-800c-45fafcc8ec93 tempest-VolumesTransfersV357Test-300790154 None] Deleted volume successfully. Jul 08 01:50:25 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-f582c785-0185-4e75-800c-45fafcc8ec93 tempest-VolumesTransfersV357Test-300790154 None] Lock "cinder-81497567-aea5-4150-aff6-54b832bb448b-delete_volume" released by "delete_volume" :: held 4.746s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:50:26 devstack sudo[96650]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:26 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e4a1684e-f0c2-4419-a24f-c4710331f426 tempest-VolumesSnapshotListTestJSON-611841005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.bb04b6a9-7e92-46ad-93d3-87ea2f5413be 1G" returned: 0 in 1.376s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:26 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e4a1684e-f0c2-4419-a24f-c4710331f426 tempest-VolumesSnapshotListTestJSON-611841005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.bb04b6a9-7e92-46ad-93d3-87ea2f5413be {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:26 devstack sudo[96659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.bb04b6a9-7e92-46ad-93d3-87ea2f5413be Jul 08 01:50:26 devstack sudo[96659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:27 devstack sudo[96659]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:27 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e4a1684e-f0c2-4419-a24f-c4710331f426 tempest-VolumesSnapshotListTestJSON-611841005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.bb04b6a9-7e92-46ad-93d3-87ea2f5413be" returned: 0 in 0.942s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:27 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-e4a1684e-f0c2-4419-a24f-c4710331f426 tempest-VolumesSnapshotListTestJSON-611841005 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.bb04b6a9-7e92-46ad-93d3-87ea2f5413be is being set with open permissions: ugo+rw Jul 08 01:50:27 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e4a1684e-f0c2-4419-a24f-c4710331f426 tempest-VolumesSnapshotListTestJSON-611841005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.bb04b6a9-7e92-46ad-93d3-87ea2f5413be {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:27 devstack sudo[96664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.bb04b6a9-7e92-46ad-93d3-87ea2f5413be Jul 08 01:50:27 devstack sudo[96664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:28 devstack sudo[96664]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:28 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e4a1684e-f0c2-4419-a24f-c4710331f426 tempest-VolumesSnapshotListTestJSON-611841005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.bb04b6a9-7e92-46ad-93d3-87ea2f5413be" returned: 0 in 0.839s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:28 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e4a1684e-f0c2-4419-a24f-c4710331f426 tempest-VolumesSnapshotListTestJSON-611841005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:28 devstack sudo[96668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.info Jul 08 01:50:28 devstack sudo[96668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:29 devstack sudo[96668]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e4a1684e-f0c2-4419-a24f-c4710331f426 tempest-VolumesSnapshotListTestJSON-611841005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.info" returned: 0 in 0.772s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:29 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-e4a1684e-f0c2-4419-a24f-c4710331f426 tempest-VolumesSnapshotListTestJSON-611841005 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.info is being set with open permissions: ugo+rw Jul 08 01:50:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e4a1684e-f0c2-4419-a24f-c4710331f426 tempest-VolumesSnapshotListTestJSON-611841005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:29 devstack sudo[96671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.info Jul 08 01:50:29 devstack sudo[96671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:30 devstack sudo[96671]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e4a1684e-f0c2-4419-a24f-c4710331f426 tempest-VolumesSnapshotListTestJSON-611841005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.info" returned: 0 in 0.753s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e4a1684e-f0c2-4419-a24f-c4710331f426 tempest-VolumesSnapshotListTestJSON-611841005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.137s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:50:30 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-e4a1684e-f0c2-4419-a24f-c4710331f426 tempest-VolumesSnapshotListTestJSON-611841005 None] Create snapshot completed successfully Jul 08 01:50:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-4cef7926-75b6-40a6-9c11-c036067bd18c tempest-VolumesSnapshotListTestJSON-611841005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:50:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-4cef7926-75b6-40a6-9c11-c036067bd18c tempest-VolumesSnapshotListTestJSON-611841005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:50:30 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-4cef7926-75b6-40a6-9c11-c036067bd18c tempest-VolumesSnapshotListTestJSON-611841005 None] Creating offline snapshot ff7e77c2-829d-4123-a200-a869cc528168 of volume 08fef4a7-dcc8-42c7-8e2e-60a8d44b4022 {{(pid=87134) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:50:30 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bca007a-0b2d-4512-aa33-60419f452d45]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:50:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4cef7926-75b6-40a6-9c11-c036067bd18c tempest-VolumesSnapshotListTestJSON-611841005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.bb04b6a9-7e92-46ad-93d3-87ea2f5413be {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:30 devstack sudo[96680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.bb04b6a9-7e92-46ad-93d3-87ea2f5413be Jul 08 01:50:30 devstack sudo[96680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:31 devstack sudo[96680]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4cef7926-75b6-40a6-9c11-c036067bd18c tempest-VolumesSnapshotListTestJSON-611841005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.bb04b6a9-7e92-46ad-93d3-87ea2f5413be" returned: 0 in 1.087s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:31 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-4cef7926-75b6-40a6-9c11-c036067bd18c tempest-VolumesSnapshotListTestJSON-611841005 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:50:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4cef7926-75b6-40a6-9c11-c036067bd18c tempest-VolumesSnapshotListTestJSON-611841005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.bb04b6a9-7e92-46ad-93d3-87ea2f5413be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.ff7e77c2-829d-4123-a200-a869cc528168 1G {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:31 devstack sudo[96685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.bb04b6a9-7e92-46ad-93d3-87ea2f5413be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.ff7e77c2-829d-4123-a200-a869cc528168 1G Jul 08 01:50:31 devstack sudo[96685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:33 devstack sudo[96685]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4cef7926-75b6-40a6-9c11-c036067bd18c tempest-VolumesSnapshotListTestJSON-611841005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.bb04b6a9-7e92-46ad-93d3-87ea2f5413be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.ff7e77c2-829d-4123-a200-a869cc528168 1G" returned: 0 in 1.359s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4cef7926-75b6-40a6-9c11-c036067bd18c tempest-VolumesSnapshotListTestJSON-611841005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.bb04b6a9-7e92-46ad-93d3-87ea2f5413be -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.ff7e77c2-829d-4123-a200-a869cc528168 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:33 devstack sudo[96692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.bb04b6a9-7e92-46ad-93d3-87ea2f5413be -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.ff7e77c2-829d-4123-a200-a869cc528168 Jul 08 01:50:33 devstack sudo[96692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:34 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-01a11888-efe0-431c-b84a-5cc44752d2e1 tempest-VolumesActionsTest-11317694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:50:34 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-01a11888-efe0-431c-b84a-5cc44752d2e1 tempest-VolumesActionsTest-11317694 None] Flow 'volume_create_manager' (04b3df7d-693b-4c3f-9942-d291712cdf01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:50:34 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-01a11888-efe0-431c-b84a-5cc44752d2e1 tempest-VolumesActionsTest-11317694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12d97aa7-916d-49e8-9a7d-c6648b8f42e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:34 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-01a11888-efe0-431c-b84a-5cc44752d2e1 tempest-VolumesActionsTest-11317694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12d97aa7-916d-49e8-9a7d-c6648b8f42e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:50:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1550072596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05100268-f3f4-4d59-a006-e1cd31dd0392,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='849adbcbfb0148ef9ef52713ab2d611b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:50:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:50:34Z,use_quota=True,user_id='0e98ac8aebf84a3392855dbf2b1e8c22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:34 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-01a11888-efe0-431c-b84a-5cc44752d2e1 tempest-VolumesActionsTest-11317694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b349183-dc6f-40c5-8103-47dc2c643288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:34 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-01a11888-efe0-431c-b84a-5cc44752d2e1 tempest-VolumesActionsTest-11317694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b349183-dc6f-40c5-8103-47dc2c643288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:34 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-01a11888-efe0-431c-b84a-5cc44752d2e1 tempest-VolumesActionsTest-11317694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16c90d12-b649-4562-a49b-837b25e84007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:34 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-01a11888-efe0-431c-b84a-5cc44752d2e1 tempest-VolumesActionsTest-11317694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16c90d12-b649-4562-a49b-837b25e84007) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05100268-f3f4-4d59-a006-e1cd31dd0392', 'volume_name': 'volume-05100268-f3f4-4d59-a006-e1cd31dd0392', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:34 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-01a11888-efe0-431c-b84a-5cc44752d2e1 tempest-VolumesActionsTest-11317694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ca7840a-2786-4f43-9911-831420b07376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:34 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-01a11888-efe0-431c-b84a-5cc44752d2e1 tempest-VolumesActionsTest-11317694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ca7840a-2786-4f43-9911-831420b07376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:34 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-01a11888-efe0-431c-b84a-5cc44752d2e1 tempest-VolumesActionsTest-11317694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2e39045-e59a-4769-84dc-79f0fae51f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:34 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-01a11888-efe0-431c-b84a-5cc44752d2e1 tempest-VolumesActionsTest-11317694 None] Volume 05100268-f3f4-4d59-a006-e1cd31dd0392: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05100268-f3f4-4d59-a006-e1cd31dd0392', 'volume_size': 1} Jul 08 01:50:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-01a11888-efe0-431c-b84a-5cc44752d2e1 tempest-VolumesActionsTest-11317694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:50:34 devstack sudo[96692]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4cef7926-75b6-40a6-9c11-c036067bd18c tempest-VolumesSnapshotListTestJSON-611841005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.bb04b6a9-7e92-46ad-93d3-87ea2f5413be -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.ff7e77c2-829d-4123-a200-a869cc528168" returned: 0 in 1.132s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:34 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-4cef7926-75b6-40a6-9c11-c036067bd18c tempest-VolumesSnapshotListTestJSON-611841005 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.ff7e77c2-829d-4123-a200-a869cc528168 is being set with open permissions: ugo+rw Jul 08 01:50:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4cef7926-75b6-40a6-9c11-c036067bd18c tempest-VolumesSnapshotListTestJSON-611841005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.ff7e77c2-829d-4123-a200-a869cc528168 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:34 devstack sudo[96699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.ff7e77c2-829d-4123-a200-a869cc528168 Jul 08 01:50:34 devstack sudo[96699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:35 devstack sudo[96699]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4cef7926-75b6-40a6-9c11-c036067bd18c tempest-VolumesSnapshotListTestJSON-611841005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.ff7e77c2-829d-4123-a200-a869cc528168" returned: 0 in 0.842s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-4cef7926-75b6-40a6-9c11-c036067bd18c tempest-VolumesSnapshotListTestJSON-611841005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.593s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:50:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-01a11888-efe0-431c-b84a-5cc44752d2e1 tempest-VolumesActionsTest-11317694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.956s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:50:35 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-01a11888-efe0-431c-b84a-5cc44752d2e1 tempest-VolumesActionsTest-11317694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:50:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1550072596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05100268-f3f4-4d59-a006-e1cd31dd0392,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='849adbcbfb0148ef9ef52713ab2d611b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:50:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:50:34Z,use_quota=True,user_id='0e98ac8aebf84a3392855dbf2b1e8c22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:50:35 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-01a11888-efe0-431c-b84a-5cc44752d2e1 tempest-VolumesActionsTest-11317694 None] Creating volume 05100268-f3f4-4d59-a006-e1cd31dd0392 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:50:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-01a11888-efe0-431c-b84a-5cc44752d2e1 tempest-VolumesActionsTest-11317694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:50:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-01a11888-efe0-431c-b84a-5cc44752d2e1 tempest-VolumesActionsTest-11317694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:50:35 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-01a11888-efe0-431c-b84a-5cc44752d2e1 tempest-VolumesActionsTest-11317694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:50:35 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-01a11888-efe0-431c-b84a-5cc44752d2e1 tempest-VolumesActionsTest-11317694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:50:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-01a11888-efe0-431c-b84a-5cc44752d2e1 tempest-VolumesActionsTest-11317694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:50:35 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-01a11888-efe0-431c-b84a-5cc44752d2e1 tempest-VolumesActionsTest-11317694 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:50:35 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-01a11888-efe0-431c-b84a-5cc44752d2e1 tempest-VolumesActionsTest-11317694 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:50:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-01a11888-efe0-431c-b84a-5cc44752d2e1 tempest-VolumesActionsTest-11317694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-05100268-f3f4-4d59-a006-e1cd31dd0392 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:35 devstack sudo[96702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-05100268-f3f4-4d59-a006-e1cd31dd0392 1073741824 Jul 08 01:50:35 devstack sudo[96702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:35 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-4cef7926-75b6-40a6-9c11-c036067bd18c tempest-VolumesSnapshotListTestJSON-611841005 None] Create snapshot completed successfully Jul 08 01:50:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5cdfdade-b54d-43e4-b22d-12261a433d8b tempest-VolumesSnapshotListTestJSON-611841005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:50:36 devstack sudo[96702]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-01a11888-efe0-431c-b84a-5cc44752d2e1 tempest-VolumesActionsTest-11317694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-05100268-f3f4-4d59-a006-e1cd31dd0392 1073741824" returned: 0 in 1.191s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-01a11888-efe0-431c-b84a-5cc44752d2e1 tempest-VolumesActionsTest-11317694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-05100268-f3f4-4d59-a006-e1cd31dd0392 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:36 devstack sudo[96707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-05100268-f3f4-4d59-a006-e1cd31dd0392 Jul 08 01:50:36 devstack sudo[96707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:37 devstack sudo[96707]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-01a11888-efe0-431c-b84a-5cc44752d2e1 tempest-VolumesActionsTest-11317694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-05100268-f3f4-4d59-a006-e1cd31dd0392" returned: 0 in 0.736s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:37 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-01a11888-efe0-431c-b84a-5cc44752d2e1 tempest-VolumesActionsTest-11317694 None] <== create_volume: return (1979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:50:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-01a11888-efe0-431c-b84a-5cc44752d2e1 tempest-VolumesActionsTest-11317694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.987s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:50:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5cdfdade-b54d-43e4-b22d-12261a433d8b tempest-VolumesSnapshotListTestJSON-611841005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.952s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:50:37 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-01a11888-efe0-431c-b84a-5cc44752d2e1 tempest-VolumesActionsTest-11317694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2e39045-e59a-4769-84dc-79f0fae51f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05100268-f3f4-4d59-a006-e1cd31dd0392', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:37 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-01a11888-efe0-431c-b84a-5cc44752d2e1 tempest-VolumesActionsTest-11317694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3010b098-de1e-4f39-a2ef-bd7330e239e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:37 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-5cdfdade-b54d-43e4-b22d-12261a433d8b tempest-VolumesSnapshotListTestJSON-611841005 None] Creating offline snapshot 3c97bd1b-28e7-4537-b7b8-560b79ee17af of volume 08fef4a7-dcc8-42c7-8e2e-60a8d44b4022 {{(pid=87134) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:50:37 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-01a11888-efe0-431c-b84a-5cc44752d2e1 tempest-VolumesActionsTest-11317694 None] Volume volume-05100268-f3f4-4d59-a006-e1cd31dd0392 (05100268-f3f4-4d59-a006-e1cd31dd0392): created successfully Jul 08 01:50:37 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-01a11888-efe0-431c-b84a-5cc44752d2e1 tempest-VolumesActionsTest-11317694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3010b098-de1e-4f39-a2ef-bd7330e239e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:37 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-01a11888-efe0-431c-b84a-5cc44752d2e1 tempest-VolumesActionsTest-11317694 None] Flow 'volume_create_manager' (04b3df7d-693b-4c3f-9942-d291712cdf01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:50:37 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece9ac3d-3ace-43a3-a15e-95a70ebfa05f]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:50:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5cdfdade-b54d-43e4-b22d-12261a433d8b tempest-VolumesSnapshotListTestJSON-611841005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.ff7e77c2-829d-4123-a200-a869cc528168 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:37 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-01a11888-efe0-431c-b84a-5cc44752d2e1 tempest-VolumesActionsTest-11317694 None] Created volume successfully. Jul 08 01:50:37 devstack sudo[96710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.ff7e77c2-829d-4123-a200-a869cc528168 Jul 08 01:50:37 devstack sudo[96710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:38 devstack sudo[96710]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5cdfdade-b54d-43e4-b22d-12261a433d8b tempest-VolumesSnapshotListTestJSON-611841005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.ff7e77c2-829d-4123-a200-a869cc528168" returned: 0 in 0.956s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:38 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-5cdfdade-b54d-43e4-b22d-12261a433d8b tempest-VolumesSnapshotListTestJSON-611841005 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:50:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5cdfdade-b54d-43e4-b22d-12261a433d8b tempest-VolumesSnapshotListTestJSON-611841005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.ff7e77c2-829d-4123-a200-a869cc528168,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.3c97bd1b-28e7-4537-b7b8-560b79ee17af 1G {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:38 devstack sudo[96715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.ff7e77c2-829d-4123-a200-a869cc528168,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.3c97bd1b-28e7-4537-b7b8-560b79ee17af 1G Jul 08 01:50:38 devstack sudo[96715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:39 devstack sudo[96715]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5cdfdade-b54d-43e4-b22d-12261a433d8b tempest-VolumesSnapshotListTestJSON-611841005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.ff7e77c2-829d-4123-a200-a869cc528168,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.3c97bd1b-28e7-4537-b7b8-560b79ee17af 1G" returned: 0 in 1.230s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5cdfdade-b54d-43e4-b22d-12261a433d8b tempest-VolumesSnapshotListTestJSON-611841005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.ff7e77c2-829d-4123-a200-a869cc528168 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.3c97bd1b-28e7-4537-b7b8-560b79ee17af {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:39 devstack sudo[96721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.ff7e77c2-829d-4123-a200-a869cc528168 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.3c97bd1b-28e7-4537-b7b8-560b79ee17af Jul 08 01:50:39 devstack sudo[96721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:39 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [req-5229fa06-1259-42e0-8c41-1706850b97e2 req-1c542e17-d939-43c5-8190-dee792e965ef tempest-VolumesGetTestJSON-1564046994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:50:39 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [req-5229fa06-1259-42e0-8c41-1706850b97e2 req-1c542e17-d939-43c5-8190-dee792e965ef tempest-VolumesGetTestJSON-1564046994 None] Flow 'volume_create_manager' (19781a57-67b1-427f-bf59-34b0a32daefd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:50:39 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [req-5229fa06-1259-42e0-8c41-1706850b97e2 req-1c542e17-d939-43c5-8190-dee792e965ef tempest-VolumesGetTestJSON-1564046994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9df93a5-4991-41a4-a2ba-d6eebf495ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:39 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [req-5229fa06-1259-42e0-8c41-1706850b97e2 req-1c542e17-d939-43c5-8190-dee792e965ef tempest-VolumesGetTestJSON-1564046994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9df93a5-4991-41a4-a2ba-d6eebf495ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:50:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1399119973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e333d4f-e91a-4717-9e53-8b3740a9488d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='51e042c257e34255a7b377497066fc22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:50:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:50:40Z,use_quota=True,user_id='b985f2938e4e48f9801641cc9702c152',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:39 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [req-5229fa06-1259-42e0-8c41-1706850b97e2 req-1c542e17-d939-43c5-8190-dee792e965ef tempest-VolumesGetTestJSON-1564046994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60638e3c-10ca-4f0c-b511-bd6377198847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:39 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [req-5229fa06-1259-42e0-8c41-1706850b97e2 req-1c542e17-d939-43c5-8190-dee792e965ef tempest-VolumesGetTestJSON-1564046994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60638e3c-10ca-4f0c-b511-bd6377198847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:39 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [req-5229fa06-1259-42e0-8c41-1706850b97e2 req-1c542e17-d939-43c5-8190-dee792e965ef tempest-VolumesGetTestJSON-1564046994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (548b8054-3440-4d49-baff-75fe4fdeb5b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:40 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [req-5229fa06-1259-42e0-8c41-1706850b97e2 req-1c542e17-d939-43c5-8190-dee792e965ef tempest-VolumesGetTestJSON-1564046994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (548b8054-3440-4d49-baff-75fe4fdeb5b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e333d4f-e91a-4717-9e53-8b3740a9488d', 'volume_name': 'volume-1e333d4f-e91a-4717-9e53-8b3740a9488d', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:40 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [req-5229fa06-1259-42e0-8c41-1706850b97e2 req-1c542e17-d939-43c5-8190-dee792e965ef tempest-VolumesGetTestJSON-1564046994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd298046-3226-42ae-9fd6-6113be9e07d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:40 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [req-5229fa06-1259-42e0-8c41-1706850b97e2 req-1c542e17-d939-43c5-8190-dee792e965ef tempest-VolumesGetTestJSON-1564046994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd298046-3226-42ae-9fd6-6113be9e07d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:40 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [req-5229fa06-1259-42e0-8c41-1706850b97e2 req-1c542e17-d939-43c5-8190-dee792e965ef tempest-VolumesGetTestJSON-1564046994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8f6c330-1df0-4f4e-bfad-53d272bc01ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:40 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [req-5229fa06-1259-42e0-8c41-1706850b97e2 req-1c542e17-d939-43c5-8190-dee792e965ef tempest-VolumesGetTestJSON-1564046994 None] Volume 1e333d4f-e91a-4717-9e53-8b3740a9488d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e333d4f-e91a-4717-9e53-8b3740a9488d', 'volume_size': 1} Jul 08 01:50:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-5229fa06-1259-42e0-8c41-1706850b97e2 req-1c542e17-d939-43c5-8190-dee792e965ef tempest-VolumesGetTestJSON-1564046994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:50:40 devstack sudo[96721]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5cdfdade-b54d-43e4-b22d-12261a433d8b tempest-VolumesSnapshotListTestJSON-611841005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.ff7e77c2-829d-4123-a200-a869cc528168 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.3c97bd1b-28e7-4537-b7b8-560b79ee17af" returned: 0 in 1.016s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:40 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-5cdfdade-b54d-43e4-b22d-12261a433d8b tempest-VolumesSnapshotListTestJSON-611841005 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.3c97bd1b-28e7-4537-b7b8-560b79ee17af is being set with open permissions: ugo+rw Jul 08 01:50:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5cdfdade-b54d-43e4-b22d-12261a433d8b tempest-VolumesSnapshotListTestJSON-611841005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.3c97bd1b-28e7-4537-b7b8-560b79ee17af {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:40 devstack sudo[96729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.3c97bd1b-28e7-4537-b7b8-560b79ee17af Jul 08 01:50:40 devstack sudo[96729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:41 devstack sudo[96729]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5cdfdade-b54d-43e4-b22d-12261a433d8b tempest-VolumesSnapshotListTestJSON-611841005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.3c97bd1b-28e7-4537-b7b8-560b79ee17af" returned: 0 in 0.896s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5cdfdade-b54d-43e4-b22d-12261a433d8b tempest-VolumesSnapshotListTestJSON-611841005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.296s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:50:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-5229fa06-1259-42e0-8c41-1706850b97e2 req-1c542e17-d939-43c5-8190-dee792e965ef tempest-VolumesGetTestJSON-1564046994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.593s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:50:41 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [req-5229fa06-1259-42e0-8c41-1706850b97e2 req-1c542e17-d939-43c5-8190-dee792e965ef tempest-VolumesGetTestJSON-1564046994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:50:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1399119973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e333d4f-e91a-4717-9e53-8b3740a9488d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='51e042c257e34255a7b377497066fc22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:50:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:50:40Z,use_quota=True,user_id='b985f2938e4e48f9801641cc9702c152',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:50:41 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [req-5229fa06-1259-42e0-8c41-1706850b97e2 req-1c542e17-d939-43c5-8190-dee792e965ef tempest-VolumesGetTestJSON-1564046994 None] Creating volume 1e333d4f-e91a-4717-9e53-8b3740a9488d {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:50:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-5229fa06-1259-42e0-8c41-1706850b97e2 req-1c542e17-d939-43c5-8190-dee792e965ef tempest-VolumesGetTestJSON-1564046994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:50:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-5229fa06-1259-42e0-8c41-1706850b97e2 req-1c542e17-d939-43c5-8190-dee792e965ef tempest-VolumesGetTestJSON-1564046994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:50:41 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [req-5229fa06-1259-42e0-8c41-1706850b97e2 req-1c542e17-d939-43c5-8190-dee792e965ef tempest-VolumesGetTestJSON-1564046994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:50:41 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [req-5229fa06-1259-42e0-8c41-1706850b97e2 req-1c542e17-d939-43c5-8190-dee792e965ef tempest-VolumesGetTestJSON-1564046994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:50:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-5229fa06-1259-42e0-8c41-1706850b97e2 req-1c542e17-d939-43c5-8190-dee792e965ef tempest-VolumesGetTestJSON-1564046994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:50:41 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [req-5229fa06-1259-42e0-8c41-1706850b97e2 req-1c542e17-d939-43c5-8190-dee792e965ef tempest-VolumesGetTestJSON-1564046994 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:50:41 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [req-5229fa06-1259-42e0-8c41-1706850b97e2 req-1c542e17-d939-43c5-8190-dee792e965ef tempest-VolumesGetTestJSON-1564046994 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:50:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-5229fa06-1259-42e0-8c41-1706850b97e2 req-1c542e17-d939-43c5-8190-dee792e965ef tempest-VolumesGetTestJSON-1564046994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1e333d4f-e91a-4717-9e53-8b3740a9488d 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:41 devstack sudo[96732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1e333d4f-e91a-4717-9e53-8b3740a9488d 1073741824 Jul 08 01:50:41 devstack sudo[96732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:41 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-5cdfdade-b54d-43e4-b22d-12261a433d8b tempest-VolumesSnapshotListTestJSON-611841005 None] Create snapshot completed successfully Jul 08 01:50:42 devstack sudo[96732]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-5229fa06-1259-42e0-8c41-1706850b97e2 req-1c542e17-d939-43c5-8190-dee792e965ef tempest-VolumesGetTestJSON-1564046994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1e333d4f-e91a-4717-9e53-8b3740a9488d 1073741824" returned: 0 in 1.112s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-5229fa06-1259-42e0-8c41-1706850b97e2 req-1c542e17-d939-43c5-8190-dee792e965ef tempest-VolumesGetTestJSON-1564046994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1e333d4f-e91a-4717-9e53-8b3740a9488d {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:42 devstack sudo[96739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1e333d4f-e91a-4717-9e53-8b3740a9488d Jul 08 01:50:42 devstack sudo[96739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:43 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-c89e2e28-da99-4121-bc22-88649762700a tempest-VolumesSnapshotListTestJSON-611841005 None] Acquiring lock "cinder-3c97bd1b-28e7-4537-b7b8-560b79ee17af-delete_snapshot" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:50:43 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-c89e2e28-da99-4121-bc22-88649762700a tempest-VolumesSnapshotListTestJSON-611841005 None] Lock "cinder-3c97bd1b-28e7-4537-b7b8-560b79ee17af-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:50:43 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-c89e2e28-da99-4121-bc22-88649762700a tempest-VolumesSnapshotListTestJSON-611841005 None] Acquiring lock "cinder-quobyte-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:50:43 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-c89e2e28-da99-4121-bc22-88649762700a tempest-VolumesSnapshotListTestJSON-611841005 None] Lock "cinder-quobyte-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:50:43 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-c89e2e28-da99-4121-bc22-88649762700a tempest-VolumesSnapshotListTestJSON-611841005 None] Acquiring lock "cinder-quobyte-3c97bd1b-28e7-4537-b7b8-560b79ee17af" by "_delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:50:43 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-c89e2e28-da99-4121-bc22-88649762700a tempest-VolumesSnapshotListTestJSON-611841005 None] Lock "cinder-quobyte-3c97bd1b-28e7-4537-b7b8-560b79ee17af" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:50:43 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-c89e2e28-da99-4121-bc22-88649762700a tempest-VolumesSnapshotListTestJSON-611841005 None] Deleting offline snapshot 3c97bd1b-28e7-4537-b7b8-560b79ee17af of volume 08fef4a7-dcc8-42c7-8e2e-60a8d44b4022 {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:50:43 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-c89e2e28-da99-4121-bc22-88649762700a tempest-VolumesSnapshotListTestJSON-611841005 None] snapshot_file for this snap is: volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.3c97bd1b-28e7-4537-b7b8-560b79ee17af {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:50:43 devstack sudo[96739]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-5229fa06-1259-42e0-8c41-1706850b97e2 req-1c542e17-d939-43c5-8190-dee792e965ef tempest-VolumesGetTestJSON-1564046994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1e333d4f-e91a-4717-9e53-8b3740a9488d" returned: 0 in 0.823s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:43 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [req-5229fa06-1259-42e0-8c41-1706850b97e2 req-1c542e17-d939-43c5-8190-dee792e965ef tempest-VolumesGetTestJSON-1564046994 None] <== create_volume: return (2008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:50:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-5229fa06-1259-42e0-8c41-1706850b97e2 req-1c542e17-d939-43c5-8190-dee792e965ef tempest-VolumesGetTestJSON-1564046994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.011s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:50:43 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6bf3752-60a4-482b-a699-0bb538b4e43a]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:50:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c89e2e28-da99-4121-bc22-88649762700a tempest-VolumesSnapshotListTestJSON-611841005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.3c97bd1b-28e7-4537-b7b8-560b79ee17af {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:43 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [req-5229fa06-1259-42e0-8c41-1706850b97e2 req-1c542e17-d939-43c5-8190-dee792e965ef tempest-VolumesGetTestJSON-1564046994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8f6c330-1df0-4f4e-bfad-53d272bc01ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e333d4f-e91a-4717-9e53-8b3740a9488d', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:43 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [req-5229fa06-1259-42e0-8c41-1706850b97e2 req-1c542e17-d939-43c5-8190-dee792e965ef tempest-VolumesGetTestJSON-1564046994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d56ae2bb-7ebf-4431-87b6-b918d6ee03fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:43 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [req-5229fa06-1259-42e0-8c41-1706850b97e2 req-1c542e17-d939-43c5-8190-dee792e965ef tempest-VolumesGetTestJSON-1564046994 None] Volume volume-1e333d4f-e91a-4717-9e53-8b3740a9488d (1e333d4f-e91a-4717-9e53-8b3740a9488d): created successfully Jul 08 01:50:43 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [req-5229fa06-1259-42e0-8c41-1706850b97e2 req-1c542e17-d939-43c5-8190-dee792e965ef tempest-VolumesGetTestJSON-1564046994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d56ae2bb-7ebf-4431-87b6-b918d6ee03fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:43 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [req-5229fa06-1259-42e0-8c41-1706850b97e2 req-1c542e17-d939-43c5-8190-dee792e965ef tempest-VolumesGetTestJSON-1564046994 None] Flow 'volume_create_manager' (19781a57-67b1-427f-bf59-34b0a32daefd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:50:43 devstack cinder-volume[87134]: INFO cinder.volume.manager [req-5229fa06-1259-42e0-8c41-1706850b97e2 req-1c542e17-d939-43c5-8190-dee792e965ef tempest-VolumesGetTestJSON-1564046994 None] Created volume successfully. Jul 08 01:50:43 devstack sudo[96742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.3c97bd1b-28e7-4537-b7b8-560b79ee17af Jul 08 01:50:43 devstack sudo[96742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:44 devstack sudo[96742]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c89e2e28-da99-4121-bc22-88649762700a tempest-VolumesSnapshotListTestJSON-611841005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.3c97bd1b-28e7-4537-b7b8-560b79ee17af" returned: 0 in 0.995s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:44 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-c89e2e28-da99-4121-bc22-88649762700a tempest-VolumesSnapshotListTestJSON-611841005 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:50:44 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[05bfc92d-c795-471d-a796-7427d3473192]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:50:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c89e2e28-da99-4121-bc22-88649762700a tempest-VolumesSnapshotListTestJSON-611841005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.ff7e77c2-829d-4123-a200-a869cc528168 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:44 devstack sudo[96747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.ff7e77c2-829d-4123-a200-a869cc528168 Jul 08 01:50:44 devstack sudo[96747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:44 devstack cinder-volume[87134]: DEBUG cinder.coordination [req-7679d407-873b-4ce7-9043-856c3c75a176 req-c624a6e7-e1a4-4e8a-8a1c-a3e47e82925e tempest-VolumesGetTestJSON-1564046994 None] Acquiring lock "cinder-1e333d4f-e91a-4717-9e53-8b3740a9488d-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:50:44 devstack cinder-volume[87134]: DEBUG cinder.coordination [req-7679d407-873b-4ce7-9043-856c3c75a176 req-c624a6e7-e1a4-4e8a-8a1c-a3e47e82925e tempest-VolumesGetTestJSON-1564046994 None] Lock "cinder-1e333d4f-e91a-4717-9e53-8b3740a9488d-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:50:44 devstack cinder-volume[87134]: DEBUG cinder.coordination [req-7679d407-873b-4ce7-9043-856c3c75a176 req-c624a6e7-e1a4-4e8a-8a1c-a3e47e82925e tempest-VolumesGetTestJSON-1564046994 None] Acquiring lock "cinder-quobyte-1e333d4f-e91a-4717-9e53-8b3740a9488d" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:50:44 devstack cinder-volume[87134]: DEBUG cinder.coordination [req-7679d407-873b-4ce7-9043-856c3c75a176 req-c624a6e7-e1a4-4e8a-8a1c-a3e47e82925e tempest-VolumesGetTestJSON-1564046994 None] Lock "cinder-quobyte-1e333d4f-e91a-4717-9e53-8b3740a9488d" acquired by "delete_volume" :: waited 0.029s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:50:45 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[610fc9cf-a67d-460a-a213-d247fb45186a]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:50:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-7679d407-873b-4ce7-9043-856c3c75a176 req-c624a6e7-e1a4-4e8a-8a1c-a3e47e82925e tempest-VolumesGetTestJSON-1564046994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1e333d4f-e91a-4717-9e53-8b3740a9488d {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:45 devstack sudo[96749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1e333d4f-e91a-4717-9e53-8b3740a9488d Jul 08 01:50:45 devstack sudo[96749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:45 devstack sudo[96747]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c89e2e28-da99-4121-bc22-88649762700a tempest-VolumesSnapshotListTestJSON-611841005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.ff7e77c2-829d-4123-a200-a869cc528168" returned: 0 in 1.063s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:45 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-c89e2e28-da99-4121-bc22-88649762700a tempest-VolumesSnapshotListTestJSON-611841005 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:50:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c89e2e28-da99-4121-bc22-88649762700a tempest-VolumesSnapshotListTestJSON-611841005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.3c97bd1b-28e7-4537-b7b8-560b79ee17af {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:45 devstack sudo[96754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.3c97bd1b-28e7-4537-b7b8-560b79ee17af Jul 08 01:50:45 devstack sudo[96754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:46 devstack sudo[96749]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-7679d407-873b-4ce7-9043-856c3c75a176 req-c624a6e7-e1a4-4e8a-8a1c-a3e47e82925e tempest-VolumesGetTestJSON-1564046994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1e333d4f-e91a-4717-9e53-8b3740a9488d" returned: 0 in 1.254s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-7679d407-873b-4ce7-9043-856c3c75a176 req-c624a6e7-e1a4-4e8a-8a1c-a3e47e82925e tempest-VolumesGetTestJSON-1564046994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1e333d4f-e91a-4717-9e53-8b3740a9488d {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:46 devstack sudo[96759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1e333d4f-e91a-4717-9e53-8b3740a9488d Jul 08 01:50:46 devstack sudo[96759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:47 devstack sudo[96754]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c89e2e28-da99-4121-bc22-88649762700a tempest-VolumesSnapshotListTestJSON-611841005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.3c97bd1b-28e7-4537-b7b8-560b79ee17af" returned: 0 in 1.430s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c89e2e28-da99-4121-bc22-88649762700a tempest-VolumesSnapshotListTestJSON-611841005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.3c97bd1b-28e7-4537-b7b8-560b79ee17af {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:47 devstack sudo[96766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.3c97bd1b-28e7-4537-b7b8-560b79ee17af Jul 08 01:50:47 devstack sudo[96766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:47 devstack sudo[96759]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-7679d407-873b-4ce7-9043-856c3c75a176 req-c624a6e7-e1a4-4e8a-8a1c-a3e47e82925e tempest-VolumesGetTestJSON-1564046994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1e333d4f-e91a-4717-9e53-8b3740a9488d" returned: 0 in 1.110s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:47 devstack cinder-volume[87134]: DEBUG cinder.coordination [req-7679d407-873b-4ce7-9043-856c3c75a176 req-c624a6e7-e1a4-4e8a-8a1c-a3e47e82925e tempest-VolumesGetTestJSON-1564046994 None] Lock "cinder-quobyte-1e333d4f-e91a-4717-9e53-8b3740a9488d" released by "delete_volume" :: held 2.464s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:50:47 devstack cinder-volume[87134]: DEBUG cinder.quota [req-7679d407-873b-4ce7-9043-856c3c75a176 req-c624a6e7-e1a4-4e8a-8a1c-a3e47e82925e tempest-VolumesGetTestJSON-1564046994 None] Created reservations ['f7895ff1-ae90-4426-8660-1297918b3a29', 'b0418443-51ef-47ca-a218-8385f61c6463', 'bb68b347-5e7b-416a-b90c-59dcd22d0057', '85ae8acd-d127-49e2-a55e-2b7324663cc1'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:50:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-7679d407-873b-4ce7-9043-856c3c75a176 req-c624a6e7-e1a4-4e8a-8a1c-a3e47e82925e tempest-VolumesGetTestJSON-1564046994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:50:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-7679d407-873b-4ce7-9043-856c3c75a176 req-c624a6e7-e1a4-4e8a-8a1c-a3e47e82925e tempest-VolumesGetTestJSON-1564046994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:50:47 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [req-7679d407-873b-4ce7-9043-856c3c75a176 req-c624a6e7-e1a4-4e8a-8a1c-a3e47e82925e tempest-VolumesGetTestJSON-1564046994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:50:47 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [req-7679d407-873b-4ce7-9043-856c3c75a176 req-c624a6e7-e1a4-4e8a-8a1c-a3e47e82925e tempest-VolumesGetTestJSON-1564046994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:50:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-7679d407-873b-4ce7-9043-856c3c75a176 req-c624a6e7-e1a4-4e8a-8a1c-a3e47e82925e tempest-VolumesGetTestJSON-1564046994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:50:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-7679d407-873b-4ce7-9043-856c3c75a176 req-c624a6e7-e1a4-4e8a-8a1c-a3e47e82925e tempest-VolumesGetTestJSON-1564046994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:47 devstack sudo[96776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:50:47 devstack sudo[96776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:48 devstack sudo[96766]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c89e2e28-da99-4121-bc22-88649762700a tempest-VolumesSnapshotListTestJSON-611841005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.3c97bd1b-28e7-4537-b7b8-560b79ee17af" returned: 0 in 1.362s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:48 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-c89e2e28-da99-4121-bc22-88649762700a tempest-VolumesSnapshotListTestJSON-611841005 None] Lock "cinder-quobyte-3c97bd1b-28e7-4537-b7b8-560b79ee17af" released by "_delete_snapshot" :: held 5.057s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:50:48 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-c89e2e28-da99-4121-bc22-88649762700a tempest-VolumesSnapshotListTestJSON-611841005 None] Lock "cinder-quobyte-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022" released by "delete_snapshot" :: held 5.099s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:50:48 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-c89e2e28-da99-4121-bc22-88649762700a tempest-VolumesSnapshotListTestJSON-611841005 None] Created reservations ['ebcd8cdf-c567-4215-aa37-0f2343fec09a', '80c97999-b0c2-4664-be7c-ac8c35f34e92', '039a8987-7b85-4779-8ef6-ff1e3f78d426', '29e120e7-6845-45bd-8ab1-3f48cd1985f6'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:50:48 devstack sudo[96776]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-7679d407-873b-4ce7-9043-856c3c75a176 req-c624a6e7-e1a4-4e8a-8a1c-a3e47e82925e tempest-VolumesGetTestJSON-1564046994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 1.212s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:48 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-c89e2e28-da99-4121-bc22-88649762700a tempest-VolumesSnapshotListTestJSON-611841005 None] Delete snapshot completed successfully. Jul 08 01:50:48 devstack cinder-volume[87134]: DEBUG cinder.manager [req-7679d407-873b-4ce7-9043-856c3c75a176 req-c624a6e7-e1a4-4e8a-8a1c-a3e47e82925e tempest-VolumesGetTestJSON-1564046994 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:50:48 devstack cinder-volume[87134]: INFO cinder.volume.manager [req-7679d407-873b-4ce7-9043-856c3c75a176 req-c624a6e7-e1a4-4e8a-8a1c-a3e47e82925e tempest-VolumesGetTestJSON-1564046994 None] Deleted volume successfully. Jul 08 01:50:48 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-c89e2e28-da99-4121-bc22-88649762700a tempest-VolumesSnapshotListTestJSON-611841005 None] Lock "cinder-3c97bd1b-28e7-4537-b7b8-560b79ee17af-delete_snapshot" released by "delete_snapshot" :: held 5.391s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:50:48 devstack cinder-volume[87134]: DEBUG cinder.coordination [req-7679d407-873b-4ce7-9043-856c3c75a176 req-c624a6e7-e1a4-4e8a-8a1c-a3e47e82925e tempest-VolumesGetTestJSON-1564046994 None] Lock "cinder-1e333d4f-e91a-4717-9e53-8b3740a9488d-delete_volume" released by "delete_volume" :: held 4.027s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:50:49 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7e156bab-2098-4c71-9160-89c15586ede0 tempest-VolumesSnapshotListTestJSON-611841005 None] Acquiring lock "cinder-ff7e77c2-829d-4123-a200-a869cc528168-delete_snapshot" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:50:49 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7e156bab-2098-4c71-9160-89c15586ede0 tempest-VolumesSnapshotListTestJSON-611841005 None] Lock "cinder-ff7e77c2-829d-4123-a200-a869cc528168-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:50:49 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7e156bab-2098-4c71-9160-89c15586ede0 tempest-VolumesSnapshotListTestJSON-611841005 None] Acquiring lock "cinder-quobyte-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:50:49 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7e156bab-2098-4c71-9160-89c15586ede0 tempest-VolumesSnapshotListTestJSON-611841005 None] Lock "cinder-quobyte-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:50:49 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7e156bab-2098-4c71-9160-89c15586ede0 tempest-VolumesSnapshotListTestJSON-611841005 None] Acquiring lock "cinder-quobyte-ff7e77c2-829d-4123-a200-a869cc528168" by "_delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:50:49 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7e156bab-2098-4c71-9160-89c15586ede0 tempest-VolumesSnapshotListTestJSON-611841005 None] Lock "cinder-quobyte-ff7e77c2-829d-4123-a200-a869cc528168" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:50:49 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-7e156bab-2098-4c71-9160-89c15586ede0 tempest-VolumesSnapshotListTestJSON-611841005 None] Deleting offline snapshot ff7e77c2-829d-4123-a200-a869cc528168 of volume 08fef4a7-dcc8-42c7-8e2e-60a8d44b4022 {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:50:49 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-7e156bab-2098-4c71-9160-89c15586ede0 tempest-VolumesSnapshotListTestJSON-611841005 None] snapshot_file for this snap is: volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.ff7e77c2-829d-4123-a200-a869cc528168 {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:50:49 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3a3266-fef4-46b6-b5c8-3781ed2318a0]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:50:49 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7e156bab-2098-4c71-9160-89c15586ede0 tempest-VolumesSnapshotListTestJSON-611841005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.ff7e77c2-829d-4123-a200-a869cc528168 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:49 devstack sudo[96790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.ff7e77c2-829d-4123-a200-a869cc528168 Jul 08 01:50:49 devstack sudo[96790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:50 devstack sudo[96790]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:50 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7e156bab-2098-4c71-9160-89c15586ede0 tempest-VolumesSnapshotListTestJSON-611841005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.ff7e77c2-829d-4123-a200-a869cc528168" returned: 0 in 1.092s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:50 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-7e156bab-2098-4c71-9160-89c15586ede0 tempest-VolumesSnapshotListTestJSON-611841005 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:50:50 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b768757-1a6e-4825-a140-4f371de1b01f]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:50:50 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7e156bab-2098-4c71-9160-89c15586ede0 tempest-VolumesSnapshotListTestJSON-611841005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.bb04b6a9-7e92-46ad-93d3-87ea2f5413be {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:50 devstack sudo[96796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.bb04b6a9-7e92-46ad-93d3-87ea2f5413be Jul 08 01:50:50 devstack sudo[96796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:51 devstack sudo[96796]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7e156bab-2098-4c71-9160-89c15586ede0 tempest-VolumesSnapshotListTestJSON-611841005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.bb04b6a9-7e92-46ad-93d3-87ea2f5413be" returned: 0 in 1.029s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:51 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-7e156bab-2098-4c71-9160-89c15586ede0 tempest-VolumesSnapshotListTestJSON-611841005 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:50:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7e156bab-2098-4c71-9160-89c15586ede0 tempest-VolumesSnapshotListTestJSON-611841005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.ff7e77c2-829d-4123-a200-a869cc528168 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:51 devstack sudo[96802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.ff7e77c2-829d-4123-a200-a869cc528168 Jul 08 01:50:51 devstack sudo[96802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:52 devstack sudo[96802]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:52 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7e156bab-2098-4c71-9160-89c15586ede0 tempest-VolumesSnapshotListTestJSON-611841005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.ff7e77c2-829d-4123-a200-a869cc528168" returned: 0 in 1.428s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:52 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7e156bab-2098-4c71-9160-89c15586ede0 tempest-VolumesSnapshotListTestJSON-611841005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.ff7e77c2-829d-4123-a200-a869cc528168 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:52 devstack sudo[96808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.ff7e77c2-829d-4123-a200-a869cc528168 Jul 08 01:50:52 devstack sudo[96808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:53 devstack sudo[96808]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7e156bab-2098-4c71-9160-89c15586ede0 tempest-VolumesSnapshotListTestJSON-611841005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.ff7e77c2-829d-4123-a200-a869cc528168" returned: 0 in 0.824s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:53 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7e156bab-2098-4c71-9160-89c15586ede0 tempest-VolumesSnapshotListTestJSON-611841005 None] Lock "cinder-quobyte-ff7e77c2-829d-4123-a200-a869cc528168" released by "_delete_snapshot" :: held 4.533s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:50:53 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7e156bab-2098-4c71-9160-89c15586ede0 tempest-VolumesSnapshotListTestJSON-611841005 None] Lock "cinder-quobyte-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022" released by "delete_snapshot" :: held 4.564s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:50:53 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-7e156bab-2098-4c71-9160-89c15586ede0 tempest-VolumesSnapshotListTestJSON-611841005 None] Created reservations ['719ffd80-ca5b-42af-bc9c-67f69b07e866', '348a06d2-4afd-447e-b1db-78cc95cd836d', 'c356bae7-d2da-4e32-ba15-468631b462de', '2fffa461-3bd0-41c4-ad35-3a3d6d66a446'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:50:53 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-7e156bab-2098-4c71-9160-89c15586ede0 tempest-VolumesSnapshotListTestJSON-611841005 None] Delete snapshot completed successfully. Jul 08 01:50:53 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7e156bab-2098-4c71-9160-89c15586ede0 tempest-VolumesSnapshotListTestJSON-611841005 None] Lock "cinder-ff7e77c2-829d-4123-a200-a869cc528168-delete_snapshot" released by "delete_snapshot" :: held 4.800s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:50:54 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c9a6020-ecad-4ebe-9fcd-3afcc88e40c2 tempest-VolumesTestJSON-184146727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:50:54 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8c9a6020-ecad-4ebe-9fcd-3afcc88e40c2 tempest-VolumesTestJSON-184146727 None] Flow 'volume_create_manager' (0965c526-b514-46dd-9fd7-d5b004768f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:50:54 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8c9a6020-ecad-4ebe-9fcd-3afcc88e40c2 tempest-VolumesTestJSON-184146727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65e80017-bc33-446d-8f08-08abc7c1c750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:54 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8c9a6020-ecad-4ebe-9fcd-3afcc88e40c2 tempest-VolumesTestJSON-184146727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65e80017-bc33-446d-8f08-08abc7c1c750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:50:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1692651600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d43728d1-9c7c-432d-9d8a-267beea6fee8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='caf41379047b45f9b3fbf5b4d2e3e564',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:50:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:50:54Z,use_quota=True,user_id='cb20daf32a9542588c942273cc1b1d67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:54 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8c9a6020-ecad-4ebe-9fcd-3afcc88e40c2 tempest-VolumesTestJSON-184146727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c9a6dc7-9604-475c-8da0-4d81d002b3f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:54 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8c9a6020-ecad-4ebe-9fcd-3afcc88e40c2 tempest-VolumesTestJSON-184146727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c9a6dc7-9604-475c-8da0-4d81d002b3f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:54 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8c9a6020-ecad-4ebe-9fcd-3afcc88e40c2 tempest-VolumesTestJSON-184146727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7766947d-6694-4bea-83d0-b561ba191d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:54 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8c9a6020-ecad-4ebe-9fcd-3afcc88e40c2 tempest-VolumesTestJSON-184146727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7766947d-6694-4bea-83d0-b561ba191d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd43728d1-9c7c-432d-9d8a-267beea6fee8', 'volume_name': 'volume-d43728d1-9c7c-432d-9d8a-267beea6fee8', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:54 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8c9a6020-ecad-4ebe-9fcd-3afcc88e40c2 tempest-VolumesTestJSON-184146727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26cb08c2-e71d-437b-8beb-88de036c5b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:54 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8c9a6020-ecad-4ebe-9fcd-3afcc88e40c2 tempest-VolumesTestJSON-184146727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26cb08c2-e71d-437b-8beb-88de036c5b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:54 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8c9a6020-ecad-4ebe-9fcd-3afcc88e40c2 tempest-VolumesTestJSON-184146727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (488f1f1d-d2c7-4789-b629-9108c6cbac03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:54 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-8c9a6020-ecad-4ebe-9fcd-3afcc88e40c2 tempest-VolumesTestJSON-184146727 None] Volume d43728d1-9c7c-432d-9d8a-267beea6fee8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d43728d1-9c7c-432d-9d8a-267beea6fee8', 'volume_size': 1} Jul 08 01:50:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-8c9a6020-ecad-4ebe-9fcd-3afcc88e40c2 tempest-VolumesTestJSON-184146727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:50:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-8c9a6020-ecad-4ebe-9fcd-3afcc88e40c2 tempest-VolumesTestJSON-184146727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:50:54 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-8c9a6020-ecad-4ebe-9fcd-3afcc88e40c2 tempest-VolumesTestJSON-184146727 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:50:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1692651600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d43728d1-9c7c-432d-9d8a-267beea6fee8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='caf41379047b45f9b3fbf5b4d2e3e564',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:50:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:50:54Z,use_quota=True,user_id='cb20daf32a9542588c942273cc1b1d67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:50:54 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-8c9a6020-ecad-4ebe-9fcd-3afcc88e40c2 tempest-VolumesTestJSON-184146727 None] Creating volume d43728d1-9c7c-432d-9d8a-267beea6fee8 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:50:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-8c9a6020-ecad-4ebe-9fcd-3afcc88e40c2 tempest-VolumesTestJSON-184146727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:50:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-8c9a6020-ecad-4ebe-9fcd-3afcc88e40c2 tempest-VolumesTestJSON-184146727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:50:54 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-8c9a6020-ecad-4ebe-9fcd-3afcc88e40c2 tempest-VolumesTestJSON-184146727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:50:54 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-8c9a6020-ecad-4ebe-9fcd-3afcc88e40c2 tempest-VolumesTestJSON-184146727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:50:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-8c9a6020-ecad-4ebe-9fcd-3afcc88e40c2 tempest-VolumesTestJSON-184146727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:50:54 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-8c9a6020-ecad-4ebe-9fcd-3afcc88e40c2 tempest-VolumesTestJSON-184146727 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:50:54 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-8c9a6020-ecad-4ebe-9fcd-3afcc88e40c2 tempest-VolumesTestJSON-184146727 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:50:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8c9a6020-ecad-4ebe-9fcd-3afcc88e40c2 tempest-VolumesTestJSON-184146727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d43728d1-9c7c-432d-9d8a-267beea6fee8 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:54 devstack sudo[96842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d43728d1-9c7c-432d-9d8a-267beea6fee8 1073741824 Jul 08 01:50:54 devstack sudo[96842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:54 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-8478cf81-192d-4906-bae8-31004b623569 tempest-VolumesSnapshotListTestJSON-611841005 None] Acquiring lock "cinder-bb04b6a9-7e92-46ad-93d3-87ea2f5413be-delete_snapshot" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:50:54 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-8478cf81-192d-4906-bae8-31004b623569 tempest-VolumesSnapshotListTestJSON-611841005 None] Lock "cinder-bb04b6a9-7e92-46ad-93d3-87ea2f5413be-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:50:54 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-8478cf81-192d-4906-bae8-31004b623569 tempest-VolumesSnapshotListTestJSON-611841005 None] Acquiring lock "cinder-quobyte-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:50:54 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-8478cf81-192d-4906-bae8-31004b623569 tempest-VolumesSnapshotListTestJSON-611841005 None] Lock "cinder-quobyte-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:50:54 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-8478cf81-192d-4906-bae8-31004b623569 tempest-VolumesSnapshotListTestJSON-611841005 None] Acquiring lock "cinder-quobyte-bb04b6a9-7e92-46ad-93d3-87ea2f5413be" by "_delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:50:54 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-8478cf81-192d-4906-bae8-31004b623569 tempest-VolumesSnapshotListTestJSON-611841005 None] Lock "cinder-quobyte-bb04b6a9-7e92-46ad-93d3-87ea2f5413be" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:50:54 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-8478cf81-192d-4906-bae8-31004b623569 tempest-VolumesSnapshotListTestJSON-611841005 None] Deleting offline snapshot bb04b6a9-7e92-46ad-93d3-87ea2f5413be of volume 08fef4a7-dcc8-42c7-8e2e-60a8d44b4022 {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:50:54 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-8478cf81-192d-4906-bae8-31004b623569 tempest-VolumesSnapshotListTestJSON-611841005 None] snapshot_file for this snap is: volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.bb04b6a9-7e92-46ad-93d3-87ea2f5413be {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:50:54 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[d39f7175-38b3-409d-9419-af56a72b8fba]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:50:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8478cf81-192d-4906-bae8-31004b623569 tempest-VolumesSnapshotListTestJSON-611841005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.bb04b6a9-7e92-46ad-93d3-87ea2f5413be {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:54 devstack sudo[96856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.bb04b6a9-7e92-46ad-93d3-87ea2f5413be Jul 08 01:50:54 devstack sudo[96856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:55 devstack sudo[96842]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:55 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8c9a6020-ecad-4ebe-9fcd-3afcc88e40c2 tempest-VolumesTestJSON-184146727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d43728d1-9c7c-432d-9d8a-267beea6fee8 1073741824" returned: 0 in 1.390s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:55 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8c9a6020-ecad-4ebe-9fcd-3afcc88e40c2 tempest-VolumesTestJSON-184146727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d43728d1-9c7c-432d-9d8a-267beea6fee8 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:55 devstack sudo[96879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d43728d1-9c7c-432d-9d8a-267beea6fee8 Jul 08 01:50:55 devstack sudo[96879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:55 devstack sudo[96856]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:55 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8478cf81-192d-4906-bae8-31004b623569 tempest-VolumesSnapshotListTestJSON-611841005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.bb04b6a9-7e92-46ad-93d3-87ea2f5413be" returned: 0 in 1.163s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:55 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-8478cf81-192d-4906-bae8-31004b623569 tempest-VolumesSnapshotListTestJSON-611841005 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:50:55 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a722fb-6bbd-430c-b9f0-75e72cf4205d]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:50:55 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8478cf81-192d-4906-bae8-31004b623569 tempest-VolumesSnapshotListTestJSON-611841005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:56 devstack sudo[96891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022 Jul 08 01:50:56 devstack sudo[96891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:56 devstack sudo[96879]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:56 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8c9a6020-ecad-4ebe-9fcd-3afcc88e40c2 tempest-VolumesTestJSON-184146727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d43728d1-9c7c-432d-9d8a-267beea6fee8" returned: 0 in 0.920s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:56 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-8c9a6020-ecad-4ebe-9fcd-3afcc88e40c2 tempest-VolumesTestJSON-184146727 None] <== create_volume: return (2369ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:50:56 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-8c9a6020-ecad-4ebe-9fcd-3afcc88e40c2 tempest-VolumesTestJSON-184146727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.372s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:50:56 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8c9a6020-ecad-4ebe-9fcd-3afcc88e40c2 tempest-VolumesTestJSON-184146727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (488f1f1d-d2c7-4789-b629-9108c6cbac03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d43728d1-9c7c-432d-9d8a-267beea6fee8', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:56 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8c9a6020-ecad-4ebe-9fcd-3afcc88e40c2 tempest-VolumesTestJSON-184146727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a52cce1f-8a19-4415-a640-bca1ce14cc7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:56 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-8c9a6020-ecad-4ebe-9fcd-3afcc88e40c2 tempest-VolumesTestJSON-184146727 None] Volume volume-d43728d1-9c7c-432d-9d8a-267beea6fee8 (d43728d1-9c7c-432d-9d8a-267beea6fee8): created successfully Jul 08 01:50:56 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8c9a6020-ecad-4ebe-9fcd-3afcc88e40c2 tempest-VolumesTestJSON-184146727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a52cce1f-8a19-4415-a640-bca1ce14cc7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:56 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8c9a6020-ecad-4ebe-9fcd-3afcc88e40c2 tempest-VolumesTestJSON-184146727 None] Flow 'volume_create_manager' (0965c526-b514-46dd-9fd7-d5b004768f74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:50:56 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-8c9a6020-ecad-4ebe-9fcd-3afcc88e40c2 tempest-VolumesTestJSON-184146727 None] Created volume successfully. Jul 08 01:50:57 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-d26a508e-9e32-4e17-990a-187773657dfb tempest-VolumesSnapshotTestJSON-1781941103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:50:57 devstack sudo[96891]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:57 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-d26a508e-9e32-4e17-990a-187773657dfb tempest-VolumesSnapshotTestJSON-1781941103 None] Flow 'volume_create_manager' (2a75ab4c-5474-420a-916a-86e42cc464e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:50:57 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-d26a508e-9e32-4e17-990a-187773657dfb tempest-VolumesSnapshotTestJSON-1781941103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96b98c6b-6d0c-4d67-9737-40bb79fa4872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:57 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8478cf81-192d-4906-bae8-31004b623569 tempest-VolumesSnapshotListTestJSON-611841005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022" returned: 0 in 1.280s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:57 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8478cf81-192d-4906-bae8-31004b623569 tempest-VolumesSnapshotListTestJSON-611841005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.bb04b6a9-7e92-46ad-93d3-87ea2f5413be {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:57 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-d26a508e-9e32-4e17-990a-187773657dfb tempest-VolumesSnapshotTestJSON-1781941103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96b98c6b-6d0c-4d67-9737-40bb79fa4872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:50:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2056349074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47b93fcb-0cb5-454a-abc0-98c177f4f1ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d35d25a53f04475397d55628d5c33338',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:50:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:50:57Z,use_quota=True,user_id='a8c972c3a0194d0399a1068466ad9ba0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:57 devstack sudo[96900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.bb04b6a9-7e92-46ad-93d3-87ea2f5413be Jul 08 01:50:57 devstack sudo[96900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:57 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-d26a508e-9e32-4e17-990a-187773657dfb tempest-VolumesSnapshotTestJSON-1781941103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc67b703-7a08-4020-8665-2f80da59f397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:57 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-d26a508e-9e32-4e17-990a-187773657dfb tempest-VolumesSnapshotTestJSON-1781941103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc67b703-7a08-4020-8665-2f80da59f397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:57 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-d26a508e-9e32-4e17-990a-187773657dfb tempest-VolumesSnapshotTestJSON-1781941103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca4a05f2-bccc-4aa5-9ed2-efc2b9ebac25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:57 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-d26a508e-9e32-4e17-990a-187773657dfb tempest-VolumesSnapshotTestJSON-1781941103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca4a05f2-bccc-4aa5-9ed2-efc2b9ebac25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47b93fcb-0cb5-454a-abc0-98c177f4f1ef', 'volume_name': 'volume-47b93fcb-0cb5-454a-abc0-98c177f4f1ef', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:57 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-d26a508e-9e32-4e17-990a-187773657dfb tempest-VolumesSnapshotTestJSON-1781941103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6a0d18f-5df7-4efe-bf3b-e268dc47b961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:57 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-d26a508e-9e32-4e17-990a-187773657dfb tempest-VolumesSnapshotTestJSON-1781941103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6a0d18f-5df7-4efe-bf3b-e268dc47b961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:57 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-d26a508e-9e32-4e17-990a-187773657dfb tempest-VolumesSnapshotTestJSON-1781941103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e173a06-784a-4ee9-afba-15d95d385e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:57 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-d26a508e-9e32-4e17-990a-187773657dfb tempest-VolumesSnapshotTestJSON-1781941103 None] Volume 47b93fcb-0cb5-454a-abc0-98c177f4f1ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47b93fcb-0cb5-454a-abc0-98c177f4f1ef', 'volume_size': 1} Jul 08 01:50:57 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-d26a508e-9e32-4e17-990a-187773657dfb tempest-VolumesSnapshotTestJSON-1781941103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:50:57 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-d26a508e-9e32-4e17-990a-187773657dfb tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:50:57 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-d26a508e-9e32-4e17-990a-187773657dfb tempest-VolumesSnapshotTestJSON-1781941103 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:50:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2056349074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47b93fcb-0cb5-454a-abc0-98c177f4f1ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d35d25a53f04475397d55628d5c33338',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:50:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:50:57Z,use_quota=True,user_id='a8c972c3a0194d0399a1068466ad9ba0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:50:57 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-d26a508e-9e32-4e17-990a-187773657dfb tempest-VolumesSnapshotTestJSON-1781941103 None] Creating volume 47b93fcb-0cb5-454a-abc0-98c177f4f1ef {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:50:57 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-d26a508e-9e32-4e17-990a-187773657dfb tempest-VolumesSnapshotTestJSON-1781941103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:50:57 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-d26a508e-9e32-4e17-990a-187773657dfb tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:50:57 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-d26a508e-9e32-4e17-990a-187773657dfb tempest-VolumesSnapshotTestJSON-1781941103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:50:57 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-d26a508e-9e32-4e17-990a-187773657dfb tempest-VolumesSnapshotTestJSON-1781941103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:50:57 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-d26a508e-9e32-4e17-990a-187773657dfb tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:50:57 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-d26a508e-9e32-4e17-990a-187773657dfb tempest-VolumesSnapshotTestJSON-1781941103 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:50:57 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-d26a508e-9e32-4e17-990a-187773657dfb tempest-VolumesSnapshotTestJSON-1781941103 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:50:57 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d26a508e-9e32-4e17-990a-187773657dfb tempest-VolumesSnapshotTestJSON-1781941103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-47b93fcb-0cb5-454a-abc0-98c177f4f1ef 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:57 devstack sudo[96902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-47b93fcb-0cb5-454a-abc0-98c177f4f1ef 1073741824 Jul 08 01:50:57 devstack sudo[96902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:58 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-608c6143-d484-41a1-975c-49c5a26b563f tempest-VolumesTestJSON-184146727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:50:58 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-608c6143-d484-41a1-975c-49c5a26b563f tempest-VolumesTestJSON-184146727 None] Flow 'volume_create_manager' (0bce40fc-1490-4042-85cc-a136c1559881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:50:58 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-608c6143-d484-41a1-975c-49c5a26b563f tempest-VolumesTestJSON-184146727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b83e6b0b-3c24-4e1c-af25-7192212bb410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:58 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-608c6143-d484-41a1-975c-49c5a26b563f tempest-VolumesTestJSON-184146727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b83e6b0b-3c24-4e1c-af25-7192212bb410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:50:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1772127182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3f24f1c-f200-41a1-ab55-4d17466e4dcc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='caf41379047b45f9b3fbf5b4d2e3e564',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:50:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:50:58Z,use_quota=True,user_id='cb20daf32a9542588c942273cc1b1d67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:58 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-608c6143-d484-41a1-975c-49c5a26b563f tempest-VolumesTestJSON-184146727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddcbf4a3-92f2-4fc0-b5f6-a437c039c94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:58 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-608c6143-d484-41a1-975c-49c5a26b563f tempest-VolumesTestJSON-184146727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddcbf4a3-92f2-4fc0-b5f6-a437c039c94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:58 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-608c6143-d484-41a1-975c-49c5a26b563f tempest-VolumesTestJSON-184146727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab8872a4-cbde-4840-8f0d-b50a37aa072b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:58 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-608c6143-d484-41a1-975c-49c5a26b563f tempest-VolumesTestJSON-184146727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab8872a4-cbde-4840-8f0d-b50a37aa072b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3f24f1c-f200-41a1-ab55-4d17466e4dcc', 'volume_name': 'volume-d3f24f1c-f200-41a1-ab55-4d17466e4dcc', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:58 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-608c6143-d484-41a1-975c-49c5a26b563f tempest-VolumesTestJSON-184146727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d660aa7-e1a1-419d-8e20-b75760d9f212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:58 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-608c6143-d484-41a1-975c-49c5a26b563f tempest-VolumesTestJSON-184146727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d660aa7-e1a1-419d-8e20-b75760d9f212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:58 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-608c6143-d484-41a1-975c-49c5a26b563f tempest-VolumesTestJSON-184146727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d33a82b7-3337-4a14-88b8-c846cd7b374d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:58 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-608c6143-d484-41a1-975c-49c5a26b563f tempest-VolumesTestJSON-184146727 None] Volume d3f24f1c-f200-41a1-ab55-4d17466e4dcc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3f24f1c-f200-41a1-ab55-4d17466e4dcc', 'volume_size': 1} Jul 08 01:50:58 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-608c6143-d484-41a1-975c-49c5a26b563f tempest-VolumesTestJSON-184146727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:50:58 devstack sudo[96900]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:58 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8478cf81-192d-4906-bae8-31004b623569 tempest-VolumesSnapshotListTestJSON-611841005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.bb04b6a9-7e92-46ad-93d3-87ea2f5413be" returned: 0 in 1.382s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:58 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8478cf81-192d-4906-bae8-31004b623569 tempest-VolumesSnapshotListTestJSON-611841005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.bb04b6a9-7e92-46ad-93d3-87ea2f5413be {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:58 devstack sudo[96911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.bb04b6a9-7e92-46ad-93d3-87ea2f5413be Jul 08 01:50:58 devstack sudo[96911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:58 devstack sudo[96902]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:58 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d26a508e-9e32-4e17-990a-187773657dfb tempest-VolumesSnapshotTestJSON-1781941103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-47b93fcb-0cb5-454a-abc0-98c177f4f1ef 1073741824" returned: 0 in 1.365s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:58 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d26a508e-9e32-4e17-990a-187773657dfb tempest-VolumesSnapshotTestJSON-1781941103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-47b93fcb-0cb5-454a-abc0-98c177f4f1ef {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:58 devstack sudo[96913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-47b93fcb-0cb5-454a-abc0-98c177f4f1ef Jul 08 01:50:58 devstack sudo[96913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:59 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-484f9e5b-25fc-45db-b8e2-d5047b286895 tempest-VolumesActionsTest-11317694 None] Acquiring lock "cinder-05100268-f3f4-4d59-a006-e1cd31dd0392" by "attach_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:50:59 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-484f9e5b-25fc-45db-b8e2-d5047b286895 tempest-VolumesActionsTest-11317694 None] Lock "cinder-05100268-f3f4-4d59-a006-e1cd31dd0392" acquired by "attach_volume" :: waited 0.033s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:50:59 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-484f9e5b-25fc-45db-b8e2-d5047b286895 tempest-VolumesActionsTest-11317694 None] Attaching volume 05100268-f3f4-4d59-a006-e1cd31dd0392 to instance b24e24f7-6c77-4937-ab22-a30d085e0549 at mountpoint /dev/vdb on host None. Jul 08 01:50:59 devstack sudo[96911]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8478cf81-192d-4906-bae8-31004b623569 tempest-VolumesSnapshotListTestJSON-611841005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022.bb04b6a9-7e92-46ad-93d3-87ea2f5413be" returned: 0 in 0.866s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:59 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-484f9e5b-25fc-45db-b8e2-d5047b286895 tempest-VolumesActionsTest-11317694 None] Attach volume completed successfully. Jul 08 01:50:59 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-484f9e5b-25fc-45db-b8e2-d5047b286895 tempest-VolumesActionsTest-11317694 None] Lock "cinder-05100268-f3f4-4d59-a006-e1cd31dd0392" released by "attach_volume" :: held 0.219s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:50:59 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-8478cf81-192d-4906-bae8-31004b623569 tempest-VolumesSnapshotListTestJSON-611841005 None] Lock "cinder-quobyte-bb04b6a9-7e92-46ad-93d3-87ea2f5413be" released by "_delete_snapshot" :: held 4.913s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:50:59 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-8478cf81-192d-4906-bae8-31004b623569 tempest-VolumesSnapshotListTestJSON-611841005 None] Lock "cinder-quobyte-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022" released by "delete_snapshot" :: held 4.956s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:50:59 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-8478cf81-192d-4906-bae8-31004b623569 tempest-VolumesSnapshotListTestJSON-611841005 None] Created reservations ['e73939a7-9d54-42f8-8c50-e613c77e13e4', '1bb08eb1-d2d7-4feb-a585-cc8fcea6f429', '32be5d1b-b815-446e-bbbd-ce9ecb371133', '1ad28a35-1fc2-41d7-9ab0-304fe116c1fb'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:50:59 devstack sudo[96913]: pam_unix(sudo:session): session closed for user root Jul 08 01:50:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d26a508e-9e32-4e17-990a-187773657dfb tempest-VolumesSnapshotTestJSON-1781941103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-47b93fcb-0cb5-454a-abc0-98c177f4f1ef" returned: 0 in 0.923s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:50:59 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-d26a508e-9e32-4e17-990a-187773657dfb tempest-VolumesSnapshotTestJSON-1781941103 None] <== create_volume: return (2350ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:50:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-d26a508e-9e32-4e17-990a-187773657dfb tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.352s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:50:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-608c6143-d484-41a1-975c-49c5a26b563f tempest-VolumesTestJSON-184146727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.096s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:50:59 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-608c6143-d484-41a1-975c-49c5a26b563f tempest-VolumesTestJSON-184146727 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:50:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1772127182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3f24f1c-f200-41a1-ab55-4d17466e4dcc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='caf41379047b45f9b3fbf5b4d2e3e564',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:50:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:50:58Z,use_quota=True,user_id='cb20daf32a9542588c942273cc1b1d67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:50:59 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-608c6143-d484-41a1-975c-49c5a26b563f tempest-VolumesTestJSON-184146727 None] Creating volume d3f24f1c-f200-41a1-ab55-4d17466e4dcc {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:50:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-608c6143-d484-41a1-975c-49c5a26b563f tempest-VolumesTestJSON-184146727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:50:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-608c6143-d484-41a1-975c-49c5a26b563f tempest-VolumesTestJSON-184146727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:50:59 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-608c6143-d484-41a1-975c-49c5a26b563f tempest-VolumesTestJSON-184146727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:50:59 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-608c6143-d484-41a1-975c-49c5a26b563f tempest-VolumesTestJSON-184146727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:50:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-608c6143-d484-41a1-975c-49c5a26b563f tempest-VolumesTestJSON-184146727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:50:59 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-608c6143-d484-41a1-975c-49c5a26b563f tempest-VolumesTestJSON-184146727 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:50:59 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-608c6143-d484-41a1-975c-49c5a26b563f tempest-VolumesTestJSON-184146727 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:50:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-608c6143-d484-41a1-975c-49c5a26b563f tempest-VolumesTestJSON-184146727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d3f24f1c-f200-41a1-ab55-4d17466e4dcc 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:50:59 devstack sudo[96917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d3f24f1c-f200-41a1-ab55-4d17466e4dcc 1073741824 Jul 08 01:50:59 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-d26a508e-9e32-4e17-990a-187773657dfb tempest-VolumesSnapshotTestJSON-1781941103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e173a06-784a-4ee9-afba-15d95d385e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47b93fcb-0cb5-454a-abc0-98c177f4f1ef', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:59 devstack sudo[96917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:50:59 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-d26a508e-9e32-4e17-990a-187773657dfb tempest-VolumesSnapshotTestJSON-1781941103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c2411ba-6f62-490a-8129-93aac17ab461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:50:59 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-d26a508e-9e32-4e17-990a-187773657dfb tempest-VolumesSnapshotTestJSON-1781941103 None] Volume volume-47b93fcb-0cb5-454a-abc0-98c177f4f1ef (47b93fcb-0cb5-454a-abc0-98c177f4f1ef): created successfully Jul 08 01:50:59 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-d26a508e-9e32-4e17-990a-187773657dfb tempest-VolumesSnapshotTestJSON-1781941103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c2411ba-6f62-490a-8129-93aac17ab461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:50:59 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-d26a508e-9e32-4e17-990a-187773657dfb tempest-VolumesSnapshotTestJSON-1781941103 None] Flow 'volume_create_manager' (2a75ab4c-5474-420a-916a-86e42cc464e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:50:59 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-8478cf81-192d-4906-bae8-31004b623569 tempest-VolumesSnapshotListTestJSON-611841005 None] Delete snapshot completed successfully. Jul 08 01:50:59 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-d26a508e-9e32-4e17-990a-187773657dfb tempest-VolumesSnapshotTestJSON-1781941103 None] Created volume successfully. Jul 08 01:50:59 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-8478cf81-192d-4906-bae8-31004b623569 tempest-VolumesSnapshotListTestJSON-611841005 None] Lock "cinder-bb04b6a9-7e92-46ad-93d3-87ea2f5413be-delete_snapshot" released by "delete_snapshot" :: held 5.235s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:50:59 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-54bacb83-68e7-4636-8744-f52f8ea9996c tempest-VolumesActionsTest-11317694 None] Acquiring lock "cinder-05100268-f3f4-4d59-a006-e1cd31dd0392-detach_volume" by "detach_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:50:59 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-54bacb83-68e7-4636-8744-f52f8ea9996c tempest-VolumesActionsTest-11317694 None] Lock "cinder-05100268-f3f4-4d59-a006-e1cd31dd0392-detach_volume" acquired by "detach_volume" :: waited 0.033s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:50:59 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-54bacb83-68e7-4636-8744-f52f8ea9996c tempest-VolumesActionsTest-11317694 None] Detaching volume 05100268-f3f4-4d59-a006-e1cd31dd0392 from instance b24e24f7-6c77-4937-ab22-a30d085e0549. Jul 08 01:51:00 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-4e25e48f-01d3-4c14-a75f-73a1e61af357 tempest-VolumesSnapshotListTestJSON-611841005 None] Acquiring lock "cinder-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:51:00 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-54bacb83-68e7-4636-8744-f52f8ea9996c tempest-VolumesActionsTest-11317694 None] Detach volume completed successfully. Jul 08 01:51:00 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-4e25e48f-01d3-4c14-a75f-73a1e61af357 tempest-VolumesSnapshotListTestJSON-611841005 None] Lock "cinder-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:51:00 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-54bacb83-68e7-4636-8744-f52f8ea9996c tempest-VolumesActionsTest-11317694 None] Lock "cinder-05100268-f3f4-4d59-a006-e1cd31dd0392-detach_volume" released by "detach_volume" :: held 0.146s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:51:00 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-4e25e48f-01d3-4c14-a75f-73a1e61af357 tempest-VolumesSnapshotListTestJSON-611841005 None] Acquiring lock "cinder-quobyte-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:51:00 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-4e25e48f-01d3-4c14-a75f-73a1e61af357 tempest-VolumesSnapshotListTestJSON-611841005 None] Lock "cinder-quobyte-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022" acquired by "delete_volume" :: waited 0.022s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:51:00 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[932ea7ad-b25c-4168-a1ea-911a5ecf2d73]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:51:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4e25e48f-01d3-4c14-a75f-73a1e61af357 tempest-VolumesSnapshotListTestJSON-611841005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:00 devstack sudo[96919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022 Jul 08 01:51:00 devstack sudo[96919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:01 devstack sudo[96917]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-608c6143-d484-41a1-975c-49c5a26b563f tempest-VolumesTestJSON-184146727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d3f24f1c-f200-41a1-ab55-4d17466e4dcc 1073741824" returned: 0 in 1.384s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b991b32c-7dfb-47f8-b98e-94871e3492b5 tempest-VolumesSnapshotTestJSON-1781941103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:51:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-608c6143-d484-41a1-975c-49c5a26b563f tempest-VolumesTestJSON-184146727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d3f24f1c-f200-41a1-ab55-4d17466e4dcc {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:01 devstack sudo[96925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d3f24f1c-f200-41a1-ab55-4d17466e4dcc Jul 08 01:51:01 devstack sudo[96925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:01 devstack sudo[96919]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4e25e48f-01d3-4c14-a75f-73a1e61af357 tempest-VolumesSnapshotListTestJSON-611841005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022" returned: 0 in 1.284s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4e25e48f-01d3-4c14-a75f-73a1e61af357 tempest-VolumesSnapshotListTestJSON-611841005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:01 devstack sudo[96931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022 Jul 08 01:51:01 devstack sudo[96931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:01 devstack sudo[96925]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-608c6143-d484-41a1-975c-49c5a26b563f tempest-VolumesTestJSON-184146727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d3f24f1c-f200-41a1-ab55-4d17466e4dcc" returned: 0 in 0.807s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:01 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-608c6143-d484-41a1-975c-49c5a26b563f tempest-VolumesTestJSON-184146727 None] <== create_volume: return (2241ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:51:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-608c6143-d484-41a1-975c-49c5a26b563f tempest-VolumesTestJSON-184146727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.245s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:51:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b991b32c-7dfb-47f8-b98e-94871e3492b5 tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.831s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:51:01 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-608c6143-d484-41a1-975c-49c5a26b563f tempest-VolumesTestJSON-184146727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d33a82b7-3337-4a14-88b8-c846cd7b374d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3f24f1c-f200-41a1-ab55-4d17466e4dcc', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:51:01 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-608c6143-d484-41a1-975c-49c5a26b563f tempest-VolumesTestJSON-184146727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (886e9276-e3b5-44a8-80de-cfa97ba0c299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:51:01 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-b991b32c-7dfb-47f8-b98e-94871e3492b5 tempest-VolumesSnapshotTestJSON-1781941103 None] Creating offline snapshot e06fbc37-ab00-4eaa-82b1-ea81ae6511da of volume 47b93fcb-0cb5-454a-abc0-98c177f4f1ef {{(pid=87134) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:51:01 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-608c6143-d484-41a1-975c-49c5a26b563f tempest-VolumesTestJSON-184146727 None] Volume volume-d3f24f1c-f200-41a1-ab55-4d17466e4dcc (d3f24f1c-f200-41a1-ab55-4d17466e4dcc): created successfully Jul 08 01:51:01 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-608c6143-d484-41a1-975c-49c5a26b563f tempest-VolumesTestJSON-184146727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (886e9276-e3b5-44a8-80de-cfa97ba0c299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:51:01 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-608c6143-d484-41a1-975c-49c5a26b563f tempest-VolumesTestJSON-184146727 None] Flow 'volume_create_manager' (0bce40fc-1490-4042-85cc-a136c1559881) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:51:01 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[e68561a4-8079-4ff1-8ce6-4cd8c45fa4c5]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:51:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b991b32c-7dfb-47f8-b98e-94871e3492b5 tempest-VolumesSnapshotTestJSON-1781941103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-47b93fcb-0cb5-454a-abc0-98c177f4f1ef {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:01 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-608c6143-d484-41a1-975c-49c5a26b563f tempest-VolumesTestJSON-184146727 None] Created volume successfully. Jul 08 01:51:02 devstack sudo[96936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-47b93fcb-0cb5-454a-abc0-98c177f4f1ef Jul 08 01:51:02 devstack sudo[96936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:02 devstack sudo[96931]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4e25e48f-01d3-4c14-a75f-73a1e61af357 tempest-VolumesSnapshotListTestJSON-611841005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022" returned: 0 in 0.779s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:02 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-4e25e48f-01d3-4c14-a75f-73a1e61af357 tempest-VolumesSnapshotListTestJSON-611841005 None] Lock "cinder-quobyte-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022" released by "delete_volume" :: held 2.129s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:51:02 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-4e25e48f-01d3-4c14-a75f-73a1e61af357 tempest-VolumesSnapshotListTestJSON-611841005 None] Created reservations ['1bdf3595-5215-4562-a5df-c25872cfcb8c', '8c5093fd-6c52-41fb-9fae-f03fd0db0bfb', '9527771f-d940-4064-af2b-df7302016b01', 'd2c17b6f-92b1-4103-a5c0-af947e85fc4c'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:51:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-4e25e48f-01d3-4c14-a75f-73a1e61af357 tempest-VolumesSnapshotListTestJSON-611841005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:51:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-4e25e48f-01d3-4c14-a75f-73a1e61af357 tempest-VolumesSnapshotListTestJSON-611841005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:51:02 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-4e25e48f-01d3-4c14-a75f-73a1e61af357 tempest-VolumesSnapshotListTestJSON-611841005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:51:02 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-4e25e48f-01d3-4c14-a75f-73a1e61af357 tempest-VolumesSnapshotListTestJSON-611841005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:51:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-4e25e48f-01d3-4c14-a75f-73a1e61af357 tempest-VolumesSnapshotListTestJSON-611841005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:51:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4e25e48f-01d3-4c14-a75f-73a1e61af357 tempest-VolumesSnapshotListTestJSON-611841005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:02 devstack sudo[96944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:51:02 devstack sudo[96944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:03 devstack sudo[96936]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:03 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b991b32c-7dfb-47f8-b98e-94871e3492b5 tempest-VolumesSnapshotTestJSON-1781941103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-47b93fcb-0cb5-454a-abc0-98c177f4f1ef" returned: 0 in 1.097s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:03 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b991b32c-7dfb-47f8-b98e-94871e3492b5 tempest-VolumesSnapshotTestJSON-1781941103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-47b93fcb-0cb5-454a-abc0-98c177f4f1ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-47b93fcb-0cb5-454a-abc0-98c177f4f1ef.e06fbc37-ab00-4eaa-82b1-ea81ae6511da 1G {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:03 devstack sudo[96966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-47b93fcb-0cb5-454a-abc0-98c177f4f1ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-47b93fcb-0cb5-454a-abc0-98c177f4f1ef.e06fbc37-ab00-4eaa-82b1-ea81ae6511da 1G Jul 08 01:51:03 devstack sudo[96966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:03 devstack sudo[96944]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:03 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4e25e48f-01d3-4c14-a75f-73a1e61af357 tempest-VolumesSnapshotListTestJSON-611841005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.831s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:03 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-4e25e48f-01d3-4c14-a75f-73a1e61af357 tempest-VolumesSnapshotListTestJSON-611841005 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:51:03 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-4e25e48f-01d3-4c14-a75f-73a1e61af357 tempest-VolumesSnapshotListTestJSON-611841005 None] Deleted volume successfully. Jul 08 01:51:03 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-4e25e48f-01d3-4c14-a75f-73a1e61af357 tempest-VolumesSnapshotListTestJSON-611841005 None] Lock "cinder-08fef4a7-dcc8-42c7-8e2e-60a8d44b4022-delete_volume" released by "delete_volume" :: held 3.228s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:51:03 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-b90b6d57-41dd-4f2f-807e-b1e7a90330f4 tempest-VolumesTestJSON-184146727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:51:03 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b90b6d57-41dd-4f2f-807e-b1e7a90330f4 tempest-VolumesTestJSON-184146727 None] Flow 'volume_create_manager' (6a406674-7c75-4cdd-bba3-f00c183f7547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:51:03 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b90b6d57-41dd-4f2f-807e-b1e7a90330f4 tempest-VolumesTestJSON-184146727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37b9fcb6-496a-4c4d-94ed-22acd982e483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:51:03 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b90b6d57-41dd-4f2f-807e-b1e7a90330f4 tempest-VolumesTestJSON-184146727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37b9fcb6-496a-4c4d-94ed-22acd982e483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:51:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1634664677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=879a709e-db90-48f6-96bf-125efa9073ae,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='caf41379047b45f9b3fbf5b4d2e3e564',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:51:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:51:04Z,use_quota=True,user_id='cb20daf32a9542588c942273cc1b1d67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:51:03 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b90b6d57-41dd-4f2f-807e-b1e7a90330f4 tempest-VolumesTestJSON-184146727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6efb1482-10fc-45bf-874c-57708350d1e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:51:03 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b90b6d57-41dd-4f2f-807e-b1e7a90330f4 tempest-VolumesTestJSON-184146727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6efb1482-10fc-45bf-874c-57708350d1e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:51:03 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b90b6d57-41dd-4f2f-807e-b1e7a90330f4 tempest-VolumesTestJSON-184146727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0bf29a4-72c3-475e-9d75-6dac509183cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:51:03 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b90b6d57-41dd-4f2f-807e-b1e7a90330f4 tempest-VolumesTestJSON-184146727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0bf29a4-72c3-475e-9d75-6dac509183cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '879a709e-db90-48f6-96bf-125efa9073ae', 'volume_name': 'volume-879a709e-db90-48f6-96bf-125efa9073ae', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:51:03 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b90b6d57-41dd-4f2f-807e-b1e7a90330f4 tempest-VolumesTestJSON-184146727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56257150-4b6c-480a-a1ee-6cd5353eac98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:51:03 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b90b6d57-41dd-4f2f-807e-b1e7a90330f4 tempest-VolumesTestJSON-184146727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56257150-4b6c-480a-a1ee-6cd5353eac98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:51:03 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b90b6d57-41dd-4f2f-807e-b1e7a90330f4 tempest-VolumesTestJSON-184146727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a51b0ba1-8352-41f9-be7e-34a91442a034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:51:03 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-b90b6d57-41dd-4f2f-807e-b1e7a90330f4 tempest-VolumesTestJSON-184146727 None] Volume 879a709e-db90-48f6-96bf-125efa9073ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-879a709e-db90-48f6-96bf-125efa9073ae', 'volume_size': 1} Jul 08 01:51:03 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b90b6d57-41dd-4f2f-807e-b1e7a90330f4 tempest-VolumesTestJSON-184146727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:51:04 devstack sudo[96966]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:04 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b991b32c-7dfb-47f8-b98e-94871e3492b5 tempest-VolumesSnapshotTestJSON-1781941103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-47b93fcb-0cb5-454a-abc0-98c177f4f1ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-47b93fcb-0cb5-454a-abc0-98c177f4f1ef.e06fbc37-ab00-4eaa-82b1-ea81ae6511da 1G" returned: 0 in 1.309s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:04 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b991b32c-7dfb-47f8-b98e-94871e3492b5 tempest-VolumesSnapshotTestJSON-1781941103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47b93fcb-0cb5-454a-abc0-98c177f4f1ef -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-47b93fcb-0cb5-454a-abc0-98c177f4f1ef.e06fbc37-ab00-4eaa-82b1-ea81ae6511da {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:04 devstack sudo[96975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47b93fcb-0cb5-454a-abc0-98c177f4f1ef -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-47b93fcb-0cb5-454a-abc0-98c177f4f1ef.e06fbc37-ab00-4eaa-82b1-ea81ae6511da Jul 08 01:51:04 devstack sudo[96975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:05 devstack sudo[96975]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:05 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b991b32c-7dfb-47f8-b98e-94871e3492b5 tempest-VolumesSnapshotTestJSON-1781941103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47b93fcb-0cb5-454a-abc0-98c177f4f1ef -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-47b93fcb-0cb5-454a-abc0-98c177f4f1ef.e06fbc37-ab00-4eaa-82b1-ea81ae6511da" returned: 0 in 0.801s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:05 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-b991b32c-7dfb-47f8-b98e-94871e3492b5 tempest-VolumesSnapshotTestJSON-1781941103 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-47b93fcb-0cb5-454a-abc0-98c177f4f1ef.e06fbc37-ab00-4eaa-82b1-ea81ae6511da is being set with open permissions: ugo+rw Jul 08 01:51:05 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b991b32c-7dfb-47f8-b98e-94871e3492b5 tempest-VolumesSnapshotTestJSON-1781941103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-47b93fcb-0cb5-454a-abc0-98c177f4f1ef.e06fbc37-ab00-4eaa-82b1-ea81ae6511da {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:05 devstack sudo[96981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-47b93fcb-0cb5-454a-abc0-98c177f4f1ef.e06fbc37-ab00-4eaa-82b1-ea81ae6511da Jul 08 01:51:05 devstack sudo[96981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:05 devstack sudo[96981]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:05 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b991b32c-7dfb-47f8-b98e-94871e3492b5 tempest-VolumesSnapshotTestJSON-1781941103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-47b93fcb-0cb5-454a-abc0-98c177f4f1ef.e06fbc37-ab00-4eaa-82b1-ea81ae6511da" returned: 0 in 0.750s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:05 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b991b32c-7dfb-47f8-b98e-94871e3492b5 tempest-VolumesSnapshotTestJSON-1781941103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-47b93fcb-0cb5-454a-abc0-98c177f4f1ef.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:05 devstack sudo[96984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-47b93fcb-0cb5-454a-abc0-98c177f4f1ef.info Jul 08 01:51:05 devstack sudo[96984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:06 devstack sudo[96984]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:06 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b991b32c-7dfb-47f8-b98e-94871e3492b5 tempest-VolumesSnapshotTestJSON-1781941103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-47b93fcb-0cb5-454a-abc0-98c177f4f1ef.info" returned: 0 in 0.763s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:06 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-b991b32c-7dfb-47f8-b98e-94871e3492b5 tempest-VolumesSnapshotTestJSON-1781941103 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-47b93fcb-0cb5-454a-abc0-98c177f4f1ef.info is being set with open permissions: ugo+rw Jul 08 01:51:06 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b991b32c-7dfb-47f8-b98e-94871e3492b5 tempest-VolumesSnapshotTestJSON-1781941103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-47b93fcb-0cb5-454a-abc0-98c177f4f1ef.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:06 devstack sudo[96987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-47b93fcb-0cb5-454a-abc0-98c177f4f1ef.info Jul 08 01:51:06 devstack sudo[96987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:07 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-5419d6f3-9961-4680-b5a6-4b6f53379552 tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:51:07 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5419d6f3-9961-4680-b5a6-4b6f53379552 tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] Flow 'volume_create_manager' (a7d1bf47-e813-4168-9ff9-cd68b72b7062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:51:07 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5419d6f3-9961-4680-b5a6-4b6f53379552 tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ccaba85-0df3-401c-8c9e-d6d0c2381318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:51:07 devstack sudo[96987]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:07 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b991b32c-7dfb-47f8-b98e-94871e3492b5 tempest-VolumesSnapshotTestJSON-1781941103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-47b93fcb-0cb5-454a-abc0-98c177f4f1ef.info" returned: 0 in 0.910s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:07 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b991b32c-7dfb-47f8-b98e-94871e3492b5 tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.764s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:51:07 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b90b6d57-41dd-4f2f-807e-b1e7a90330f4 tempest-VolumesTestJSON-184146727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.766s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:51:07 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-b90b6d57-41dd-4f2f-807e-b1e7a90330f4 tempest-VolumesTestJSON-184146727 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:51:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1634664677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=879a709e-db90-48f6-96bf-125efa9073ae,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='caf41379047b45f9b3fbf5b4d2e3e564',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:51:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:51:04Z,use_quota=True,user_id='cb20daf32a9542588c942273cc1b1d67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:51:07 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-b90b6d57-41dd-4f2f-807e-b1e7a90330f4 tempest-VolumesTestJSON-184146727 None] Creating volume 879a709e-db90-48f6-96bf-125efa9073ae {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:51:07 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b90b6d57-41dd-4f2f-807e-b1e7a90330f4 tempest-VolumesTestJSON-184146727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:51:07 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b90b6d57-41dd-4f2f-807e-b1e7a90330f4 tempest-VolumesTestJSON-184146727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:51:07 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-b90b6d57-41dd-4f2f-807e-b1e7a90330f4 tempest-VolumesTestJSON-184146727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:51:07 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-b90b6d57-41dd-4f2f-807e-b1e7a90330f4 tempest-VolumesTestJSON-184146727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:51:07 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b90b6d57-41dd-4f2f-807e-b1e7a90330f4 tempest-VolumesTestJSON-184146727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:51:07 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-b90b6d57-41dd-4f2f-807e-b1e7a90330f4 tempest-VolumesTestJSON-184146727 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:51:07 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-b90b6d57-41dd-4f2f-807e-b1e7a90330f4 tempest-VolumesTestJSON-184146727 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:51:07 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b90b6d57-41dd-4f2f-807e-b1e7a90330f4 tempest-VolumesTestJSON-184146727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-879a709e-db90-48f6-96bf-125efa9073ae 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:07 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5419d6f3-9961-4680-b5a6-4b6f53379552 tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ccaba85-0df3-401c-8c9e-d6d0c2381318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:51:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-661168753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4925ecc6-d381-4772-8034-7ae9e8a7e87f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='267d93ff6b5545ed89e34498857b0245',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:51:07Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:51:07Z,use_quota=True,user_id='2e968bec23c2427db2423e214b3ee69a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:51:07 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5419d6f3-9961-4680-b5a6-4b6f53379552 tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37d6f9a9-6179-4cd6-8a77-1bd247dbd9d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:51:07 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5419d6f3-9961-4680-b5a6-4b6f53379552 tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37d6f9a9-6179-4cd6-8a77-1bd247dbd9d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:51:07 devstack sudo[96990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-879a709e-db90-48f6-96bf-125efa9073ae 1073741824 Jul 08 01:51:07 devstack sudo[96990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:07 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5419d6f3-9961-4680-b5a6-4b6f53379552 tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3264897a-704c-4e65-b3bb-6263de0b7e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:51:07 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5419d6f3-9961-4680-b5a6-4b6f53379552 tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3264897a-704c-4e65-b3bb-6263de0b7e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4925ecc6-d381-4772-8034-7ae9e8a7e87f', 'volume_name': 'volume-4925ecc6-d381-4772-8034-7ae9e8a7e87f', 'volume_size': 2}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:51:07 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5419d6f3-9961-4680-b5a6-4b6f53379552 tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76b065f0-f36f-43fc-9df2-310fffebdf6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:51:07 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5419d6f3-9961-4680-b5a6-4b6f53379552 tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76b065f0-f36f-43fc-9df2-310fffebdf6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:51:07 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5419d6f3-9961-4680-b5a6-4b6f53379552 tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84670eab-8e1b-41a7-b063-61b1616231ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:51:07 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-5419d6f3-9961-4680-b5a6-4b6f53379552 tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] Volume 4925ecc6-d381-4772-8034-7ae9e8a7e87f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4925ecc6-d381-4772-8034-7ae9e8a7e87f', 'volume_size': 2} Jul 08 01:51:07 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5419d6f3-9961-4680-b5a6-4b6f53379552 tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:51:07 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-b991b32c-7dfb-47f8-b98e-94871e3492b5 tempest-VolumesSnapshotTestJSON-1781941103 None] Create snapshot completed successfully Jul 08 01:51:08 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-12a3360d-02f3-4a39-95bf-f38723e4cabe tempest-VolumesSnapshotTestJSON-1781941103 None] Acquiring lock "cinder-e06fbc37-ab00-4eaa-82b1-ea81ae6511da-delete_snapshot" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:51:08 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-12a3360d-02f3-4a39-95bf-f38723e4cabe tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "cinder-e06fbc37-ab00-4eaa-82b1-ea81ae6511da-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:51:08 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-12a3360d-02f3-4a39-95bf-f38723e4cabe tempest-VolumesSnapshotTestJSON-1781941103 None] Acquiring lock "cinder-quobyte-47b93fcb-0cb5-454a-abc0-98c177f4f1ef" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:51:08 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-12a3360d-02f3-4a39-95bf-f38723e4cabe tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "cinder-quobyte-47b93fcb-0cb5-454a-abc0-98c177f4f1ef" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:51:08 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-12a3360d-02f3-4a39-95bf-f38723e4cabe tempest-VolumesSnapshotTestJSON-1781941103 None] Acquiring lock "cinder-quobyte-e06fbc37-ab00-4eaa-82b1-ea81ae6511da" by "_delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:51:08 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-12a3360d-02f3-4a39-95bf-f38723e4cabe tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "cinder-quobyte-e06fbc37-ab00-4eaa-82b1-ea81ae6511da" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:51:08 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-12a3360d-02f3-4a39-95bf-f38723e4cabe tempest-VolumesSnapshotTestJSON-1781941103 None] Deleting offline snapshot e06fbc37-ab00-4eaa-82b1-ea81ae6511da of volume 47b93fcb-0cb5-454a-abc0-98c177f4f1ef {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:51:08 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-12a3360d-02f3-4a39-95bf-f38723e4cabe tempest-VolumesSnapshotTestJSON-1781941103 None] snapshot_file for this snap is: volume-47b93fcb-0cb5-454a-abc0-98c177f4f1ef.e06fbc37-ab00-4eaa-82b1-ea81ae6511da {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:51:08 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[67bbfbeb-7ebe-48b3-b2d2-302a22169742]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:51:08 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-12a3360d-02f3-4a39-95bf-f38723e4cabe tempest-VolumesSnapshotTestJSON-1781941103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-47b93fcb-0cb5-454a-abc0-98c177f4f1ef.e06fbc37-ab00-4eaa-82b1-ea81ae6511da {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:08 devstack sudo[96990]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:08 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b90b6d57-41dd-4f2f-807e-b1e7a90330f4 tempest-VolumesTestJSON-184146727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-879a709e-db90-48f6-96bf-125efa9073ae 1073741824" returned: 0 in 1.087s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:08 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b90b6d57-41dd-4f2f-807e-b1e7a90330f4 tempest-VolumesTestJSON-184146727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-879a709e-db90-48f6-96bf-125efa9073ae {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:08 devstack sudo[96998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-879a709e-db90-48f6-96bf-125efa9073ae Jul 08 01:51:08 devstack sudo[96998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:08 devstack sudo[96997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-47b93fcb-0cb5-454a-abc0-98c177f4f1ef.e06fbc37-ab00-4eaa-82b1-ea81ae6511da Jul 08 01:51:08 devstack sudo[96997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:09 devstack sudo[96998]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:09 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b90b6d57-41dd-4f2f-807e-b1e7a90330f4 tempest-VolumesTestJSON-184146727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-879a709e-db90-48f6-96bf-125efa9073ae" returned: 0 in 0.808s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:09 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-b90b6d57-41dd-4f2f-807e-b1e7a90330f4 tempest-VolumesTestJSON-184146727 None] <== create_volume: return (1963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:51:09 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b90b6d57-41dd-4f2f-807e-b1e7a90330f4 tempest-VolumesTestJSON-184146727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.968s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:51:09 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5419d6f3-9961-4680-b5a6-4b6f53379552 tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.910s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:51:09 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-5419d6f3-9961-4680-b5a6-4b6f53379552 tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:51:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-661168753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4925ecc6-d381-4772-8034-7ae9e8a7e87f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='267d93ff6b5545ed89e34498857b0245',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:51:07Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:51:07Z,use_quota=True,user_id='2e968bec23c2427db2423e214b3ee69a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:51:09 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-5419d6f3-9961-4680-b5a6-4b6f53379552 tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] Creating volume 4925ecc6-d381-4772-8034-7ae9e8a7e87f {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:51:09 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5419d6f3-9961-4680-b5a6-4b6f53379552 tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:51:09 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5419d6f3-9961-4680-b5a6-4b6f53379552 tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:51:09 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-5419d6f3-9961-4680-b5a6-4b6f53379552 tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:51:09 devstack sudo[96997]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:09 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-5419d6f3-9961-4680-b5a6-4b6f53379552 tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:51:09 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5419d6f3-9961-4680-b5a6-4b6f53379552 tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:51:09 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-5419d6f3-9961-4680-b5a6-4b6f53379552 tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:51:09 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-5419d6f3-9961-4680-b5a6-4b6f53379552 tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:51:09 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5419d6f3-9961-4680-b5a6-4b6f53379552 tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4925ecc6-d381-4772-8034-7ae9e8a7e87f 2147483648 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:09 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-12a3360d-02f3-4a39-95bf-f38723e4cabe tempest-VolumesSnapshotTestJSON-1781941103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-47b93fcb-0cb5-454a-abc0-98c177f4f1ef.e06fbc37-ab00-4eaa-82b1-ea81ae6511da" returned: 0 in 0.945s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:09 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-12a3360d-02f3-4a39-95bf-f38723e4cabe tempest-VolumesSnapshotTestJSON-1781941103 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47b93fcb-0cb5-454a-abc0-98c177f4f1ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:51:09 devstack sudo[97006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4925ecc6-d381-4772-8034-7ae9e8a7e87f 2147483648 Jul 08 01:51:09 devstack sudo[97006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:09 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b90b6d57-41dd-4f2f-807e-b1e7a90330f4 tempest-VolumesTestJSON-184146727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a51b0ba1-8352-41f9-be7e-34a91442a034) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-879a709e-db90-48f6-96bf-125efa9073ae', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:51:09 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b90b6d57-41dd-4f2f-807e-b1e7a90330f4 tempest-VolumesTestJSON-184146727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bd2dfdf-d00a-4e62-9989-2ba5775559c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:51:09 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[916b62e5-7674-4f2d-a232-fb11a200782f]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:51:09 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-12a3360d-02f3-4a39-95bf-f38723e4cabe tempest-VolumesSnapshotTestJSON-1781941103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-47b93fcb-0cb5-454a-abc0-98c177f4f1ef {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:09 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-b90b6d57-41dd-4f2f-807e-b1e7a90330f4 tempest-VolumesTestJSON-184146727 None] Volume volume-879a709e-db90-48f6-96bf-125efa9073ae (879a709e-db90-48f6-96bf-125efa9073ae): created successfully Jul 08 01:51:09 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b90b6d57-41dd-4f2f-807e-b1e7a90330f4 tempest-VolumesTestJSON-184146727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bd2dfdf-d00a-4e62-9989-2ba5775559c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:51:09 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b90b6d57-41dd-4f2f-807e-b1e7a90330f4 tempest-VolumesTestJSON-184146727 None] Flow 'volume_create_manager' (6a406674-7c75-4cdd-bba3-f00c183f7547) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:51:09 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-b90b6d57-41dd-4f2f-807e-b1e7a90330f4 tempest-VolumesTestJSON-184146727 None] Created volume successfully. Jul 08 01:51:09 devstack sudo[97010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-47b93fcb-0cb5-454a-abc0-98c177f4f1ef Jul 08 01:51:09 devstack sudo[97010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:10 devstack sudo[97010]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:10 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-12a3360d-02f3-4a39-95bf-f38723e4cabe tempest-VolumesSnapshotTestJSON-1781941103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-47b93fcb-0cb5-454a-abc0-98c177f4f1ef" returned: 0 in 0.931s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:10 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-12a3360d-02f3-4a39-95bf-f38723e4cabe tempest-VolumesSnapshotTestJSON-1781941103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-47b93fcb-0cb5-454a-abc0-98c177f4f1ef.e06fbc37-ab00-4eaa-82b1-ea81ae6511da {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:10 devstack sudo[97019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-47b93fcb-0cb5-454a-abc0-98c177f4f1ef.e06fbc37-ab00-4eaa-82b1-ea81ae6511da Jul 08 01:51:10 devstack sudo[97019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:11 devstack sudo[97006]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:11 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5419d6f3-9961-4680-b5a6-4b6f53379552 tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4925ecc6-d381-4772-8034-7ae9e8a7e87f 2147483648" returned: 0 in 1.370s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:11 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5419d6f3-9961-4680-b5a6-4b6f53379552 tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4925ecc6-d381-4772-8034-7ae9e8a7e87f {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:11 devstack sudo[97021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4925ecc6-d381-4772-8034-7ae9e8a7e87f Jul 08 01:51:11 devstack sudo[97021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:11 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-1425e21c-3b5d-4e0a-b69b-fe926ac5560f tempest-VolumesTestJSON-184146727 None] Acquiring lock "cinder-879a709e-db90-48f6-96bf-125efa9073ae-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:51:11 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-1425e21c-3b5d-4e0a-b69b-fe926ac5560f tempest-VolumesTestJSON-184146727 None] Lock "cinder-879a709e-db90-48f6-96bf-125efa9073ae-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:51:11 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-1425e21c-3b5d-4e0a-b69b-fe926ac5560f tempest-VolumesTestJSON-184146727 None] Acquiring lock "cinder-quobyte-879a709e-db90-48f6-96bf-125efa9073ae" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:51:11 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-1425e21c-3b5d-4e0a-b69b-fe926ac5560f tempest-VolumesTestJSON-184146727 None] Lock "cinder-quobyte-879a709e-db90-48f6-96bf-125efa9073ae" acquired by "delete_volume" :: waited 0.019s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:51:11 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d79ee1-d511-44b4-9e3b-8f6a7de29a2b]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:51:11 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1425e21c-3b5d-4e0a-b69b-fe926ac5560f tempest-VolumesTestJSON-184146727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-879a709e-db90-48f6-96bf-125efa9073ae {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:11 devstack sudo[97025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-879a709e-db90-48f6-96bf-125efa9073ae Jul 08 01:51:11 devstack sudo[97025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:11 devstack sudo[97019]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:11 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-12a3360d-02f3-4a39-95bf-f38723e4cabe tempest-VolumesSnapshotTestJSON-1781941103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-47b93fcb-0cb5-454a-abc0-98c177f4f1ef.e06fbc37-ab00-4eaa-82b1-ea81ae6511da" returned: 0 in 0.920s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:11 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-12a3360d-02f3-4a39-95bf-f38723e4cabe tempest-VolumesSnapshotTestJSON-1781941103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-47b93fcb-0cb5-454a-abc0-98c177f4f1ef.e06fbc37-ab00-4eaa-82b1-ea81ae6511da {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:11 devstack sudo[97030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-47b93fcb-0cb5-454a-abc0-98c177f4f1ef.e06fbc37-ab00-4eaa-82b1-ea81ae6511da Jul 08 01:51:11 devstack sudo[97030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:11 devstack sudo[97021]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:11 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5419d6f3-9961-4680-b5a6-4b6f53379552 tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4925ecc6-d381-4772-8034-7ae9e8a7e87f" returned: 0 in 0.787s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:11 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-5419d6f3-9961-4680-b5a6-4b6f53379552 tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] <== create_volume: return (2237ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:51:11 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5419d6f3-9961-4680-b5a6-4b6f53379552 tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.243s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:51:11 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5419d6f3-9961-4680-b5a6-4b6f53379552 tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84670eab-8e1b-41a7-b063-61b1616231ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4925ecc6-d381-4772-8034-7ae9e8a7e87f', 'volume_size': 2}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:51:11 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5419d6f3-9961-4680-b5a6-4b6f53379552 tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d645d62-fbc9-4bdf-a08e-d989f8fc7113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:51:11 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-5419d6f3-9961-4680-b5a6-4b6f53379552 tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] Volume volume-4925ecc6-d381-4772-8034-7ae9e8a7e87f (4925ecc6-d381-4772-8034-7ae9e8a7e87f): created successfully Jul 08 01:51:11 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5419d6f3-9961-4680-b5a6-4b6f53379552 tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d645d62-fbc9-4bdf-a08e-d989f8fc7113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:51:11 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5419d6f3-9961-4680-b5a6-4b6f53379552 tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] Flow 'volume_create_manager' (a7d1bf47-e813-4168-9ff9-cd68b72b7062) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:51:11 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-5419d6f3-9961-4680-b5a6-4b6f53379552 tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] Created volume successfully. Jul 08 01:51:12 devstack sudo[97025]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:12 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1425e21c-3b5d-4e0a-b69b-fe926ac5560f tempest-VolumesTestJSON-184146727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-879a709e-db90-48f6-96bf-125efa9073ae" returned: 0 in 1.004s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:12 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1425e21c-3b5d-4e0a-b69b-fe926ac5560f tempest-VolumesTestJSON-184146727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-879a709e-db90-48f6-96bf-125efa9073ae {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:12 devstack sudo[97030]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:12 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-12a3360d-02f3-4a39-95bf-f38723e4cabe tempest-VolumesSnapshotTestJSON-1781941103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-47b93fcb-0cb5-454a-abc0-98c177f4f1ef.e06fbc37-ab00-4eaa-82b1-ea81ae6511da" returned: 0 in 0.760s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:12 devstack sudo[97037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-879a709e-db90-48f6-96bf-125efa9073ae Jul 08 01:51:12 devstack sudo[97037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:12 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-12a3360d-02f3-4a39-95bf-f38723e4cabe tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "cinder-quobyte-e06fbc37-ab00-4eaa-82b1-ea81ae6511da" released by "_delete_snapshot" :: held 3.713s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:51:12 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-12a3360d-02f3-4a39-95bf-f38723e4cabe tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "cinder-quobyte-47b93fcb-0cb5-454a-abc0-98c177f4f1ef" released by "delete_snapshot" :: held 3.743s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:51:12 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-12a3360d-02f3-4a39-95bf-f38723e4cabe tempest-VolumesSnapshotTestJSON-1781941103 None] Created reservations ['7147c1ea-ce66-4481-833a-a4e2f4924b36', 'b71f6b07-e66d-4178-8fc7-f76b4b4ff788', '6ea8e4b4-b2a5-43c9-b0da-4203d77adc3d', 'a4553a3a-677b-4643-8da3-8c124d2d57a0'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:51:12 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-12a3360d-02f3-4a39-95bf-f38723e4cabe tempest-VolumesSnapshotTestJSON-1781941103 None] Delete snapshot completed successfully. Jul 08 01:51:12 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-12a3360d-02f3-4a39-95bf-f38723e4cabe tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "cinder-e06fbc37-ab00-4eaa-82b1-ea81ae6511da-delete_snapshot" released by "delete_snapshot" :: held 3.984s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:51:13 devstack sudo[97037]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1425e21c-3b5d-4e0a-b69b-fe926ac5560f tempest-VolumesTestJSON-184146727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-879a709e-db90-48f6-96bf-125efa9073ae" returned: 0 in 0.766s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-a5c67cf1-1bce-4a6f-aed6-93af9161badf tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:51:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-a5c67cf1-1bce-4a6f-aed6-93af9161badf tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:51:13 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-1425e21c-3b5d-4e0a-b69b-fe926ac5560f tempest-VolumesTestJSON-184146727 None] Lock "cinder-quobyte-879a709e-db90-48f6-96bf-125efa9073ae" released by "delete_volume" :: held 1.812s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:51:13 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-a5c67cf1-1bce-4a6f-aed6-93af9161badf tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] Creating offline snapshot fad33c81-f760-464c-b3d9-36ee21732963 of volume 4925ecc6-d381-4772-8034-7ae9e8a7e87f {{(pid=87134) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:51:13 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[b292fe03-ce95-4b21-bd9e-1a5c26ea37d1]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:51:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a5c67cf1-1bce-4a6f-aed6-93af9161badf tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4925ecc6-d381-4772-8034-7ae9e8a7e87f {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:13 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-1425e21c-3b5d-4e0a-b69b-fe926ac5560f tempest-VolumesTestJSON-184146727 None] Created reservations ['35a3a968-0fb9-483f-9bdb-fb6751c7e75c', 'd1abd2f3-d52c-4651-9a09-3468c0cdaf1f', 'f1201b01-3282-4d42-b6a5-f8b483fe4c60', '2d738f4c-d8bf-4778-9d49-d2c4373836ea'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:51:13 devstack sudo[97041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4925ecc6-d381-4772-8034-7ae9e8a7e87f Jul 08 01:51:13 devstack sudo[97041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-1425e21c-3b5d-4e0a-b69b-fe926ac5560f tempest-VolumesTestJSON-184146727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:51:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-1425e21c-3b5d-4e0a-b69b-fe926ac5560f tempest-VolumesTestJSON-184146727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:51:13 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-1425e21c-3b5d-4e0a-b69b-fe926ac5560f tempest-VolumesTestJSON-184146727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:51:13 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-1425e21c-3b5d-4e0a-b69b-fe926ac5560f tempest-VolumesTestJSON-184146727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:51:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-1425e21c-3b5d-4e0a-b69b-fe926ac5560f tempest-VolumesTestJSON-184146727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:51:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1425e21c-3b5d-4e0a-b69b-fe926ac5560f tempest-VolumesTestJSON-184146727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:13 devstack sudo[97043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:51:13 devstack sudo[97043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:13 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-58f58aba-ad9a-4560-aa72-9ed279f685d6 tempest-VolumesTestJSON-184146727 None] Acquiring lock "cinder-d3f24f1c-f200-41a1-ab55-4d17466e4dcc-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:51:13 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-58f58aba-ad9a-4560-aa72-9ed279f685d6 tempest-VolumesTestJSON-184146727 None] Lock "cinder-d3f24f1c-f200-41a1-ab55-4d17466e4dcc-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:51:13 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-58f58aba-ad9a-4560-aa72-9ed279f685d6 tempest-VolumesTestJSON-184146727 None] Acquiring lock "cinder-quobyte-d3f24f1c-f200-41a1-ab55-4d17466e4dcc" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:51:13 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f62e939-6c1e-4e9c-bdcf-dfca33dba3ad tempest-VolumesSnapshotTestJSON-1781941103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:51:13 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5f62e939-6c1e-4e9c-bdcf-dfca33dba3ad tempest-VolumesSnapshotTestJSON-1781941103 None] Flow 'volume_create_manager' (d05ebec3-ffea-4028-a815-b27ec38ee4e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:51:13 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5f62e939-6c1e-4e9c-bdcf-dfca33dba3ad tempest-VolumesSnapshotTestJSON-1781941103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (385ff5b4-0272-47fc-ad34-2697d2a4553f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:51:13 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-58f58aba-ad9a-4560-aa72-9ed279f685d6 tempest-VolumesTestJSON-184146727 None] Lock "cinder-quobyte-d3f24f1c-f200-41a1-ab55-4d17466e4dcc" acquired by "delete_volume" :: waited 0.052s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:51:13 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5f62e939-6c1e-4e9c-bdcf-dfca33dba3ad tempest-VolumesSnapshotTestJSON-1781941103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (385ff5b4-0272-47fc-ad34-2697d2a4553f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:51:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-693414380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a37c8de-f711-44f6-8f58-998b8e41b9bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d35d25a53f04475397d55628d5c33338',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:51:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:51:14Z,use_quota=True,user_id='a8c972c3a0194d0399a1068466ad9ba0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:51:13 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5f62e939-6c1e-4e9c-bdcf-dfca33dba3ad tempest-VolumesSnapshotTestJSON-1781941103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24816113-978f-49c4-a461-a7af213fafd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:51:13 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5f62e939-6c1e-4e9c-bdcf-dfca33dba3ad tempest-VolumesSnapshotTestJSON-1781941103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24816113-978f-49c4-a461-a7af213fafd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:51:13 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5f62e939-6c1e-4e9c-bdcf-dfca33dba3ad tempest-VolumesSnapshotTestJSON-1781941103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fc5bce5-a795-4097-beea-dd006212317a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:51:13 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5f62e939-6c1e-4e9c-bdcf-dfca33dba3ad tempest-VolumesSnapshotTestJSON-1781941103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fc5bce5-a795-4097-beea-dd006212317a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a37c8de-f711-44f6-8f58-998b8e41b9bc', 'volume_name': 'volume-3a37c8de-f711-44f6-8f58-998b8e41b9bc', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:51:13 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5f62e939-6c1e-4e9c-bdcf-dfca33dba3ad tempest-VolumesSnapshotTestJSON-1781941103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50749b98-fb5c-4580-b3af-57c5693aa02d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:51:13 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5f62e939-6c1e-4e9c-bdcf-dfca33dba3ad tempest-VolumesSnapshotTestJSON-1781941103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50749b98-fb5c-4580-b3af-57c5693aa02d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:51:13 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5f62e939-6c1e-4e9c-bdcf-dfca33dba3ad tempest-VolumesSnapshotTestJSON-1781941103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9940bf8b-7998-461c-a540-51dc8de6d52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:51:13 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-5f62e939-6c1e-4e9c-bdcf-dfca33dba3ad tempest-VolumesSnapshotTestJSON-1781941103 None] Volume 3a37c8de-f711-44f6-8f58-998b8e41b9bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a37c8de-f711-44f6-8f58-998b8e41b9bc', 'volume_size': 1} Jul 08 01:51:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5f62e939-6c1e-4e9c-bdcf-dfca33dba3ad tempest-VolumesSnapshotTestJSON-1781941103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:51:13 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7738a5-1c54-407c-97f6-5c87f03b831d]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:51:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-58f58aba-ad9a-4560-aa72-9ed279f685d6 tempest-VolumesTestJSON-184146727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d3f24f1c-f200-41a1-ab55-4d17466e4dcc {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:13 devstack sudo[97045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d3f24f1c-f200-41a1-ab55-4d17466e4dcc Jul 08 01:51:13 devstack sudo[97045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:14 devstack sudo[97041]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:14 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a5c67cf1-1bce-4a6f-aed6-93af9161badf tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4925ecc6-d381-4772-8034-7ae9e8a7e87f" returned: 0 in 0.976s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:14 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a5c67cf1-1bce-4a6f-aed6-93af9161badf tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4925ecc6-d381-4772-8034-7ae9e8a7e87f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4925ecc6-d381-4772-8034-7ae9e8a7e87f.fad33c81-f760-464c-b3d9-36ee21732963 2G {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:14 devstack sudo[97043]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:14 devstack sudo[97051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4925ecc6-d381-4772-8034-7ae9e8a7e87f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4925ecc6-d381-4772-8034-7ae9e8a7e87f.fad33c81-f760-464c-b3d9-36ee21732963 2G Jul 08 01:51:14 devstack sudo[97051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:14 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1425e21c-3b5d-4e0a-b69b-fe926ac5560f tempest-VolumesTestJSON-184146727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.798s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:14 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-1425e21c-3b5d-4e0a-b69b-fe926ac5560f tempest-VolumesTestJSON-184146727 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:51:14 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-1425e21c-3b5d-4e0a-b69b-fe926ac5560f tempest-VolumesTestJSON-184146727 None] Deleted volume successfully. Jul 08 01:51:14 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-1425e21c-3b5d-4e0a-b69b-fe926ac5560f tempest-VolumesTestJSON-184146727 None] Lock "cinder-879a709e-db90-48f6-96bf-125efa9073ae-delete_volume" released by "delete_volume" :: held 2.953s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:51:14 devstack sudo[97045]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:14 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-58f58aba-ad9a-4560-aa72-9ed279f685d6 tempest-VolumesTestJSON-184146727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d3f24f1c-f200-41a1-ab55-4d17466e4dcc" returned: 0 in 0.861s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:14 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-58f58aba-ad9a-4560-aa72-9ed279f685d6 tempest-VolumesTestJSON-184146727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d3f24f1c-f200-41a1-ab55-4d17466e4dcc {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:14 devstack sudo[97057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d3f24f1c-f200-41a1-ab55-4d17466e4dcc Jul 08 01:51:14 devstack sudo[97057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:15 devstack sudo[97051]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a5c67cf1-1bce-4a6f-aed6-93af9161badf tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4925ecc6-d381-4772-8034-7ae9e8a7e87f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4925ecc6-d381-4772-8034-7ae9e8a7e87f.fad33c81-f760-464c-b3d9-36ee21732963 2G" returned: 0 in 0.903s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a5c67cf1-1bce-4a6f-aed6-93af9161badf tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4925ecc6-d381-4772-8034-7ae9e8a7e87f -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4925ecc6-d381-4772-8034-7ae9e8a7e87f.fad33c81-f760-464c-b3d9-36ee21732963 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:15 devstack sudo[97063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4925ecc6-d381-4772-8034-7ae9e8a7e87f -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4925ecc6-d381-4772-8034-7ae9e8a7e87f.fad33c81-f760-464c-b3d9-36ee21732963 Jul 08 01:51:15 devstack sudo[97063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:15 devstack sudo[97057]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-58f58aba-ad9a-4560-aa72-9ed279f685d6 tempest-VolumesTestJSON-184146727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d3f24f1c-f200-41a1-ab55-4d17466e4dcc" returned: 0 in 0.737s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:15 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-58f58aba-ad9a-4560-aa72-9ed279f685d6 tempest-VolumesTestJSON-184146727 None] Lock "cinder-quobyte-d3f24f1c-f200-41a1-ab55-4d17466e4dcc" released by "delete_volume" :: held 1.686s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:51:15 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-58f58aba-ad9a-4560-aa72-9ed279f685d6 tempest-VolumesTestJSON-184146727 None] Created reservations ['4e456779-0342-4194-b438-3407da6c5a3c', '58ca5e13-81c7-41c2-8a18-8e3dbaa100d3', '5065822d-c93b-4f8c-950b-9ce153245cfe', '1e8b03ec-43fb-4848-adc3-5fe090e2e0d7'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:51:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-58f58aba-ad9a-4560-aa72-9ed279f685d6 tempest-VolumesTestJSON-184146727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:51:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-58f58aba-ad9a-4560-aa72-9ed279f685d6 tempest-VolumesTestJSON-184146727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:51:15 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-58f58aba-ad9a-4560-aa72-9ed279f685d6 tempest-VolumesTestJSON-184146727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:51:15 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-58f58aba-ad9a-4560-aa72-9ed279f685d6 tempest-VolumesTestJSON-184146727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:51:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-58f58aba-ad9a-4560-aa72-9ed279f685d6 tempest-VolumesTestJSON-184146727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:51:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-58f58aba-ad9a-4560-aa72-9ed279f685d6 tempest-VolumesTestJSON-184146727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:15 devstack sudo[97066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:51:15 devstack sudo[97066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:15 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7cafb4a8-e31a-4f0e-a450-83b19b2ae22c tempest-VolumesTestJSON-184146727 None] Acquiring lock "cinder-d43728d1-9c7c-432d-9d8a-267beea6fee8-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:51:15 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7cafb4a8-e31a-4f0e-a450-83b19b2ae22c tempest-VolumesTestJSON-184146727 None] Lock "cinder-d43728d1-9c7c-432d-9d8a-267beea6fee8-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:51:16 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7cafb4a8-e31a-4f0e-a450-83b19b2ae22c tempest-VolumesTestJSON-184146727 None] Acquiring lock "cinder-quobyte-d43728d1-9c7c-432d-9d8a-267beea6fee8" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:51:16 devstack sudo[97063]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:16 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7cafb4a8-e31a-4f0e-a450-83b19b2ae22c tempest-VolumesTestJSON-184146727 None] Lock "cinder-quobyte-d43728d1-9c7c-432d-9d8a-267beea6fee8" acquired by "delete_volume" :: waited 0.025s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:51:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a5c67cf1-1bce-4a6f-aed6-93af9161badf tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4925ecc6-d381-4772-8034-7ae9e8a7e87f -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4925ecc6-d381-4772-8034-7ae9e8a7e87f.fad33c81-f760-464c-b3d9-36ee21732963" returned: 0 in 1.081s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:16 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-a5c67cf1-1bce-4a6f-aed6-93af9161badf tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4925ecc6-d381-4772-8034-7ae9e8a7e87f.fad33c81-f760-464c-b3d9-36ee21732963 is being set with open permissions: ugo+rw Jul 08 01:51:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a5c67cf1-1bce-4a6f-aed6-93af9161badf tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4925ecc6-d381-4772-8034-7ae9e8a7e87f.fad33c81-f760-464c-b3d9-36ee21732963 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:16 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d6c41b-e668-4f94-975a-816c0dfc12af]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:51:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7cafb4a8-e31a-4f0e-a450-83b19b2ae22c tempest-VolumesTestJSON-184146727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d43728d1-9c7c-432d-9d8a-267beea6fee8 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:16 devstack sudo[97071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4925ecc6-d381-4772-8034-7ae9e8a7e87f.fad33c81-f760-464c-b3d9-36ee21732963 Jul 08 01:51:16 devstack sudo[97071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:16 devstack sudo[97072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d43728d1-9c7c-432d-9d8a-267beea6fee8 Jul 08 01:51:16 devstack sudo[97072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:16 devstack sudo[97066]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-58f58aba-ad9a-4560-aa72-9ed279f685d6 tempest-VolumesTestJSON-184146727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.893s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:16 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-58f58aba-ad9a-4560-aa72-9ed279f685d6 tempest-VolumesTestJSON-184146727 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:51:16 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-58f58aba-ad9a-4560-aa72-9ed279f685d6 tempest-VolumesTestJSON-184146727 None] Deleted volume successfully. Jul 08 01:51:16 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-58f58aba-ad9a-4560-aa72-9ed279f685d6 tempest-VolumesTestJSON-184146727 None] Lock "cinder-d3f24f1c-f200-41a1-ab55-4d17466e4dcc-delete_volume" released by "delete_volume" :: held 2.911s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:51:16 devstack sudo[97071]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a5c67cf1-1bce-4a6f-aed6-93af9161badf tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4925ecc6-d381-4772-8034-7ae9e8a7e87f.fad33c81-f760-464c-b3d9-36ee21732963" returned: 0 in 0.794s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a5c67cf1-1bce-4a6f-aed6-93af9161badf tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4925ecc6-d381-4772-8034-7ae9e8a7e87f.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:16 devstack sudo[97080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4925ecc6-d381-4772-8034-7ae9e8a7e87f.info Jul 08 01:51:16 devstack sudo[97080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:17 devstack sudo[97072]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7cafb4a8-e31a-4f0e-a450-83b19b2ae22c tempest-VolumesTestJSON-184146727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d43728d1-9c7c-432d-9d8a-267beea6fee8" returned: 0 in 0.945s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7cafb4a8-e31a-4f0e-a450-83b19b2ae22c tempest-VolumesTestJSON-184146727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d43728d1-9c7c-432d-9d8a-267beea6fee8 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:17 devstack sudo[97083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d43728d1-9c7c-432d-9d8a-267beea6fee8 Jul 08 01:51:17 devstack sudo[97083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:17 devstack sudo[97083]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7cafb4a8-e31a-4f0e-a450-83b19b2ae22c tempest-VolumesTestJSON-184146727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d43728d1-9c7c-432d-9d8a-267beea6fee8" returned: 0 in 0.851s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:17 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7cafb4a8-e31a-4f0e-a450-83b19b2ae22c tempest-VolumesTestJSON-184146727 None] Lock "cinder-quobyte-d43728d1-9c7c-432d-9d8a-267beea6fee8" released by "delete_volume" :: held 1.861s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:51:17 devstack sudo[97080]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a5c67cf1-1bce-4a6f-aed6-93af9161badf tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4925ecc6-d381-4772-8034-7ae9e8a7e87f.info" returned: 0 in 1.028s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:17 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-a5c67cf1-1bce-4a6f-aed6-93af9161badf tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4925ecc6-d381-4772-8034-7ae9e8a7e87f.info is being set with open permissions: ugo+rw Jul 08 01:51:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a5c67cf1-1bce-4a6f-aed6-93af9161badf tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4925ecc6-d381-4772-8034-7ae9e8a7e87f.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:17 devstack sudo[97103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4925ecc6-d381-4772-8034-7ae9e8a7e87f.info Jul 08 01:51:17 devstack sudo[97103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:18 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-7cafb4a8-e31a-4f0e-a450-83b19b2ae22c tempest-VolumesTestJSON-184146727 None] Created reservations ['8c3bfdcc-ea5b-43de-b775-946d9bad269b', 'f6aff50a-b7f0-4b34-9293-abe248aa6079', '92540ea7-14e7-44c1-89e8-45e3844b1ad3', '70ae987c-1294-4197-8556-95260e178200'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:51:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7cafb4a8-e31a-4f0e-a450-83b19b2ae22c tempest-VolumesTestJSON-184146727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:51:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7cafb4a8-e31a-4f0e-a450-83b19b2ae22c tempest-VolumesTestJSON-184146727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:51:18 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-7cafb4a8-e31a-4f0e-a450-83b19b2ae22c tempest-VolumesTestJSON-184146727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:51:18 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-7cafb4a8-e31a-4f0e-a450-83b19b2ae22c tempest-VolumesTestJSON-184146727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:51:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7cafb4a8-e31a-4f0e-a450-83b19b2ae22c tempest-VolumesTestJSON-184146727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:51:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7cafb4a8-e31a-4f0e-a450-83b19b2ae22c tempest-VolumesTestJSON-184146727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:18 devstack sudo[97105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:51:18 devstack sudo[97105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:18 devstack sudo[97103]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a5c67cf1-1bce-4a6f-aed6-93af9161badf tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4925ecc6-d381-4772-8034-7ae9e8a7e87f.info" returned: 0 in 0.719s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-a5c67cf1-1bce-4a6f-aed6-93af9161badf tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.621s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:51:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5f62e939-6c1e-4e9c-bdcf-dfca33dba3ad tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.972s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:51:18 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-5f62e939-6c1e-4e9c-bdcf-dfca33dba3ad tempest-VolumesSnapshotTestJSON-1781941103 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:51:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-693414380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a37c8de-f711-44f6-8f58-998b8e41b9bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d35d25a53f04475397d55628d5c33338',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:51:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:51:14Z,use_quota=True,user_id='a8c972c3a0194d0399a1068466ad9ba0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:51:18 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-5f62e939-6c1e-4e9c-bdcf-dfca33dba3ad tempest-VolumesSnapshotTestJSON-1781941103 None] Creating volume 3a37c8de-f711-44f6-8f58-998b8e41b9bc {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:51:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5f62e939-6c1e-4e9c-bdcf-dfca33dba3ad tempest-VolumesSnapshotTestJSON-1781941103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:51:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5f62e939-6c1e-4e9c-bdcf-dfca33dba3ad tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:51:18 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-5f62e939-6c1e-4e9c-bdcf-dfca33dba3ad tempest-VolumesSnapshotTestJSON-1781941103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:51:18 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-5f62e939-6c1e-4e9c-bdcf-dfca33dba3ad tempest-VolumesSnapshotTestJSON-1781941103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:51:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5f62e939-6c1e-4e9c-bdcf-dfca33dba3ad tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:51:18 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-5f62e939-6c1e-4e9c-bdcf-dfca33dba3ad tempest-VolumesSnapshotTestJSON-1781941103 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:51:18 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-5f62e939-6c1e-4e9c-bdcf-dfca33dba3ad tempest-VolumesSnapshotTestJSON-1781941103 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:51:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5f62e939-6c1e-4e9c-bdcf-dfca33dba3ad tempest-VolumesSnapshotTestJSON-1781941103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3a37c8de-f711-44f6-8f58-998b8e41b9bc 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:18 devstack sudo[97109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3a37c8de-f711-44f6-8f58-998b8e41b9bc 1073741824 Jul 08 01:51:18 devstack sudo[97109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:18 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-a5c67cf1-1bce-4a6f-aed6-93af9161badf tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] Create snapshot completed successfully Jul 08 01:51:18 devstack sudo[97105]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7cafb4a8-e31a-4f0e-a450-83b19b2ae22c tempest-VolumesTestJSON-184146727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.757s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:18 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-7cafb4a8-e31a-4f0e-a450-83b19b2ae22c tempest-VolumesTestJSON-184146727 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:51:18 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-7cafb4a8-e31a-4f0e-a450-83b19b2ae22c tempest-VolumesTestJSON-184146727 None] Deleted volume successfully. Jul 08 01:51:18 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7cafb4a8-e31a-4f0e-a450-83b19b2ae22c tempest-VolumesTestJSON-184146727 None] Lock "cinder-d43728d1-9c7c-432d-9d8a-267beea6fee8-delete_volume" released by "delete_volume" :: held 2.946s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:51:19 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-707f0d5a-cefa-4c95-b63a-60c2a0968f51 tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] Acquiring lock "cinder-fad33c81-f760-464c-b3d9-36ee21732963-delete_snapshot" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:51:19 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-707f0d5a-cefa-4c95-b63a-60c2a0968f51 tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] Lock "cinder-fad33c81-f760-464c-b3d9-36ee21732963-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:51:19 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-707f0d5a-cefa-4c95-b63a-60c2a0968f51 tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] Acquiring lock "cinder-quobyte-4925ecc6-d381-4772-8034-7ae9e8a7e87f" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:51:19 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-707f0d5a-cefa-4c95-b63a-60c2a0968f51 tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] Lock "cinder-quobyte-4925ecc6-d381-4772-8034-7ae9e8a7e87f" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:51:19 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-707f0d5a-cefa-4c95-b63a-60c2a0968f51 tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] Acquiring lock "cinder-quobyte-fad33c81-f760-464c-b3d9-36ee21732963" by "_delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:51:19 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-707f0d5a-cefa-4c95-b63a-60c2a0968f51 tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] Lock "cinder-quobyte-fad33c81-f760-464c-b3d9-36ee21732963" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:51:19 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-707f0d5a-cefa-4c95-b63a-60c2a0968f51 tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] Deleting offline snapshot fad33c81-f760-464c-b3d9-36ee21732963 of volume 4925ecc6-d381-4772-8034-7ae9e8a7e87f {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:51:19 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-707f0d5a-cefa-4c95-b63a-60c2a0968f51 tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] snapshot_file for this snap is: volume-4925ecc6-d381-4772-8034-7ae9e8a7e87f.fad33c81-f760-464c-b3d9-36ee21732963 {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:51:19 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ced7e5-a2b5-406f-b79c-86c7f0a05cf5]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:51:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-707f0d5a-cefa-4c95-b63a-60c2a0968f51 tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4925ecc6-d381-4772-8034-7ae9e8a7e87f.fad33c81-f760-464c-b3d9-36ee21732963 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:19 devstack sudo[97109]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5f62e939-6c1e-4e9c-bdcf-dfca33dba3ad tempest-VolumesSnapshotTestJSON-1781941103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3a37c8de-f711-44f6-8f58-998b8e41b9bc 1073741824" returned: 0 in 1.062s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5f62e939-6c1e-4e9c-bdcf-dfca33dba3ad tempest-VolumesSnapshotTestJSON-1781941103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3a37c8de-f711-44f6-8f58-998b8e41b9bc {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:19 devstack sudo[97115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4925ecc6-d381-4772-8034-7ae9e8a7e87f.fad33c81-f760-464c-b3d9-36ee21732963 Jul 08 01:51:19 devstack sudo[97115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:19 devstack sudo[97116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3a37c8de-f711-44f6-8f58-998b8e41b9bc Jul 08 01:51:19 devstack sudo[97116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:20 devstack sudo[97116]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5f62e939-6c1e-4e9c-bdcf-dfca33dba3ad tempest-VolumesSnapshotTestJSON-1781941103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3a37c8de-f711-44f6-8f58-998b8e41b9bc" returned: 0 in 0.822s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:20 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-5f62e939-6c1e-4e9c-bdcf-dfca33dba3ad tempest-VolumesSnapshotTestJSON-1781941103 None] <== create_volume: return (1944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:51:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5f62e939-6c1e-4e9c-bdcf-dfca33dba3ad tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.947s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:51:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5f62e939-6c1e-4e9c-bdcf-dfca33dba3ad tempest-VolumesSnapshotTestJSON-1781941103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9940bf8b-7998-461c-a540-51dc8de6d52d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a37c8de-f711-44f6-8f58-998b8e41b9bc', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:51:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5f62e939-6c1e-4e9c-bdcf-dfca33dba3ad tempest-VolumesSnapshotTestJSON-1781941103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eea59ba-a0b7-4933-ba43-0e2f97048de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:51:20 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-5f62e939-6c1e-4e9c-bdcf-dfca33dba3ad tempest-VolumesSnapshotTestJSON-1781941103 None] Volume volume-3a37c8de-f711-44f6-8f58-998b8e41b9bc (3a37c8de-f711-44f6-8f58-998b8e41b9bc): created successfully Jul 08 01:51:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5f62e939-6c1e-4e9c-bdcf-dfca33dba3ad tempest-VolumesSnapshotTestJSON-1781941103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eea59ba-a0b7-4933-ba43-0e2f97048de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:51:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5f62e939-6c1e-4e9c-bdcf-dfca33dba3ad tempest-VolumesSnapshotTestJSON-1781941103 None] Flow 'volume_create_manager' (d05ebec3-ffea-4028-a815-b27ec38ee4e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:51:20 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-5f62e939-6c1e-4e9c-bdcf-dfca33dba3ad tempest-VolumesSnapshotTestJSON-1781941103 None] Created volume successfully. Jul 08 01:51:20 devstack sudo[97115]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-707f0d5a-cefa-4c95-b63a-60c2a0968f51 tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4925ecc6-d381-4772-8034-7ae9e8a7e87f.fad33c81-f760-464c-b3d9-36ee21732963" returned: 0 in 1.122s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:20 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-707f0d5a-cefa-4c95-b63a-60c2a0968f51 tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4925ecc6-d381-4772-8034-7ae9e8a7e87f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:51:20 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e800bd-0a53-4617-a10e-5e2348b84514]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:51:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-707f0d5a-cefa-4c95-b63a-60c2a0968f51 tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4925ecc6-d381-4772-8034-7ae9e8a7e87f {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:20 devstack cinder-volume[87134]: DEBUG oslo_service.periodic_task [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87134) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:51:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:51:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:51:20 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:51:20 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:51:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:51:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:20 devstack sudo[97124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:51:20 devstack sudo[97124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:20 devstack sudo[97123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4925ecc6-d381-4772-8034-7ae9e8a7e87f Jul 08 01:51:20 devstack sudo[97123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-86c540d5-9f17-434a-a1f2-30ea08e5a36d tempest-VolumesSnapshotTestJSON-1781941103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:51:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-86c540d5-9f17-434a-a1f2-30ea08e5a36d tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:51:21 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-86c540d5-9f17-434a-a1f2-30ea08e5a36d tempest-VolumesSnapshotTestJSON-1781941103 None] Creating offline snapshot 3a6b3dd6-5c08-452d-bbb3-dc37973e9524 of volume 3a37c8de-f711-44f6-8f58-998b8e41b9bc {{(pid=87134) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:51:21 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[57770ab3-1c76-4e47-bf79-f429c8b63006]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:51:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-86c540d5-9f17-434a-a1f2-30ea08e5a36d tempest-VolumesSnapshotTestJSON-1781941103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3a37c8de-f711-44f6-8f58-998b8e41b9bc {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:21 devstack sudo[97141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3a37c8de-f711-44f6-8f58-998b8e41b9bc Jul 08 01:51:21 devstack sudo[97141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:22 devstack sudo[97123]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-707f0d5a-cefa-4c95-b63a-60c2a0968f51 tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4925ecc6-d381-4772-8034-7ae9e8a7e87f" returned: 0 in 1.278s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-707f0d5a-cefa-4c95-b63a-60c2a0968f51 tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4925ecc6-d381-4772-8034-7ae9e8a7e87f.fad33c81-f760-464c-b3d9-36ee21732963 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:22 devstack sudo[97165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4925ecc6-d381-4772-8034-7ae9e8a7e87f.fad33c81-f760-464c-b3d9-36ee21732963 Jul 08 01:51:22 devstack sudo[97165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:22 devstack sudo[97124]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 1.319s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:22 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:51:22 devstack cinder-volume[87134]: DEBUG oslo_service.periodic_task [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running periodic task VolumeManager._thread_info {{(pid=87134) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:51:22 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] thread count: 28 {{(pid=87134) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:51:22 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] thread info: [<_MainThread(MainThread, started 129378964615296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87134) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:51:23 devstack sudo[97141]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:23 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-86c540d5-9f17-434a-a1f2-30ea08e5a36d tempest-VolumesSnapshotTestJSON-1781941103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3a37c8de-f711-44f6-8f58-998b8e41b9bc" returned: 0 in 1.410s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:23 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-86c540d5-9f17-434a-a1f2-30ea08e5a36d tempest-VolumesSnapshotTestJSON-1781941103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3a37c8de-f711-44f6-8f58-998b8e41b9bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3a37c8de-f711-44f6-8f58-998b8e41b9bc.3a6b3dd6-5c08-452d-bbb3-dc37973e9524 1G {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:23 devstack sudo[97191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3a37c8de-f711-44f6-8f58-998b8e41b9bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3a37c8de-f711-44f6-8f58-998b8e41b9bc.3a6b3dd6-5c08-452d-bbb3-dc37973e9524 1G Jul 08 01:51:23 devstack sudo[97191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:23 devstack sudo[97165]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:23 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-707f0d5a-cefa-4c95-b63a-60c2a0968f51 tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4925ecc6-d381-4772-8034-7ae9e8a7e87f.fad33c81-f760-464c-b3d9-36ee21732963" returned: 0 in 1.218s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:23 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-707f0d5a-cefa-4c95-b63a-60c2a0968f51 tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4925ecc6-d381-4772-8034-7ae9e8a7e87f.fad33c81-f760-464c-b3d9-36ee21732963 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:23 devstack sudo[97207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4925ecc6-d381-4772-8034-7ae9e8a7e87f.fad33c81-f760-464c-b3d9-36ee21732963 Jul 08 01:51:23 devstack sudo[97207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:23 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-fa062e9c-be09-447f-a618-301844560055 tempest-GroupsTest-1407030482 None] Group tempest-Group1-1672507263: creating Jul 08 01:51:23 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-fa062e9c-be09-447f-a618-301844560055 tempest-GroupsTest-1407030482 None] Group tempest-Group1-1672507263: created successfully Jul 08 01:51:23 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-fa062e9c-be09-447f-a618-301844560055 tempest-GroupsTest-1407030482 None] Create group completed successfully. Jul 08 01:51:24 devstack sudo[97191]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-86c540d5-9f17-434a-a1f2-30ea08e5a36d tempest-VolumesSnapshotTestJSON-1781941103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3a37c8de-f711-44f6-8f58-998b8e41b9bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3a37c8de-f711-44f6-8f58-998b8e41b9bc.3a6b3dd6-5c08-452d-bbb3-dc37973e9524 1G" returned: 0 in 1.052s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-86c540d5-9f17-434a-a1f2-30ea08e5a36d tempest-VolumesSnapshotTestJSON-1781941103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a37c8de-f711-44f6-8f58-998b8e41b9bc -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3a37c8de-f711-44f6-8f58-998b8e41b9bc.3a6b3dd6-5c08-452d-bbb3-dc37973e9524 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:24 devstack sudo[97207]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-707f0d5a-cefa-4c95-b63a-60c2a0968f51 tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4925ecc6-d381-4772-8034-7ae9e8a7e87f.fad33c81-f760-464c-b3d9-36ee21732963" returned: 0 in 0.809s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:24 devstack cinder-volume[87134]: DEBUG dbcounter [-] [87134] Writing DB stats cinder:SELECT=105,cinder:UPDATE=111,cinder:INSERT=33,cinder:DELETE=12 {{(pid=87134) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:51:24 devstack cinder-volume[87134]: DEBUG dbcounter [-] [87134] Writing DB stats cinder:SELECT=94,cinder:INSERT=24,cinder:UPDATE=114,cinder:DELETE=8 {{(pid=87134) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:51:24 devstack sudo[97219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a37c8de-f711-44f6-8f58-998b8e41b9bc -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3a37c8de-f711-44f6-8f58-998b8e41b9bc.3a6b3dd6-5c08-452d-bbb3-dc37973e9524 Jul 08 01:51:24 devstack sudo[97219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:24 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-707f0d5a-cefa-4c95-b63a-60c2a0968f51 tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] Lock "cinder-quobyte-fad33c81-f760-464c-b3d9-36ee21732963" released by "_delete_snapshot" :: held 4.573s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:51:24 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-707f0d5a-cefa-4c95-b63a-60c2a0968f51 tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] Lock "cinder-quobyte-4925ecc6-d381-4772-8034-7ae9e8a7e87f" released by "delete_snapshot" :: held 4.605s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:51:24 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-707f0d5a-cefa-4c95-b63a-60c2a0968f51 tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] Created reservations ['7ac0d31e-2869-4792-986a-2134f3349e55', '77df776b-d40b-4373-a36a-137adeebb1b2', 'c7caba5a-d9ff-42e3-ae1f-caac4a3b4acf', '1c64c66f-d94a-4bf0-9220-2589ea2f54fd'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:51:24 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-707f0d5a-cefa-4c95-b63a-60c2a0968f51 tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] Delete snapshot completed successfully. Jul 08 01:51:24 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-707f0d5a-cefa-4c95-b63a-60c2a0968f51 tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] Lock "cinder-fad33c81-f760-464c-b3d9-36ee21732963-delete_snapshot" released by "delete_snapshot" :: held 4.782s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:51:25 devstack sudo[97219]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:25 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-86c540d5-9f17-434a-a1f2-30ea08e5a36d tempest-VolumesSnapshotTestJSON-1781941103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a37c8de-f711-44f6-8f58-998b8e41b9bc -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3a37c8de-f711-44f6-8f58-998b8e41b9bc.3a6b3dd6-5c08-452d-bbb3-dc37973e9524" returned: 0 in 0.995s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:25 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-86c540d5-9f17-434a-a1f2-30ea08e5a36d tempest-VolumesSnapshotTestJSON-1781941103 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3a37c8de-f711-44f6-8f58-998b8e41b9bc.3a6b3dd6-5c08-452d-bbb3-dc37973e9524 is being set with open permissions: ugo+rw Jul 08 01:51:25 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-86c540d5-9f17-434a-a1f2-30ea08e5a36d tempest-VolumesSnapshotTestJSON-1781941103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3a37c8de-f711-44f6-8f58-998b8e41b9bc.3a6b3dd6-5c08-452d-bbb3-dc37973e9524 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:25 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7f8c534f-4574-449b-999b-9fce1b14cb6a tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] Acquiring lock "cinder-4925ecc6-d381-4772-8034-7ae9e8a7e87f-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:51:25 devstack sudo[97226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3a37c8de-f711-44f6-8f58-998b8e41b9bc.3a6b3dd6-5c08-452d-bbb3-dc37973e9524 Jul 08 01:51:25 devstack sudo[97226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:25 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7f8c534f-4574-449b-999b-9fce1b14cb6a tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] Lock "cinder-4925ecc6-d381-4772-8034-7ae9e8a7e87f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:51:25 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7f8c534f-4574-449b-999b-9fce1b14cb6a tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] Acquiring lock "cinder-quobyte-4925ecc6-d381-4772-8034-7ae9e8a7e87f" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:51:25 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7f8c534f-4574-449b-999b-9fce1b14cb6a tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] Lock "cinder-quobyte-4925ecc6-d381-4772-8034-7ae9e8a7e87f" acquired by "delete_volume" :: waited 0.033s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:51:25 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[da77102c-b993-4494-b943-2791c2fab39b]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:51:25 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7f8c534f-4574-449b-999b-9fce1b14cb6a tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4925ecc6-d381-4772-8034-7ae9e8a7e87f {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:25 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-c09961f6-17b1-42bb-b09d-cc8f2749399a tempest-GroupsTest-1407030482 None] Group tempest-Group2-1211350530: creating Jul 08 01:51:25 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-c09961f6-17b1-42bb-b09d-cc8f2749399a tempest-GroupsTest-1407030482 None] Group tempest-Group2-1211350530: created successfully Jul 08 01:51:25 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-c09961f6-17b1-42bb-b09d-cc8f2749399a tempest-GroupsTest-1407030482 None] Create group completed successfully. Jul 08 01:51:25 devstack sudo[97228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4925ecc6-d381-4772-8034-7ae9e8a7e87f Jul 08 01:51:25 devstack sudo[97228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:26 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-2555a293-fb8f-4d23-b215-6b5bac231595 tempest-VolumesActionsTest-11317694 None] Acquiring lock "cinder-05100268-f3f4-4d59-a006-e1cd31dd0392" by "attach_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:51:26 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-2555a293-fb8f-4d23-b215-6b5bac231595 tempest-VolumesActionsTest-11317694 None] Lock "cinder-05100268-f3f4-4d59-a006-e1cd31dd0392" acquired by "attach_volume" :: waited 0.030s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:51:26 devstack sudo[97226]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:26 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-2555a293-fb8f-4d23-b215-6b5bac231595 tempest-VolumesActionsTest-11317694 None] Attaching volume 05100268-f3f4-4d59-a006-e1cd31dd0392 to instance 4dfca8ad-a5a1-4153-80d2-fb1aaa116de6 at mountpoint /dev/vdb on host None. Jul 08 01:51:26 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-86c540d5-9f17-434a-a1f2-30ea08e5a36d tempest-VolumesSnapshotTestJSON-1781941103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3a37c8de-f711-44f6-8f58-998b8e41b9bc.3a6b3dd6-5c08-452d-bbb3-dc37973e9524" returned: 0 in 1.324s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:26 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-2555a293-fb8f-4d23-b215-6b5bac231595 tempest-VolumesActionsTest-11317694 None] Attach volume completed successfully. Jul 08 01:51:26 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-2555a293-fb8f-4d23-b215-6b5bac231595 tempest-VolumesActionsTest-11317694 None] Lock "cinder-05100268-f3f4-4d59-a006-e1cd31dd0392" released by "attach_volume" :: held 0.178s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:51:26 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-86c540d5-9f17-434a-a1f2-30ea08e5a36d tempest-VolumesSnapshotTestJSON-1781941103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3a37c8de-f711-44f6-8f58-998b8e41b9bc.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:26 devstack sudo[97268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3a37c8de-f711-44f6-8f58-998b8e41b9bc.info Jul 08 01:51:26 devstack sudo[97268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:26 devstack sudo[97228]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:26 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7f8c534f-4574-449b-999b-9fce1b14cb6a tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4925ecc6-d381-4772-8034-7ae9e8a7e87f" returned: 0 in 1.606s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:26 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7f8c534f-4574-449b-999b-9fce1b14cb6a tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4925ecc6-d381-4772-8034-7ae9e8a7e87f {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:27 devstack sudo[97273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4925ecc6-d381-4772-8034-7ae9e8a7e87f Jul 08 01:51:27 devstack sudo[97273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:27 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-30f1c97c-0959-4fbb-911f-1407725f2d7a tempest-VolumesActionsTest-11317694 None] Acquiring lock "cinder-05100268-f3f4-4d59-a006-e1cd31dd0392-detach_volume" by "detach_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:51:27 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-30f1c97c-0959-4fbb-911f-1407725f2d7a tempest-VolumesActionsTest-11317694 None] Lock "cinder-05100268-f3f4-4d59-a006-e1cd31dd0392-detach_volume" acquired by "detach_volume" :: waited 0.040s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:51:27 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-30f1c97c-0959-4fbb-911f-1407725f2d7a tempest-VolumesActionsTest-11317694 None] Detaching volume 05100268-f3f4-4d59-a006-e1cd31dd0392 from instance 4dfca8ad-a5a1-4153-80d2-fb1aaa116de6. Jul 08 01:51:27 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-30f1c97c-0959-4fbb-911f-1407725f2d7a tempest-VolumesActionsTest-11317694 None] Detach volume completed successfully. Jul 08 01:51:27 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-30f1c97c-0959-4fbb-911f-1407725f2d7a tempest-VolumesActionsTest-11317694 None] Lock "cinder-05100268-f3f4-4d59-a006-e1cd31dd0392-detach_volume" released by "detach_volume" :: held 0.155s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:51:27 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-7987f089-dd05-4376-85bc-50769c90174f tempest-GroupsTest-1407030482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:51:27 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-7987f089-dd05-4376-85bc-50769c90174f tempest-GroupsTest-1407030482 None] Flow 'volume_create_manager' (f96cc097-f08a-4431-b5ad-e7280654c015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:51:27 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-7987f089-dd05-4376-85bc-50769c90174f tempest-GroupsTest-1407030482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (987a83a5-8159-4864-bfb1-1f40dfaca717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:51:27 devstack sudo[97268]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:27 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-86c540d5-9f17-434a-a1f2-30ea08e5a36d tempest-VolumesSnapshotTestJSON-1781941103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3a37c8de-f711-44f6-8f58-998b8e41b9bc.info" returned: 0 in 1.090s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:27 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-86c540d5-9f17-434a-a1f2-30ea08e5a36d tempest-VolumesSnapshotTestJSON-1781941103 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3a37c8de-f711-44f6-8f58-998b8e41b9bc.info is being set with open permissions: ugo+rw Jul 08 01:51:27 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-86c540d5-9f17-434a-a1f2-30ea08e5a36d tempest-VolumesSnapshotTestJSON-1781941103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3a37c8de-f711-44f6-8f58-998b8e41b9bc.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:27 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-7987f089-dd05-4376-85bc-50769c90174f tempest-GroupsTest-1407030482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (987a83a5-8159-4864-bfb1-1f40dfaca717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:51:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1545664695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3be65ad0-42c7-44a0-8b18-07f87ac22470,host='devstack@QuobyteHD#QuobyteHD',id=8c1fee6c-0c9b-4c99-9e58-3a0d8ce1fe41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57e472f0b0e74e7495897c357c7bfa02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:51:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:51:27Z,use_quota=True,user_id='dd782e22763049ce8de7deda77fecf2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7ca5e466-66bb-461b-9adf-0aefcc6e11bb),volume_type_id=7ca5e466-66bb-461b-9adf-0aefcc6e11bb)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:51:27 devstack sudo[97276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3a37c8de-f711-44f6-8f58-998b8e41b9bc.info Jul 08 01:51:27 devstack sudo[97276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:27 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-7987f089-dd05-4376-85bc-50769c90174f tempest-GroupsTest-1407030482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (735a3bb2-a2eb-4348-ad64-b618ac4d3a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:51:27 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-7987f089-dd05-4376-85bc-50769c90174f tempest-GroupsTest-1407030482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (735a3bb2-a2eb-4348-ad64-b618ac4d3a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:51:27 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-7987f089-dd05-4376-85bc-50769c90174f tempest-GroupsTest-1407030482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56f5ad40-e17f-4101-9998-389271fb91e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:51:27 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-7987f089-dd05-4376-85bc-50769c90174f tempest-GroupsTest-1407030482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56f5ad40-e17f-4101-9998-389271fb91e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c1fee6c-0c9b-4c99-9e58-3a0d8ce1fe41', 'volume_name': 'volume-8c1fee6c-0c9b-4c99-9e58-3a0d8ce1fe41', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:51:27 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-7987f089-dd05-4376-85bc-50769c90174f tempest-GroupsTest-1407030482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d472676a-daa6-4e2e-88ba-fa835bc0198b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:51:27 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-7987f089-dd05-4376-85bc-50769c90174f tempest-GroupsTest-1407030482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d472676a-daa6-4e2e-88ba-fa835bc0198b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:51:27 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-7987f089-dd05-4376-85bc-50769c90174f tempest-GroupsTest-1407030482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c52cd4c3-7870-4d0f-ab88-10902dc5f4b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:51:27 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-7987f089-dd05-4376-85bc-50769c90174f tempest-GroupsTest-1407030482 None] Volume 8c1fee6c-0c9b-4c99-9e58-3a0d8ce1fe41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c1fee6c-0c9b-4c99-9e58-3a0d8ce1fe41', 'volume_size': 1} Jul 08 01:51:27 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7987f089-dd05-4376-85bc-50769c90174f tempest-GroupsTest-1407030482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:51:28 devstack sudo[97273]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:28 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7f8c534f-4574-449b-999b-9fce1b14cb6a tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4925ecc6-d381-4772-8034-7ae9e8a7e87f" returned: 0 in 1.165s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:28 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7f8c534f-4574-449b-999b-9fce1b14cb6a tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] Lock "cinder-quobyte-4925ecc6-d381-4772-8034-7ae9e8a7e87f" released by "delete_volume" :: held 2.890s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:51:28 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-7f8c534f-4574-449b-999b-9fce1b14cb6a tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] Created reservations ['3cf332b0-3630-44e0-b501-f327d249e05a', '21543771-83ca-4cd6-882e-b90a104f4772', '2410c4fa-bb52-45eb-9dd0-142c3b001c4f', '37a06f48-2aea-4c8e-9301-104ec8df7768'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:51:28 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7f8c534f-4574-449b-999b-9fce1b14cb6a tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:51:28 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7f8c534f-4574-449b-999b-9fce1b14cb6a tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:51:28 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-7f8c534f-4574-449b-999b-9fce1b14cb6a tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:51:28 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-7f8c534f-4574-449b-999b-9fce1b14cb6a tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:51:28 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7f8c534f-4574-449b-999b-9fce1b14cb6a tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:51:28 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7f8c534f-4574-449b-999b-9fce1b14cb6a tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:28 devstack sudo[97279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:51:28 devstack sudo[97279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:28 devstack sudo[97276]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:28 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-86c540d5-9f17-434a-a1f2-30ea08e5a36d tempest-VolumesSnapshotTestJSON-1781941103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3a37c8de-f711-44f6-8f58-998b8e41b9bc.info" returned: 0 in 0.829s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:28 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-86c540d5-9f17-434a-a1f2-30ea08e5a36d tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.010s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:51:28 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7987f089-dd05-4376-85bc-50769c90174f tempest-GroupsTest-1407030482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.763s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:51:28 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-7987f089-dd05-4376-85bc-50769c90174f tempest-GroupsTest-1407030482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3be65ad0-42c7-44a0-8b18-07f87ac22470,created_at=2026-07-07T23:51:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1545664695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3be65ad0-42c7-44a0-8b18-07f87ac22470,host='devstack@QuobyteHD#QuobyteHD',id=8c1fee6c-0c9b-4c99-9e58-3a0d8ce1fe41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57e472f0b0e74e7495897c357c7bfa02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:51:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:51:27Z,use_quota=True,user_id='dd782e22763049ce8de7deda77fecf2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7ca5e466-66bb-461b-9adf-0aefcc6e11bb),volume_type_id=7ca5e466-66bb-461b-9adf-0aefcc6e11bb)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:51:28 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-7987f089-dd05-4376-85bc-50769c90174f tempest-GroupsTest-1407030482 None] Creating volume 8c1fee6c-0c9b-4c99-9e58-3a0d8ce1fe41 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:51:28 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7987f089-dd05-4376-85bc-50769c90174f tempest-GroupsTest-1407030482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:51:28 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7987f089-dd05-4376-85bc-50769c90174f tempest-GroupsTest-1407030482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:51:28 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-7987f089-dd05-4376-85bc-50769c90174f tempest-GroupsTest-1407030482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:51:28 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-7987f089-dd05-4376-85bc-50769c90174f tempest-GroupsTest-1407030482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:51:28 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7987f089-dd05-4376-85bc-50769c90174f tempest-GroupsTest-1407030482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:51:28 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-7987f089-dd05-4376-85bc-50769c90174f tempest-GroupsTest-1407030482 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:51:28 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-7987f089-dd05-4376-85bc-50769c90174f tempest-GroupsTest-1407030482 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:51:28 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7987f089-dd05-4376-85bc-50769c90174f tempest-GroupsTest-1407030482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8c1fee6c-0c9b-4c99-9e58-3a0d8ce1fe41 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:28 devstack sudo[97282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8c1fee6c-0c9b-4c99-9e58-3a0d8ce1fe41 1073741824 Jul 08 01:51:28 devstack sudo[97282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:28 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-86c540d5-9f17-434a-a1f2-30ea08e5a36d tempest-VolumesSnapshotTestJSON-1781941103 None] Create snapshot completed successfully Jul 08 01:51:29 devstack sudo[97279]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7f8c534f-4574-449b-999b-9fce1b14cb6a tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.937s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:29 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-7f8c534f-4574-449b-999b-9fce1b14cb6a tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:51:29 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-7f8c534f-4574-449b-999b-9fce1b14cb6a tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] Deleted volume successfully. Jul 08 01:51:29 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7f8c534f-4574-449b-999b-9fce1b14cb6a tempest-VolumesSnapshotNegativeTestJSON-1651940280 None] Lock "cinder-4925ecc6-d381-4772-8034-7ae9e8a7e87f-delete_volume" released by "delete_volume" :: held 4.143s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:51:29 devstack sudo[97282]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7987f089-dd05-4376-85bc-50769c90174f tempest-GroupsTest-1407030482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8c1fee6c-0c9b-4c99-9e58-3a0d8ce1fe41 1073741824" returned: 0 in 1.198s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7987f089-dd05-4376-85bc-50769c90174f tempest-GroupsTest-1407030482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8c1fee6c-0c9b-4c99-9e58-3a0d8ce1fe41 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:29 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-00ecb2fb-e061-4a50-8dc7-b725c95bdb42 tempest-VolumesSnapshotTestJSON-1781941103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:51:29 devstack sudo[97294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8c1fee6c-0c9b-4c99-9e58-3a0d8ce1fe41 Jul 08 01:51:29 devstack sudo[97294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:29 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-00ecb2fb-e061-4a50-8dc7-b725c95bdb42 tempest-VolumesSnapshotTestJSON-1781941103 None] Flow 'volume_create_manager' (31377653-01da-4171-83df-2a12ffda6ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:51:29 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-00ecb2fb-e061-4a50-8dc7-b725c95bdb42 tempest-VolumesSnapshotTestJSON-1781941103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2025dab7-562b-4614-8f84-1c440f3d5e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:51:30 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-00ecb2fb-e061-4a50-8dc7-b725c95bdb42 tempest-VolumesSnapshotTestJSON-1781941103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2025dab7-562b-4614-8f84-1c440f3d5e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:51:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1820019659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a9223f8-897b-4be7-9487-b932c517c953,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d35d25a53f04475397d55628d5c33338',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:51:30Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=3a6b3dd6-5c08-452d-bbb3-dc37973e9524,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:51:30Z,use_quota=True,user_id='a8c972c3a0194d0399a1068466ad9ba0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:51:30 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-00ecb2fb-e061-4a50-8dc7-b725c95bdb42 tempest-VolumesSnapshotTestJSON-1781941103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (606c3eec-1e1c-42d6-bcdd-3dbf87e1eaeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:51:30 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-00ecb2fb-e061-4a50-8dc7-b725c95bdb42 tempest-VolumesSnapshotTestJSON-1781941103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (606c3eec-1e1c-42d6-bcdd-3dbf87e1eaeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:51:30 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-00ecb2fb-e061-4a50-8dc7-b725c95bdb42 tempest-VolumesSnapshotTestJSON-1781941103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d04c7b7d-d6d1-477d-a5ba-84c3156deff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:51:30 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-00ecb2fb-e061-4a50-8dc7-b725c95bdb42 tempest-VolumesSnapshotTestJSON-1781941103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d04c7b7d-d6d1-477d-a5ba-84c3156deff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0a9223f8-897b-4be7-9487-b932c517c953', 'volume_name': 'volume-0a9223f8-897b-4be7-9487-b932c517c953', 'volume_size': 2, 'snapshot_id': '3a6b3dd6-5c08-452d-bbb3-dc37973e9524'}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:51:30 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-00ecb2fb-e061-4a50-8dc7-b725c95bdb42 tempest-VolumesSnapshotTestJSON-1781941103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4fbcf3e-f241-4208-b2ce-d807efde7bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:51:30 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-00ecb2fb-e061-4a50-8dc7-b725c95bdb42 tempest-VolumesSnapshotTestJSON-1781941103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4fbcf3e-f241-4208-b2ce-d807efde7bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:51:30 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-00ecb2fb-e061-4a50-8dc7-b725c95bdb42 tempest-VolumesSnapshotTestJSON-1781941103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (537540c6-f388-41c2-aa8e-4fab884d0c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:51:30 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-00ecb2fb-e061-4a50-8dc7-b725c95bdb42 tempest-VolumesSnapshotTestJSON-1781941103 None] Volume 0a9223f8-897b-4be7-9487-b932c517c953: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0a9223f8-897b-4be7-9487-b932c517c953', 'volume_size': 2, 'snapshot_id': '3a6b3dd6-5c08-452d-bbb3-dc37973e9524'} Jul 08 01:51:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-00ecb2fb-e061-4a50-8dc7-b725c95bdb42 tempest-VolumesSnapshotTestJSON-1781941103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:51:30 devstack sudo[97294]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7987f089-dd05-4376-85bc-50769c90174f tempest-GroupsTest-1407030482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8c1fee6c-0c9b-4c99-9e58-3a0d8ce1fe41" returned: 0 in 0.816s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:30 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-7987f089-dd05-4376-85bc-50769c90174f tempest-GroupsTest-1407030482 None] <== create_volume: return (2099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:51:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7987f089-dd05-4376-85bc-50769c90174f tempest-GroupsTest-1407030482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.102s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:51:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-00ecb2fb-e061-4a50-8dc7-b725c95bdb42 tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.531s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:51:30 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-00ecb2fb-e061-4a50-8dc7-b725c95bdb42 tempest-VolumesSnapshotTestJSON-1781941103 None] Acquiring lock "cinder-quobyte-3a6b3dd6-5c08-452d-bbb3-dc37973e9524-0a9223f8-897b-4be7-9487-b932c517c953" by "_create_volume_from_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:51:30 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-7987f089-dd05-4376-85bc-50769c90174f tempest-GroupsTest-1407030482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c52cd4c3-7870-4d0f-ab88-10902dc5f4b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c1fee6c-0c9b-4c99-9e58-3a0d8ce1fe41', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:51:30 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-7987f089-dd05-4376-85bc-50769c90174f tempest-GroupsTest-1407030482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b8e115f-db3b-47e3-84a0-6d501a5aee18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:51:30 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-00ecb2fb-e061-4a50-8dc7-b725c95bdb42 tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "cinder-quobyte-3a6b3dd6-5c08-452d-bbb3-dc37973e9524-0a9223f8-897b-4be7-9487-b932c517c953" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:51:30 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-00ecb2fb-e061-4a50-8dc7-b725c95bdb42 tempest-VolumesSnapshotTestJSON-1781941103 None] Creating volume 0a9223f8-897b-4be7-9487-b932c517c953 from snapshot 3a6b3dd6-5c08-452d-bbb3-dc37973e9524 {{(pid=87134) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 01:51:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-00ecb2fb-e061-4a50-8dc7-b725c95bdb42 tempest-VolumesSnapshotTestJSON-1781941103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:51:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-00ecb2fb-e061-4a50-8dc7-b725c95bdb42 tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:51:30 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-00ecb2fb-e061-4a50-8dc7-b725c95bdb42 tempest-VolumesSnapshotTestJSON-1781941103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:51:30 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-00ecb2fb-e061-4a50-8dc7-b725c95bdb42 tempest-VolumesSnapshotTestJSON-1781941103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:51:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-00ecb2fb-e061-4a50-8dc7-b725c95bdb42 tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:51:30 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-00ecb2fb-e061-4a50-8dc7-b725c95bdb42 tempest-VolumesSnapshotTestJSON-1781941103 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:51:30 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-00ecb2fb-e061-4a50-8dc7-b725c95bdb42 tempest-VolumesSnapshotTestJSON-1781941103 None] Acquiring lock "cinder-quobyte-0a9223f8-897b-4be7-9487-b932c517c953" by "_copy_volume_from_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:51:30 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-7987f089-dd05-4376-85bc-50769c90174f tempest-GroupsTest-1407030482 None] Volume volume-8c1fee6c-0c9b-4c99-9e58-3a0d8ce1fe41 (8c1fee6c-0c9b-4c99-9e58-3a0d8ce1fe41): created successfully Jul 08 01:51:30 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-7987f089-dd05-4376-85bc-50769c90174f tempest-GroupsTest-1407030482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b8e115f-db3b-47e3-84a0-6d501a5aee18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:51:30 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-7987f089-dd05-4376-85bc-50769c90174f tempest-GroupsTest-1407030482 None] Flow 'volume_create_manager' (f96cc097-f08a-4431-b5ad-e7280654c015) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:51:30 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-00ecb2fb-e061-4a50-8dc7-b725c95bdb42 tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "cinder-quobyte-0a9223f8-897b-4be7-9487-b932c517c953" acquired by "_copy_volume_from_snapshot" :: waited 0.044s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:51:30 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-00ecb2fb-e061-4a50-8dc7-b725c95bdb42 tempest-VolumesSnapshotTestJSON-1781941103 None] snapshot: 3a6b3dd6-5c08-452d-bbb3-dc37973e9524, volume: 0a9223f8-897b-4be7-9487-b932c517c953, {{(pid=87134) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 01:51:30 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-7987f089-dd05-4376-85bc-50769c90174f tempest-GroupsTest-1407030482 None] Created volume successfully. Jul 08 01:51:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-00ecb2fb-e061-4a50-8dc7-b725c95bdb42 tempest-VolumesSnapshotTestJSON-1781941103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:51:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-00ecb2fb-e061-4a50-8dc7-b725c95bdb42 tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:51:30 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-00ecb2fb-e061-4a50-8dc7-b725c95bdb42 tempest-VolumesSnapshotTestJSON-1781941103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:51:30 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-00ecb2fb-e061-4a50-8dc7-b725c95bdb42 tempest-VolumesSnapshotTestJSON-1781941103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:51:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-00ecb2fb-e061-4a50-8dc7-b725c95bdb42 tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:51:30 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7fc1ed0-5186-4d62-8b18-94da575cec64]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:51:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-00ecb2fb-e061-4a50-8dc7-b725c95bdb42 tempest-VolumesSnapshotTestJSON-1781941103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3a37c8de-f711-44f6-8f58-998b8e41b9bc.3a6b3dd6-5c08-452d-bbb3-dc37973e9524 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:31 devstack sudo[97319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3a37c8de-f711-44f6-8f58-998b8e41b9bc.3a6b3dd6-5c08-452d-bbb3-dc37973e9524 Jul 08 01:51:31 devstack sudo[97319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:31 devstack sudo[97319]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-00ecb2fb-e061-4a50-8dc7-b725c95bdb42 tempest-VolumesSnapshotTestJSON-1781941103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3a37c8de-f711-44f6-8f58-998b8e41b9bc.3a6b3dd6-5c08-452d-bbb3-dc37973e9524" returned: 0 in 1.097s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:31 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-00ecb2fb-e061-4a50-8dc7-b725c95bdb42 tempest-VolumesSnapshotTestJSON-1781941103 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a37c8de-f711-44f6-8f58-998b8e41b9bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:51:31 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-00ecb2fb-e061-4a50-8dc7-b725c95bdb42 tempest-VolumesSnapshotTestJSON-1781941103 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3a37c8de-f711-44f6-8f58-998b8e41b9bc {{(pid=87134) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 01:51:31 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-00ecb2fb-e061-4a50-8dc7-b725c95bdb42 tempest-VolumesSnapshotTestJSON-1781941103 None] Creating direct copy from snapshot {{(pid=87134) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 01:51:31 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[afef2b28-53bc-484e-9c6b-becb7c9b4943]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:51:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-00ecb2fb-e061-4a50-8dc7-b725c95bdb42 tempest-VolumesSnapshotTestJSON-1781941103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3a37c8de-f711-44f6-8f58-998b8e41b9bc {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:32 devstack sudo[97326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3a37c8de-f711-44f6-8f58-998b8e41b9bc Jul 08 01:51:32 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-f9a25ef3-ebed-45f0-8903-3206db93c428 tempest-GroupsTest-1407030482 None] Acquiring lock "cinder-quobyte-8c1fee6c-0c9b-4c99-9e58-3a0d8ce1fe41" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:51:32 devstack sudo[97326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:32 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-f9a25ef3-ebed-45f0-8903-3206db93c428 tempest-GroupsTest-1407030482 None] Lock "cinder-quobyte-8c1fee6c-0c9b-4c99-9e58-3a0d8ce1fe41" acquired by "delete_volume" :: waited 0.023s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:51:32 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[047744d9-b228-41f3-8869-0265a86f79b7]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:51:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f9a25ef3-ebed-45f0-8903-3206db93c428 tempest-GroupsTest-1407030482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8c1fee6c-0c9b-4c99-9e58-3a0d8ce1fe41 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:32 devstack sudo[97328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8c1fee6c-0c9b-4c99-9e58-3a0d8ce1fe41 Jul 08 01:51:32 devstack sudo[97328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:33 devstack sudo[97326]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-00ecb2fb-e061-4a50-8dc7-b725c95bdb42 tempest-VolumesSnapshotTestJSON-1781941103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3a37c8de-f711-44f6-8f58-998b8e41b9bc" returned: 0 in 1.084s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:33 devstack cinder-volume[87134]: DEBUG cinder.utils [None req-00ecb2fb-e061-4a50-8dc7-b725c95bdb42 tempest-VolumesSnapshotTestJSON-1781941103 None] Path /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0a9223f8-897b-4be7-9487-b932c517c953 not found in is_blk_device check {{(pid=87134) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 01:51:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-00ecb2fb-e061-4a50-8dc7-b725c95bdb42 tempest-VolumesSnapshotTestJSON-1781941103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3a37c8de-f711-44f6-8f58-998b8e41b9bc /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0a9223f8-897b-4be7-9487-b932c517c953 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:33 devstack sudo[97336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3a37c8de-f711-44f6-8f58-998b8e41b9bc /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0a9223f8-897b-4be7-9487-b932c517c953 Jul 08 01:51:33 devstack sudo[97336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:33 devstack sudo[97328]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f9a25ef3-ebed-45f0-8903-3206db93c428 tempest-GroupsTest-1407030482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8c1fee6c-0c9b-4c99-9e58-3a0d8ce1fe41" returned: 0 in 1.080s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f9a25ef3-ebed-45f0-8903-3206db93c428 tempest-GroupsTest-1407030482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8c1fee6c-0c9b-4c99-9e58-3a0d8ce1fe41 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:33 devstack sudo[97339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8c1fee6c-0c9b-4c99-9e58-3a0d8ce1fe41 Jul 08 01:51:33 devstack sudo[97339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:34 devstack sudo[97339]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f9a25ef3-ebed-45f0-8903-3206db93c428 tempest-GroupsTest-1407030482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8c1fee6c-0c9b-4c99-9e58-3a0d8ce1fe41" returned: 0 in 0.864s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:34 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-f9a25ef3-ebed-45f0-8903-3206db93c428 tempest-GroupsTest-1407030482 None] Lock "cinder-quobyte-8c1fee6c-0c9b-4c99-9e58-3a0d8ce1fe41" released by "delete_volume" :: held 2.008s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:51:34 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-f9a25ef3-ebed-45f0-8903-3206db93c428 tempest-GroupsTest-1407030482 None] Created reservations ['c1e6ab1b-073b-4231-86f4-8089e9f51a69'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:51:34 devstack cinder-volume[87134]: WARNING cinder.quota [None req-f9a25ef3-ebed-45f0-8903-3206db93c428 tempest-GroupsTest-1407030482 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-820008979 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-820008979, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:51:34 devstack cinder-volume[87134]: WARNING cinder.quota [None req-f9a25ef3-ebed-45f0-8903-3206db93c428 tempest-GroupsTest-1407030482 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-820008979 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-820008979, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:51:34 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-f9a25ef3-ebed-45f0-8903-3206db93c428 tempest-GroupsTest-1407030482 None] Created reservations ['7f457aa1-edb4-49fa-a0e4-946661a30919', 'd8847b14-5e9c-4772-9814-0d71a8b4c7fe', '5003bd5b-0327-4750-a63a-2b505a184db7', 'daa8b6b5-2e4f-43f0-aaa1-bd05691e16a2'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:51:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-f9a25ef3-ebed-45f0-8903-3206db93c428 tempest-GroupsTest-1407030482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:51:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-f9a25ef3-ebed-45f0-8903-3206db93c428 tempest-GroupsTest-1407030482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:51:34 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-f9a25ef3-ebed-45f0-8903-3206db93c428 tempest-GroupsTest-1407030482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:51:34 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-f9a25ef3-ebed-45f0-8903-3206db93c428 tempest-GroupsTest-1407030482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:51:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-f9a25ef3-ebed-45f0-8903-3206db93c428 tempest-GroupsTest-1407030482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:51:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f9a25ef3-ebed-45f0-8903-3206db93c428 tempest-GroupsTest-1407030482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:34 devstack sudo[97352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:51:34 devstack sudo[97352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:36 devstack sudo[97352]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f9a25ef3-ebed-45f0-8903-3206db93c428 tempest-GroupsTest-1407030482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 1.414s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:36 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-f9a25ef3-ebed-45f0-8903-3206db93c428 tempest-GroupsTest-1407030482 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:51:36 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-f9a25ef3-ebed-45f0-8903-3206db93c428 tempest-GroupsTest-1407030482 None] Delete group completed successfully. Jul 08 01:51:36 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-06a7d9ab-335f-4045-9a84-8fd769ea22dd tempest-GroupsTest-1407030482 None] Created reservations ['d347c139-cffa-496f-9066-f931dbe84bb6'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:51:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-06a7d9ab-335f-4045-9a84-8fd769ea22dd tempest-GroupsTest-1407030482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:51:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-06a7d9ab-335f-4045-9a84-8fd769ea22dd tempest-GroupsTest-1407030482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:51:36 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-06a7d9ab-335f-4045-9a84-8fd769ea22dd tempest-GroupsTest-1407030482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:51:36 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-06a7d9ab-335f-4045-9a84-8fd769ea22dd tempest-GroupsTest-1407030482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:51:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-06a7d9ab-335f-4045-9a84-8fd769ea22dd tempest-GroupsTest-1407030482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:51:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-06a7d9ab-335f-4045-9a84-8fd769ea22dd tempest-GroupsTest-1407030482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:36 devstack sudo[97356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:51:36 devstack sudo[97356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:37 devstack sudo[97356]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-06a7d9ab-335f-4045-9a84-8fd769ea22dd tempest-GroupsTest-1407030482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 1.056s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:37 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-06a7d9ab-335f-4045-9a84-8fd769ea22dd tempest-GroupsTest-1407030482 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:51:37 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-06a7d9ab-335f-4045-9a84-8fd769ea22dd tempest-GroupsTest-1407030482 None] Delete group completed successfully. Jul 08 01:51:39 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-35a8add1-c498-4bba-a4ad-6a8583744d60 tempest-GroupsTest-1407030482 None] Group tempest-GroupsTest-Group-435585233: creating Jul 08 01:51:39 devstack sudo[97336]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-00ecb2fb-e061-4a50-8dc7-b725c95bdb42 tempest-VolumesSnapshotTestJSON-1781941103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3a37c8de-f711-44f6-8f58-998b8e41b9bc /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0a9223f8-897b-4be7-9487-b932c517c953" returned: 0 in 6.677s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:39 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[6989fb1b-dc09-4bae-aee2-4e40cb82745c]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:51:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-00ecb2fb-e061-4a50-8dc7-b725c95bdb42 tempest-VolumesSnapshotTestJSON-1781941103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3a37c8de-f711-44f6-8f58-998b8e41b9bc {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:39 devstack sudo[97359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3a37c8de-f711-44f6-8f58-998b8e41b9bc Jul 08 01:51:39 devstack sudo[97359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:39 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-35a8add1-c498-4bba-a4ad-6a8583744d60 tempest-GroupsTest-1407030482 None] Group tempest-GroupsTest-Group-435585233: created successfully Jul 08 01:51:39 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-35a8add1-c498-4bba-a4ad-6a8583744d60 tempest-GroupsTest-1407030482 None] Create group completed successfully. Jul 08 01:51:40 devstack sudo[97359]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-00ecb2fb-e061-4a50-8dc7-b725c95bdb42 tempest-VolumesSnapshotTestJSON-1781941103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3a37c8de-f711-44f6-8f58-998b8e41b9bc" returned: 0 in 0.965s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:40 devstack cinder-volume[87134]: DEBUG cinder.image.image_utils [None req-00ecb2fb-e061-4a50-8dc7-b725c95bdb42 tempest-VolumesSnapshotTestJSON-1781941103 None] Image conversion details: src /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3a37c8de-f711-44f6-8f58-998b8e41b9bc, size 1024.00 MB, duration 6.68 sec, destination /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0a9223f8-897b-4be7-9487-b932c517c953 {{(pid=87134) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:51:40 devstack cinder-volume[87134]: INFO cinder.image.image_utils [None req-00ecb2fb-e061-4a50-8dc7-b725c95bdb42 tempest-VolumesSnapshotTestJSON-1781941103 None] Converted 1024.00 MB image at 153.34 MB/s Jul 08 01:51:40 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-00ecb2fb-e061-4a50-8dc7-b725c95bdb42 tempest-VolumesSnapshotTestJSON-1781941103 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0a9223f8-897b-4be7-9487-b932c517c953 is being set with open permissions: ugo+rw Jul 08 01:51:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-00ecb2fb-e061-4a50-8dc7-b725c95bdb42 tempest-VolumesSnapshotTestJSON-1781941103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0a9223f8-897b-4be7-9487-b932c517c953 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:40 devstack sudo[97364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0a9223f8-897b-4be7-9487-b932c517c953 Jul 08 01:51:40 devstack sudo[97364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-05c8e5f8-e6f2-46a0-ba70-d7a999fa64fe tempest-VolumesActionsTest-11317694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:51:41 devstack sudo[97364]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-00ecb2fb-e061-4a50-8dc7-b725c95bdb42 tempest-VolumesSnapshotTestJSON-1781941103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0a9223f8-897b-4be7-9487-b932c517c953" returned: 0 in 0.642s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:41 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-00ecb2fb-e061-4a50-8dc7-b725c95bdb42 tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "cinder-quobyte-0a9223f8-897b-4be7-9487-b932c517c953" released by "_copy_volume_from_snapshot" :: held 10.643s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:51:41 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-00ecb2fb-e061-4a50-8dc7-b725c95bdb42 tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "cinder-quobyte-3a6b3dd6-5c08-452d-bbb3-dc37973e9524-0a9223f8-897b-4be7-9487-b932c517c953" released by "_create_volume_from_snapshot" :: held 10.715s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:51:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-00ecb2fb-e061-4a50-8dc7-b725c95bdb42 tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.750s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:51:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-05c8e5f8-e6f2-46a0-ba70-d7a999fa64fe tempest-VolumesActionsTest-11317694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.446s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:51:41 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7acb6da-aa2e-4efb-abda-ffc3eeff5a32]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:51:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-05c8e5f8-e6f2-46a0-ba70-d7a999fa64fe tempest-VolumesActionsTest-11317694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-05100268-f3f4-4d59-a006-e1cd31dd0392 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:41 devstack sudo[97367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-05100268-f3f4-4d59-a006-e1cd31dd0392 Jul 08 01:51:41 devstack sudo[97367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:42 devstack sudo[97367]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-05c8e5f8-e6f2-46a0-ba70-d7a999fa64fe tempest-VolumesActionsTest-11317694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-05100268-f3f4-4d59-a006-e1cd31dd0392" returned: 0 in 0.746s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:42 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d07e597-4ea6-40c5-8b10-77eed0795239]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:51:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-05c8e5f8-e6f2-46a0-ba70-d7a999fa64fe tempest-VolumesActionsTest-11317694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-05100268-f3f4-4d59-a006-e1cd31dd0392 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:42 devstack sudo[97372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-05100268-f3f4-4d59-a006-e1cd31dd0392 Jul 08 01:51:42 devstack sudo[97372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:42 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-00ecb2fb-e061-4a50-8dc7-b725c95bdb42 tempest-VolumesSnapshotTestJSON-1781941103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (537540c6-f388-41c2-aa8e-4fab884d0c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a9223f8-897b-4be7-9487-b932c517c953', 'volume_size': 2, 'snapshot_id': '3a6b3dd6-5c08-452d-bbb3-dc37973e9524'}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:51:42 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-00ecb2fb-e061-4a50-8dc7-b725c95bdb42 tempest-VolumesSnapshotTestJSON-1781941103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8a20e6d-4c5b-44f1-b676-d30364c8b622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:51:42 devstack sudo[97372]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-05c8e5f8-e6f2-46a0-ba70-d7a999fa64fe tempest-VolumesActionsTest-11317694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-05100268-f3f4-4d59-a006-e1cd31dd0392" returned: 0 in 0.761s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-05c8e5f8-e6f2-46a0-ba70-d7a999fa64fe tempest-VolumesActionsTest-11317694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-05100268-f3f4-4d59-a006-e1cd31dd0392 /opt/stack/data/cinder/conversion/05100268-f3f4-4d59-a006-e1cd31dd0392.temp_image.e54b5af9-ec0b-409a-9898-cfe0048c04b7ooyk23_9.img {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:42 devstack sudo[97378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-05100268-f3f4-4d59-a006-e1cd31dd0392 /opt/stack/data/cinder/conversion/05100268-f3f4-4d59-a006-e1cd31dd0392.temp_image.e54b5af9-ec0b-409a-9898-cfe0048c04b7ooyk23_9.img Jul 08 01:51:42 devstack sudo[97378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:44 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-00ecb2fb-e061-4a50-8dc7-b725c95bdb42 tempest-VolumesSnapshotTestJSON-1781941103 None] Volume volume-0a9223f8-897b-4be7-9487-b932c517c953 (0a9223f8-897b-4be7-9487-b932c517c953): created successfully Jul 08 01:51:44 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-00ecb2fb-e061-4a50-8dc7-b725c95bdb42 tempest-VolumesSnapshotTestJSON-1781941103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8a20e6d-4c5b-44f1-b676-d30364c8b622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:51:44 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-00ecb2fb-e061-4a50-8dc7-b725c95bdb42 tempest-VolumesSnapshotTestJSON-1781941103 None] Flow 'volume_create_manager' (31377653-01da-4171-83df-2a12ffda6ddf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:51:45 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-00ecb2fb-e061-4a50-8dc7-b725c95bdb42 tempest-VolumesSnapshotTestJSON-1781941103 None] Created volume successfully. Jul 08 01:51:46 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-79ae72d0-432d-47f5-b63b-fde57574c81f tempest-VolumesSnapshotTestJSON-1781941103 None] Acquiring lock "cinder-0a9223f8-897b-4be7-9487-b932c517c953-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:51:46 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-79ae72d0-432d-47f5-b63b-fde57574c81f tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "cinder-0a9223f8-897b-4be7-9487-b932c517c953-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:51:46 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-79ae72d0-432d-47f5-b63b-fde57574c81f tempest-VolumesSnapshotTestJSON-1781941103 None] Acquiring lock "cinder-quobyte-0a9223f8-897b-4be7-9487-b932c517c953" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:51:46 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-79ae72d0-432d-47f5-b63b-fde57574c81f tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "cinder-quobyte-0a9223f8-897b-4be7-9487-b932c517c953" acquired by "delete_volume" :: waited 0.050s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:51:46 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3830e12-26cb-4f83-858a-a63d42b080ed]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:51:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-79ae72d0-432d-47f5-b63b-fde57574c81f tempest-VolumesSnapshotTestJSON-1781941103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0a9223f8-897b-4be7-9487-b932c517c953 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:46 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce235855-8848-40f6-ad94-47783e51ee1a tempest-GroupsTest-1407030482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:51:46 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ce235855-8848-40f6-ad94-47783e51ee1a tempest-GroupsTest-1407030482 None] Flow 'volume_create_manager' (2f5ba4eb-b7ce-4aa3-a6b6-74647c09b07e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:51:46 devstack sudo[97391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0a9223f8-897b-4be7-9487-b932c517c953 Jul 08 01:51:46 devstack sudo[97391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:46 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ce235855-8848-40f6-ad94-47783e51ee1a tempest-GroupsTest-1407030482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be92a6a4-6135-4f8f-957a-fe928f67ba95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:51:46 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ce235855-8848-40f6-ad94-47783e51ee1a tempest-GroupsTest-1407030482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be92a6a4-6135-4f8f-957a-fe928f67ba95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:51:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-923666571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ff8077eb-01c1-41ae-b777-0b180f6c9830,host='devstack@QuobyteHD#QuobyteHD',id=3e971ba3-8921-492d-8561-5a6bfa613581,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57e472f0b0e74e7495897c357c7bfa02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:51:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:51:47Z,use_quota=True,user_id='dd782e22763049ce8de7deda77fecf2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8dc8afc-ad01-4932-97d6-3d237b1850d3),volume_type_id=f8dc8afc-ad01-4932-97d6-3d237b1850d3)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:51:46 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ce235855-8848-40f6-ad94-47783e51ee1a tempest-GroupsTest-1407030482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b415c77f-6d74-4e32-903e-81afb8216b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:51:46 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ce235855-8848-40f6-ad94-47783e51ee1a tempest-GroupsTest-1407030482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b415c77f-6d74-4e32-903e-81afb8216b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:51:46 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ce235855-8848-40f6-ad94-47783e51ee1a tempest-GroupsTest-1407030482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c885a68-06bb-49b1-ad20-9fe2e8e4bcee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:51:46 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ce235855-8848-40f6-ad94-47783e51ee1a tempest-GroupsTest-1407030482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c885a68-06bb-49b1-ad20-9fe2e8e4bcee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e971ba3-8921-492d-8561-5a6bfa613581', 'volume_name': 'volume-3e971ba3-8921-492d-8561-5a6bfa613581', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:51:46 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ce235855-8848-40f6-ad94-47783e51ee1a tempest-GroupsTest-1407030482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e4b963b-62ae-4c41-a00d-f19af334f8f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:51:46 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ce235855-8848-40f6-ad94-47783e51ee1a tempest-GroupsTest-1407030482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e4b963b-62ae-4c41-a00d-f19af334f8f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:51:47 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ce235855-8848-40f6-ad94-47783e51ee1a tempest-GroupsTest-1407030482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7f77a47-4cc6-4683-8f82-8b9cc00b8e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:51:47 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-ce235855-8848-40f6-ad94-47783e51ee1a tempest-GroupsTest-1407030482 None] Volume 3e971ba3-8921-492d-8561-5a6bfa613581: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e971ba3-8921-492d-8561-5a6bfa613581', 'volume_size': 1} Jul 08 01:51:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-ce235855-8848-40f6-ad94-47783e51ee1a tempest-GroupsTest-1407030482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:51:48 devstack sudo[97391]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-79ae72d0-432d-47f5-b63b-fde57574c81f tempest-VolumesSnapshotTestJSON-1781941103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0a9223f8-897b-4be7-9487-b932c517c953" returned: 0 in 1.817s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-79ae72d0-432d-47f5-b63b-fde57574c81f tempest-VolumesSnapshotTestJSON-1781941103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0a9223f8-897b-4be7-9487-b932c517c953 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:48 devstack sudo[97396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0a9223f8-897b-4be7-9487-b932c517c953 Jul 08 01:51:48 devstack sudo[97396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:48 devstack sudo[97378]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-05c8e5f8-e6f2-46a0-ba70-d7a999fa64fe tempest-VolumesActionsTest-11317694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-05100268-f3f4-4d59-a006-e1cd31dd0392 /opt/stack/data/cinder/conversion/05100268-f3f4-4d59-a006-e1cd31dd0392.temp_image.e54b5af9-ec0b-409a-9898-cfe0048c04b7ooyk23_9.img" returned: 0 in 5.486s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:48 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[630a78df-0db4-4de5-a622-3112cea5b72d]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:51:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-05c8e5f8-e6f2-46a0-ba70-d7a999fa64fe tempest-VolumesActionsTest-11317694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-05100268-f3f4-4d59-a006-e1cd31dd0392 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:48 devstack sudo[97398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-05100268-f3f4-4d59-a006-e1cd31dd0392 Jul 08 01:51:48 devstack sudo[97398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:49 devstack sudo[97396]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:49 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-79ae72d0-432d-47f5-b63b-fde57574c81f tempest-VolumesSnapshotTestJSON-1781941103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0a9223f8-897b-4be7-9487-b932c517c953" returned: 0 in 0.725s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:49 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-79ae72d0-432d-47f5-b63b-fde57574c81f tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "cinder-quobyte-0a9223f8-897b-4be7-9487-b932c517c953" released by "delete_volume" :: held 2.652s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:51:49 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-79ae72d0-432d-47f5-b63b-fde57574c81f tempest-VolumesSnapshotTestJSON-1781941103 None] Created reservations ['3f853cfa-1dba-4952-bd55-f22011719434', '64d8fdd4-f7e1-479a-b14f-6d4c81261b24', '71e1fb20-d3e0-451f-b9f0-877100079892', 'ba8e9754-70c6-41ed-b502-4b92702f0753'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:51:49 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-79ae72d0-432d-47f5-b63b-fde57574c81f tempest-VolumesSnapshotTestJSON-1781941103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:51:49 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-79ae72d0-432d-47f5-b63b-fde57574c81f tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:51:49 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-79ae72d0-432d-47f5-b63b-fde57574c81f tempest-VolumesSnapshotTestJSON-1781941103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:51:49 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-79ae72d0-432d-47f5-b63b-fde57574c81f tempest-VolumesSnapshotTestJSON-1781941103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:51:49 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-79ae72d0-432d-47f5-b63b-fde57574c81f tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:51:49 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-79ae72d0-432d-47f5-b63b-fde57574c81f tempest-VolumesSnapshotTestJSON-1781941103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:49 devstack sudo[97403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:51:49 devstack sudo[97403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:49 devstack sudo[97398]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:49 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-05c8e5f8-e6f2-46a0-ba70-d7a999fa64fe tempest-VolumesActionsTest-11317694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-05100268-f3f4-4d59-a006-e1cd31dd0392" returned: 0 in 1.109s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:49 devstack cinder-volume[87134]: DEBUG cinder.image.image_utils [None req-05c8e5f8-e6f2-46a0-ba70-d7a999fa64fe tempest-VolumesActionsTest-11317694 None] Image conversion details: src /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-05100268-f3f4-4d59-a006-e1cd31dd0392, size 1024.00 MB, duration 5.49 sec, destination /opt/stack/data/cinder/conversion/05100268-f3f4-4d59-a006-e1cd31dd0392.temp_image.e54b5af9-ec0b-409a-9898-cfe0048c04b7ooyk23_9.img {{(pid=87134) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:51:49 devstack cinder-volume[87134]: INFO cinder.image.image_utils [None req-05c8e5f8-e6f2-46a0-ba70-d7a999fa64fe tempest-VolumesActionsTest-11317694 None] Converted 1024.00 MB image at 186.61 MB/s Jul 08 01:51:49 devstack cinder-volume[87134]: DEBUG cinder.image.image_utils [None req-05c8e5f8-e6f2-46a0-ba70-d7a999fa64fe tempest-VolumesActionsTest-11317694 None] e54b5af9-ec0b-409a-9898-cfe0048c04b7 was raw, no need to convert to raw {{(pid=87134) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 08 01:51:49 devstack sudo[97403]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:49 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-79ae72d0-432d-47f5-b63b-fde57574c81f tempest-VolumesSnapshotTestJSON-1781941103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.776s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:49 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-79ae72d0-432d-47f5-b63b-fde57574c81f tempest-VolumesSnapshotTestJSON-1781941103 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:51:49 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-79ae72d0-432d-47f5-b63b-fde57574c81f tempest-VolumesSnapshotTestJSON-1781941103 None] Deleted volume successfully. Jul 08 01:51:50 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-79ae72d0-432d-47f5-b63b-fde57574c81f tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "cinder-0a9223f8-897b-4be7-9487-b932c517c953-delete_volume" released by "delete_volume" :: held 3.843s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:51:50 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-cad9ae90-e7a7-4314-97ef-aecacf804f2e tempest-VolumesSnapshotTestJSON-1781941103 None] Acquiring lock "cinder-3a6b3dd6-5c08-452d-bbb3-dc37973e9524-delete_snapshot" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:51:50 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-cad9ae90-e7a7-4314-97ef-aecacf804f2e tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "cinder-3a6b3dd6-5c08-452d-bbb3-dc37973e9524-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:51:50 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-cad9ae90-e7a7-4314-97ef-aecacf804f2e tempest-VolumesSnapshotTestJSON-1781941103 None] Acquiring lock "cinder-quobyte-3a37c8de-f711-44f6-8f58-998b8e41b9bc" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:51:50 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-cad9ae90-e7a7-4314-97ef-aecacf804f2e tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "cinder-quobyte-3a37c8de-f711-44f6-8f58-998b8e41b9bc" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:51:50 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-cad9ae90-e7a7-4314-97ef-aecacf804f2e tempest-VolumesSnapshotTestJSON-1781941103 None] Acquiring lock "cinder-quobyte-3a6b3dd6-5c08-452d-bbb3-dc37973e9524" by "_delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:51:50 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-cad9ae90-e7a7-4314-97ef-aecacf804f2e tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "cinder-quobyte-3a6b3dd6-5c08-452d-bbb3-dc37973e9524" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:51:50 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-cad9ae90-e7a7-4314-97ef-aecacf804f2e tempest-VolumesSnapshotTestJSON-1781941103 None] Deleting offline snapshot 3a6b3dd6-5c08-452d-bbb3-dc37973e9524 of volume 3a37c8de-f711-44f6-8f58-998b8e41b9bc {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:51:50 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-cad9ae90-e7a7-4314-97ef-aecacf804f2e tempest-VolumesSnapshotTestJSON-1781941103 None] snapshot_file for this snap is: volume-3a37c8de-f711-44f6-8f58-998b8e41b9bc.3a6b3dd6-5c08-452d-bbb3-dc37973e9524 {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:51:50 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e17476a-8689-4ab5-8726-1bfe5c379a33]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:51:50 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-cad9ae90-e7a7-4314-97ef-aecacf804f2e tempest-VolumesSnapshotTestJSON-1781941103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3a37c8de-f711-44f6-8f58-998b8e41b9bc.3a6b3dd6-5c08-452d-bbb3-dc37973e9524 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:50 devstack sudo[97408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3a37c8de-f711-44f6-8f58-998b8e41b9bc.3a6b3dd6-5c08-452d-bbb3-dc37973e9524 Jul 08 01:51:50 devstack sudo[97408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:51 devstack sudo[97408]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-cad9ae90-e7a7-4314-97ef-aecacf804f2e tempest-VolumesSnapshotTestJSON-1781941103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3a37c8de-f711-44f6-8f58-998b8e41b9bc.3a6b3dd6-5c08-452d-bbb3-dc37973e9524" returned: 0 in 0.981s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:51 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-cad9ae90-e7a7-4314-97ef-aecacf804f2e tempest-VolumesSnapshotTestJSON-1781941103 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a37c8de-f711-44f6-8f58-998b8e41b9bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:51:51 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8a5606-ca07-4e5e-a490-b900ded80bf4]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:51:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-cad9ae90-e7a7-4314-97ef-aecacf804f2e tempest-VolumesSnapshotTestJSON-1781941103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3a37c8de-f711-44f6-8f58-998b8e41b9bc {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:51 devstack sudo[97415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3a37c8de-f711-44f6-8f58-998b8e41b9bc Jul 08 01:51:51 devstack sudo[97415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:52 devstack sudo[97415]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:52 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-cad9ae90-e7a7-4314-97ef-aecacf804f2e tempest-VolumesSnapshotTestJSON-1781941103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3a37c8de-f711-44f6-8f58-998b8e41b9bc" returned: 0 in 1.205s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:52 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-cad9ae90-e7a7-4314-97ef-aecacf804f2e tempest-VolumesSnapshotTestJSON-1781941103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3a37c8de-f711-44f6-8f58-998b8e41b9bc.3a6b3dd6-5c08-452d-bbb3-dc37973e9524 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:52 devstack sudo[97422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3a37c8de-f711-44f6-8f58-998b8e41b9bc.3a6b3dd6-5c08-452d-bbb3-dc37973e9524 Jul 08 01:51:52 devstack sudo[97422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:53 devstack sudo[97422]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-cad9ae90-e7a7-4314-97ef-aecacf804f2e tempest-VolumesSnapshotTestJSON-1781941103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3a37c8de-f711-44f6-8f58-998b8e41b9bc.3a6b3dd6-5c08-452d-bbb3-dc37973e9524" returned: 0 in 0.936s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-cad9ae90-e7a7-4314-97ef-aecacf804f2e tempest-VolumesSnapshotTestJSON-1781941103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3a37c8de-f711-44f6-8f58-998b8e41b9bc.3a6b3dd6-5c08-452d-bbb3-dc37973e9524 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:53 devstack sudo[97427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3a37c8de-f711-44f6-8f58-998b8e41b9bc.3a6b3dd6-5c08-452d-bbb3-dc37973e9524 Jul 08 01:51:53 devstack sudo[97427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:54 devstack sudo[97427]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-cad9ae90-e7a7-4314-97ef-aecacf804f2e tempest-VolumesSnapshotTestJSON-1781941103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3a37c8de-f711-44f6-8f58-998b8e41b9bc.3a6b3dd6-5c08-452d-bbb3-dc37973e9524" returned: 0 in 0.835s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:54 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-cad9ae90-e7a7-4314-97ef-aecacf804f2e tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "cinder-quobyte-3a6b3dd6-5c08-452d-bbb3-dc37973e9524" released by "_delete_snapshot" :: held 4.132s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:51:54 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-cad9ae90-e7a7-4314-97ef-aecacf804f2e tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "cinder-quobyte-3a37c8de-f711-44f6-8f58-998b8e41b9bc" released by "delete_snapshot" :: held 4.166s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:51:54 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-cad9ae90-e7a7-4314-97ef-aecacf804f2e tempest-VolumesSnapshotTestJSON-1781941103 None] Created reservations ['eb2c7f28-f6ea-4e38-8254-bf3d4d55aaa5', 'b15586bd-06bd-44a5-b7ae-28a3cdca2803', 'c5e70399-db8b-407f-980d-2d7011c99eec', '420e8479-19fb-4d6a-8857-485d889a4ae0'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:51:54 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-cad9ae90-e7a7-4314-97ef-aecacf804f2e tempest-VolumesSnapshotTestJSON-1781941103 None] Delete snapshot completed successfully. Jul 08 01:51:54 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-cad9ae90-e7a7-4314-97ef-aecacf804f2e tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "cinder-3a6b3dd6-5c08-452d-bbb3-dc37973e9524-delete_snapshot" released by "delete_snapshot" :: held 4.416s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:51:55 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-96dad958-7e1d-4755-b84c-d91ca94fd590 tempest-VolumesSnapshotTestJSON-1781941103 None] Acquiring lock "cinder-3a37c8de-f711-44f6-8f58-998b8e41b9bc-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:51:55 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-96dad958-7e1d-4755-b84c-d91ca94fd590 tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "cinder-3a37c8de-f711-44f6-8f58-998b8e41b9bc-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:51:55 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-96dad958-7e1d-4755-b84c-d91ca94fd590 tempest-VolumesSnapshotTestJSON-1781941103 None] Acquiring lock "cinder-quobyte-3a37c8de-f711-44f6-8f58-998b8e41b9bc" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:51:55 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-96dad958-7e1d-4755-b84c-d91ca94fd590 tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "cinder-quobyte-3a37c8de-f711-44f6-8f58-998b8e41b9bc" acquired by "delete_volume" :: waited 0.022s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:51:55 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[88719095-9b0e-42fe-80ab-7b5045f9e3a3]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:51:55 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-96dad958-7e1d-4755-b84c-d91ca94fd590 tempest-VolumesSnapshotTestJSON-1781941103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3a37c8de-f711-44f6-8f58-998b8e41b9bc {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:56 devstack sudo[97430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3a37c8de-f711-44f6-8f58-998b8e41b9bc Jul 08 01:51:56 devstack sudo[97430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:57 devstack sudo[97430]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:57 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-96dad958-7e1d-4755-b84c-d91ca94fd590 tempest-VolumesSnapshotTestJSON-1781941103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3a37c8de-f711-44f6-8f58-998b8e41b9bc" returned: 0 in 1.155s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:57 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-96dad958-7e1d-4755-b84c-d91ca94fd590 tempest-VolumesSnapshotTestJSON-1781941103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3a37c8de-f711-44f6-8f58-998b8e41b9bc {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:57 devstack sudo[97435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3a37c8de-f711-44f6-8f58-998b8e41b9bc Jul 08 01:51:57 devstack sudo[97435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:57 devstack sudo[97435]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:57 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-96dad958-7e1d-4755-b84c-d91ca94fd590 tempest-VolumesSnapshotTestJSON-1781941103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3a37c8de-f711-44f6-8f58-998b8e41b9bc" returned: 0 in 0.821s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:57 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-96dad958-7e1d-4755-b84c-d91ca94fd590 tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "cinder-quobyte-3a37c8de-f711-44f6-8f58-998b8e41b9bc" released by "delete_volume" :: held 2.074s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:51:57 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-96dad958-7e1d-4755-b84c-d91ca94fd590 tempest-VolumesSnapshotTestJSON-1781941103 None] Created reservations ['1eb73ab1-789f-4006-8807-3e1454cc67e4', '19b87497-635a-4588-9a21-4bda1861984e', '2347de65-4f1d-4bbf-9a01-fd64b973dbbb', '2d075624-53e2-48ea-8c93-37db9a364406'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:51:58 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-96dad958-7e1d-4755-b84c-d91ca94fd590 tempest-VolumesSnapshotTestJSON-1781941103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:51:58 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-96dad958-7e1d-4755-b84c-d91ca94fd590 tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:51:58 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-96dad958-7e1d-4755-b84c-d91ca94fd590 tempest-VolumesSnapshotTestJSON-1781941103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:51:58 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-96dad958-7e1d-4755-b84c-d91ca94fd590 tempest-VolumesSnapshotTestJSON-1781941103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:51:58 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-96dad958-7e1d-4755-b84c-d91ca94fd590 tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:51:58 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-96dad958-7e1d-4755-b84c-d91ca94fd590 tempest-VolumesSnapshotTestJSON-1781941103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:51:58 devstack sudo[97438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:51:58 devstack sudo[97438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:51:58 devstack sudo[97438]: pam_unix(sudo:session): session closed for user root Jul 08 01:51:58 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-96dad958-7e1d-4755-b84c-d91ca94fd590 tempest-VolumesSnapshotTestJSON-1781941103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.839s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:51:58 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-96dad958-7e1d-4755-b84c-d91ca94fd590 tempest-VolumesSnapshotTestJSON-1781941103 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:51:58 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-96dad958-7e1d-4755-b84c-d91ca94fd590 tempest-VolumesSnapshotTestJSON-1781941103 None] Deleted volume successfully. Jul 08 01:51:58 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-96dad958-7e1d-4755-b84c-d91ca94fd590 tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "cinder-3a37c8de-f711-44f6-8f58-998b8e41b9bc-delete_volume" released by "delete_volume" :: held 3.257s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:51:59 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a6a3323-63a7-4d78-bcda-956917e59ae8 tempest-VolumesSnapshotTestJSON-1781941103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:51:59 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8a6a3323-63a7-4d78-bcda-956917e59ae8 tempest-VolumesSnapshotTestJSON-1781941103 None] Flow 'volume_create_manager' (e7e82add-63e7-46f9-b768-0b0bf4cdbc36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:51:59 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8a6a3323-63a7-4d78-bcda-956917e59ae8 tempest-VolumesSnapshotTestJSON-1781941103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e58a8fe-ee4e-496e-ae44-5b1c27640f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:51:59 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8a6a3323-63a7-4d78-bcda-956917e59ae8 tempest-VolumesSnapshotTestJSON-1781941103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e58a8fe-ee4e-496e-ae44-5b1c27640f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-562928969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4476fd7d-512d-4140-a943-456de92c545b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d35d25a53f04475397d55628d5c33338',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:52:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:52:00Z,use_quota=True,user_id='a8c972c3a0194d0399a1068466ad9ba0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:51:59 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8a6a3323-63a7-4d78-bcda-956917e59ae8 tempest-VolumesSnapshotTestJSON-1781941103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ff1c4f2-cd4a-431c-b472-a99ec353aa73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:51:59 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8a6a3323-63a7-4d78-bcda-956917e59ae8 tempest-VolumesSnapshotTestJSON-1781941103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ff1c4f2-cd4a-431c-b472-a99ec353aa73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:51:59 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8a6a3323-63a7-4d78-bcda-956917e59ae8 tempest-VolumesSnapshotTestJSON-1781941103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25963e75-6d0b-4a0e-a392-76f3c238c187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:51:59 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8a6a3323-63a7-4d78-bcda-956917e59ae8 tempest-VolumesSnapshotTestJSON-1781941103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25963e75-6d0b-4a0e-a392-76f3c238c187) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4476fd7d-512d-4140-a943-456de92c545b', 'volume_name': 'volume-4476fd7d-512d-4140-a943-456de92c545b', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:51:59 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8a6a3323-63a7-4d78-bcda-956917e59ae8 tempest-VolumesSnapshotTestJSON-1781941103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6a275dd-f823-4e36-9782-64869ac615b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:51:59 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8a6a3323-63a7-4d78-bcda-956917e59ae8 tempest-VolumesSnapshotTestJSON-1781941103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6a275dd-f823-4e36-9782-64869ac615b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:51:59 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8a6a3323-63a7-4d78-bcda-956917e59ae8 tempest-VolumesSnapshotTestJSON-1781941103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d8e849d-79ee-45b1-b200-06b46d1c2946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:51:59 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-8a6a3323-63a7-4d78-bcda-956917e59ae8 tempest-VolumesSnapshotTestJSON-1781941103 None] Volume 4476fd7d-512d-4140-a943-456de92c545b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4476fd7d-512d-4140-a943-456de92c545b', 'volume_size': 1} Jul 08 01:51:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-8a6a3323-63a7-4d78-bcda-956917e59ae8 tempest-VolumesSnapshotTestJSON-1781941103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:52:08 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-1725a01a-f755-417b-971a-8bc58c91ce75 tempest-TestServerVolumeAttachmentScenario-1700580262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:52:08 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1725a01a-f755-417b-971a-8bc58c91ce75 tempest-TestServerVolumeAttachmentScenario-1700580262 None] Flow 'volume_create_manager' (b99416ae-030a-4a7d-9468-e69b801b6e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:52:08 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1725a01a-f755-417b-971a-8bc58c91ce75 tempest-TestServerVolumeAttachmentScenario-1700580262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (882bc001-a6c3-40e2-8e04-946053fc276d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:52:08 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1725a01a-f755-417b-971a-8bc58c91ce75 tempest-TestServerVolumeAttachmentScenario-1700580262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (882bc001-a6c3-40e2-8e04-946053fc276d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:52:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1869463638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7155157f-98b1-49c5-8e5f-577012d0e574,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93026975739d4caf9e879d1fad37cec6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:52:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:52:09Z,use_quota=True,user_id='82d3b16510634b5e906d8312d5082634',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:52:08 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1725a01a-f755-417b-971a-8bc58c91ce75 tempest-TestServerVolumeAttachmentScenario-1700580262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01ef9ff1-9ecf-41da-bfd0-058ea634f880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:52:08 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1725a01a-f755-417b-971a-8bc58c91ce75 tempest-TestServerVolumeAttachmentScenario-1700580262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01ef9ff1-9ecf-41da-bfd0-058ea634f880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:52:08 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1725a01a-f755-417b-971a-8bc58c91ce75 tempest-TestServerVolumeAttachmentScenario-1700580262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6591da6-9faa-48a0-b67f-e7a5fe7ef010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:52:08 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1725a01a-f755-417b-971a-8bc58c91ce75 tempest-TestServerVolumeAttachmentScenario-1700580262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6591da6-9faa-48a0-b67f-e7a5fe7ef010) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7155157f-98b1-49c5-8e5f-577012d0e574', 'volume_name': 'volume-7155157f-98b1-49c5-8e5f-577012d0e574', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:52:08 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1725a01a-f755-417b-971a-8bc58c91ce75 tempest-TestServerVolumeAttachmentScenario-1700580262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a21b3142-d3e0-4e89-833d-7e0ac050c125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:52:08 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1725a01a-f755-417b-971a-8bc58c91ce75 tempest-TestServerVolumeAttachmentScenario-1700580262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a21b3142-d3e0-4e89-833d-7e0ac050c125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:52:08 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1725a01a-f755-417b-971a-8bc58c91ce75 tempest-TestServerVolumeAttachmentScenario-1700580262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8abec4ac-7d89-49cb-ad98-7c8fcc2404f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:52:08 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-1725a01a-f755-417b-971a-8bc58c91ce75 tempest-TestServerVolumeAttachmentScenario-1700580262 None] Volume 7155157f-98b1-49c5-8e5f-577012d0e574: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7155157f-98b1-49c5-8e5f-577012d0e574', 'volume_size': 1} Jul 08 01:52:08 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-1725a01a-f755-417b-971a-8bc58c91ce75 tempest-TestServerVolumeAttachmentScenario-1700580262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:52:09 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-3953d3b4-67ff-41eb-9a1a-c12de32cc27b tempest-TestServerVolumeAttachmentScenario-1700580262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:52:09 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-3953d3b4-67ff-41eb-9a1a-c12de32cc27b tempest-TestServerVolumeAttachmentScenario-1700580262 None] Flow 'volume_create_manager' (4526f93b-02fe-42e5-b892-d2ccc4bbaf05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:52:09 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-3953d3b4-67ff-41eb-9a1a-c12de32cc27b tempest-TestServerVolumeAttachmentScenario-1700580262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e7a00f2-ed98-44e7-9245-6fe4ecf8972e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:52:09 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-3953d3b4-67ff-41eb-9a1a-c12de32cc27b tempest-TestServerVolumeAttachmentScenario-1700580262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e7a00f2-ed98-44e7-9245-6fe4ecf8972e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:52:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2139488595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7b32e87-a71d-4eba-9328-87c8526de819,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93026975739d4caf9e879d1fad37cec6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:52:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:52:09Z,use_quota=True,user_id='82d3b16510634b5e906d8312d5082634',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:52:09 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-3953d3b4-67ff-41eb-9a1a-c12de32cc27b tempest-TestServerVolumeAttachmentScenario-1700580262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5471799f-5c1b-435b-b37a-5734b766be43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:52:09 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-3953d3b4-67ff-41eb-9a1a-c12de32cc27b tempest-TestServerVolumeAttachmentScenario-1700580262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5471799f-5c1b-435b-b37a-5734b766be43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:52:09 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-3953d3b4-67ff-41eb-9a1a-c12de32cc27b tempest-TestServerVolumeAttachmentScenario-1700580262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e819edcb-79e5-48ff-9f5f-9e163abbaa68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:52:09 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-3953d3b4-67ff-41eb-9a1a-c12de32cc27b tempest-TestServerVolumeAttachmentScenario-1700580262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e819edcb-79e5-48ff-9f5f-9e163abbaa68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7b32e87-a71d-4eba-9328-87c8526de819', 'volume_name': 'volume-c7b32e87-a71d-4eba-9328-87c8526de819', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:52:09 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-3953d3b4-67ff-41eb-9a1a-c12de32cc27b tempest-TestServerVolumeAttachmentScenario-1700580262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e2a7fcf-53af-49f6-8efa-a3aee7f47bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:52:09 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-3953d3b4-67ff-41eb-9a1a-c12de32cc27b tempest-TestServerVolumeAttachmentScenario-1700580262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e2a7fcf-53af-49f6-8efa-a3aee7f47bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:52:09 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-3953d3b4-67ff-41eb-9a1a-c12de32cc27b tempest-TestServerVolumeAttachmentScenario-1700580262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ea60115-a1f6-40aa-bfca-fc8ce266cad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:52:09 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-3953d3b4-67ff-41eb-9a1a-c12de32cc27b tempest-TestServerVolumeAttachmentScenario-1700580262 None] Volume c7b32e87-a71d-4eba-9328-87c8526de819: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7b32e87-a71d-4eba-9328-87c8526de819', 'volume_size': 1} Jul 08 01:52:09 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-3953d3b4-67ff-41eb-9a1a-c12de32cc27b tempest-TestServerVolumeAttachmentScenario-1700580262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:52:12 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-05c8e5f8-e6f2-46a0-ba70-d7a999fa64fe tempest-VolumesActionsTest-11317694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 31.471s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:52:12 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-05c8e5f8-e6f2-46a0-ba70-d7a999fa64fe tempest-VolumesActionsTest-11317694 None] Uploaded volume to glance image-id: e54b5af9-ec0b-409a-9898-cfe0048c04b7. {{(pid=87134) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 08 01:52:12 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-ce235855-8848-40f6-ad94-47783e51ee1a tempest-GroupsTest-1407030482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 25.836s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:52:12 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-ce235855-8848-40f6-ad94-47783e51ee1a tempest-GroupsTest-1407030482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ff8077eb-01c1-41ae-b777-0b180f6c9830,created_at=2026-07-07T23:51:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-923666571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ff8077eb-01c1-41ae-b777-0b180f6c9830,host='devstack@QuobyteHD#QuobyteHD',id=3e971ba3-8921-492d-8561-5a6bfa613581,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57e472f0b0e74e7495897c357c7bfa02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:51:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:51:47Z,use_quota=True,user_id='dd782e22763049ce8de7deda77fecf2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8dc8afc-ad01-4932-97d6-3d237b1850d3),volume_type_id=f8dc8afc-ad01-4932-97d6-3d237b1850d3)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:52:12 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-ce235855-8848-40f6-ad94-47783e51ee1a tempest-GroupsTest-1407030482 None] Creating volume 3e971ba3-8921-492d-8561-5a6bfa613581 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:52:12 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-ce235855-8848-40f6-ad94-47783e51ee1a tempest-GroupsTest-1407030482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:52:12 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-ce235855-8848-40f6-ad94-47783e51ee1a tempest-GroupsTest-1407030482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:52:12 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-ce235855-8848-40f6-ad94-47783e51ee1a tempest-GroupsTest-1407030482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:52:12 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-ce235855-8848-40f6-ad94-47783e51ee1a tempest-GroupsTest-1407030482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:52:12 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-ce235855-8848-40f6-ad94-47783e51ee1a tempest-GroupsTest-1407030482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:52:12 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-ce235855-8848-40f6-ad94-47783e51ee1a tempest-GroupsTest-1407030482 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:52:12 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-ce235855-8848-40f6-ad94-47783e51ee1a tempest-GroupsTest-1407030482 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:52:12 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ce235855-8848-40f6-ad94-47783e51ee1a tempest-GroupsTest-1407030482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3e971ba3-8921-492d-8561-5a6bfa613581 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:52:12 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-05c8e5f8-e6f2-46a0-ba70-d7a999fa64fe tempest-VolumesActionsTest-11317694 None] Copy volume to image completed successfully. Jul 08 01:52:12 devstack sudo[97454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3e971ba3-8921-492d-8561-5a6bfa613581 1073741824 Jul 08 01:52:12 devstack sudo[97454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:52:13 devstack sudo[97454]: pam_unix(sudo:session): session closed for user root Jul 08 01:52:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ce235855-8848-40f6-ad94-47783e51ee1a tempest-GroupsTest-1407030482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3e971ba3-8921-492d-8561-5a6bfa613581 1073741824" returned: 0 in 0.989s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:52:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ce235855-8848-40f6-ad94-47783e51ee1a tempest-GroupsTest-1407030482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3e971ba3-8921-492d-8561-5a6bfa613581 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:52:13 devstack sudo[97459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3e971ba3-8921-492d-8561-5a6bfa613581 Jul 08 01:52:13 devstack sudo[97459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:52:14 devstack sudo[97459]: pam_unix(sudo:session): session closed for user root Jul 08 01:52:14 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ce235855-8848-40f6-ad94-47783e51ee1a tempest-GroupsTest-1407030482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3e971ba3-8921-492d-8561-5a6bfa613581" returned: 0 in 0.672s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:52:14 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-ce235855-8848-40f6-ad94-47783e51ee1a tempest-GroupsTest-1407030482 None] <== create_volume: return (1714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:52:14 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-ce235855-8848-40f6-ad94-47783e51ee1a tempest-GroupsTest-1407030482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.717s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:52:14 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-8a6a3323-63a7-4d78-bcda-956917e59ae8 tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.587s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:52:14 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-8a6a3323-63a7-4d78-bcda-956917e59ae8 tempest-VolumesSnapshotTestJSON-1781941103 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-562928969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4476fd7d-512d-4140-a943-456de92c545b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d35d25a53f04475397d55628d5c33338',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:52:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:52:00Z,use_quota=True,user_id='a8c972c3a0194d0399a1068466ad9ba0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:52:14 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-8a6a3323-63a7-4d78-bcda-956917e59ae8 tempest-VolumesSnapshotTestJSON-1781941103 None] Creating volume 4476fd7d-512d-4140-a943-456de92c545b {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:52:14 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-8a6a3323-63a7-4d78-bcda-956917e59ae8 tempest-VolumesSnapshotTestJSON-1781941103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:52:14 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-8a6a3323-63a7-4d78-bcda-956917e59ae8 tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:52:14 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-8a6a3323-63a7-4d78-bcda-956917e59ae8 tempest-VolumesSnapshotTestJSON-1781941103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:52:14 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-8a6a3323-63a7-4d78-bcda-956917e59ae8 tempest-VolumesSnapshotTestJSON-1781941103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:52:14 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-8a6a3323-63a7-4d78-bcda-956917e59ae8 tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:52:14 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-8a6a3323-63a7-4d78-bcda-956917e59ae8 tempest-VolumesSnapshotTestJSON-1781941103 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:52:14 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-8a6a3323-63a7-4d78-bcda-956917e59ae8 tempest-VolumesSnapshotTestJSON-1781941103 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:52:14 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8a6a3323-63a7-4d78-bcda-956917e59ae8 tempest-VolumesSnapshotTestJSON-1781941103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4476fd7d-512d-4140-a943-456de92c545b 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:52:14 devstack sudo[97462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4476fd7d-512d-4140-a943-456de92c545b 1073741824 Jul 08 01:52:14 devstack sudo[97462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:52:14 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ce235855-8848-40f6-ad94-47783e51ee1a tempest-GroupsTest-1407030482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7f77a47-4cc6-4683-8f82-8b9cc00b8e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e971ba3-8921-492d-8561-5a6bfa613581', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:52:14 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ce235855-8848-40f6-ad94-47783e51ee1a tempest-GroupsTest-1407030482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbaf0112-f779-4fd4-a231-5bc1a7bfd47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:52:14 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5f159b71-68d3-4037-91a8-ff3899a8b7ae tempest-VolumesActionsTest-11317694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:52:14 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-ce235855-8848-40f6-ad94-47783e51ee1a tempest-GroupsTest-1407030482 None] Volume volume-3e971ba3-8921-492d-8561-5a6bfa613581 (3e971ba3-8921-492d-8561-5a6bfa613581): created successfully Jul 08 01:52:14 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ce235855-8848-40f6-ad94-47783e51ee1a tempest-GroupsTest-1407030482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbaf0112-f779-4fd4-a231-5bc1a7bfd47e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:52:14 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ce235855-8848-40f6-ad94-47783e51ee1a tempest-GroupsTest-1407030482 None] Flow 'volume_create_manager' (2f5ba4eb-b7ce-4aa3-a6b6-74647c09b07e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:52:14 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-ce235855-8848-40f6-ad94-47783e51ee1a tempest-GroupsTest-1407030482 None] Created volume successfully. Jul 08 01:52:15 devstack sudo[97462]: pam_unix(sudo:session): session closed for user root Jul 08 01:52:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8a6a3323-63a7-4d78-bcda-956917e59ae8 tempest-VolumesSnapshotTestJSON-1781941103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4476fd7d-512d-4140-a943-456de92c545b 1073741824" returned: 0 in 0.857s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:52:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8a6a3323-63a7-4d78-bcda-956917e59ae8 tempest-VolumesSnapshotTestJSON-1781941103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4476fd7d-512d-4140-a943-456de92c545b {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:52:15 devstack sudo[97468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4476fd7d-512d-4140-a943-456de92c545b Jul 08 01:52:15 devstack sudo[97468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:52:15 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-da25e1f6-3d16-40d4-b0f5-82f693f7d309 tempest-GroupsTest-1407030482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:52:15 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-da25e1f6-3d16-40d4-b0f5-82f693f7d309 tempest-GroupsTest-1407030482 None] Flow 'volume_create_manager' (e79090a5-abb6-4ae5-86b2-2be7f74fb7c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:52:15 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-da25e1f6-3d16-40d4-b0f5-82f693f7d309 tempest-GroupsTest-1407030482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b4bf668-f71b-4d55-a9c7-493b6faed51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:52:15 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-da25e1f6-3d16-40d4-b0f5-82f693f7d309 tempest-GroupsTest-1407030482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b4bf668-f71b-4d55-a9c7-493b6faed51b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:52:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1814669394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ff8077eb-01c1-41ae-b777-0b180f6c9830,host='devstack@QuobyteHD#QuobyteHD',id=c9473ac8-83e9-4025-b6c1-ad5e8e0858ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57e472f0b0e74e7495897c357c7bfa02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:52:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:52:16Z,use_quota=True,user_id='dd782e22763049ce8de7deda77fecf2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8dc8afc-ad01-4932-97d6-3d237b1850d3),volume_type_id=f8dc8afc-ad01-4932-97d6-3d237b1850d3)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:52:15 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-da25e1f6-3d16-40d4-b0f5-82f693f7d309 tempest-GroupsTest-1407030482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5550bce-35e2-4e6b-81cf-b3fe13590ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:52:16 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-da25e1f6-3d16-40d4-b0f5-82f693f7d309 tempest-GroupsTest-1407030482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5550bce-35e2-4e6b-81cf-b3fe13590ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:52:16 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-da25e1f6-3d16-40d4-b0f5-82f693f7d309 tempest-GroupsTest-1407030482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0541b0b-fb77-439d-a0e6-93c8990f28cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:52:16 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-da25e1f6-3d16-40d4-b0f5-82f693f7d309 tempest-GroupsTest-1407030482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0541b0b-fb77-439d-a0e6-93c8990f28cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9473ac8-83e9-4025-b6c1-ad5e8e0858ba', 'volume_name': 'volume-c9473ac8-83e9-4025-b6c1-ad5e8e0858ba', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:52:16 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-da25e1f6-3d16-40d4-b0f5-82f693f7d309 tempest-GroupsTest-1407030482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30e7292c-de5e-40ca-b295-f12f8c502b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:52:16 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-da25e1f6-3d16-40d4-b0f5-82f693f7d309 tempest-GroupsTest-1407030482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30e7292c-de5e-40ca-b295-f12f8c502b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:52:16 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-da25e1f6-3d16-40d4-b0f5-82f693f7d309 tempest-GroupsTest-1407030482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93fb1d7e-201d-485c-90b2-25cd130addea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:52:16 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-da25e1f6-3d16-40d4-b0f5-82f693f7d309 tempest-GroupsTest-1407030482 None] Volume c9473ac8-83e9-4025-b6c1-ad5e8e0858ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9473ac8-83e9-4025-b6c1-ad5e8e0858ba', 'volume_size': 1} Jul 08 01:52:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-da25e1f6-3d16-40d4-b0f5-82f693f7d309 tempest-GroupsTest-1407030482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:52:16 devstack sudo[97468]: pam_unix(sudo:session): session closed for user root Jul 08 01:52:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8a6a3323-63a7-4d78-bcda-956917e59ae8 tempest-VolumesSnapshotTestJSON-1781941103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4476fd7d-512d-4140-a943-456de92c545b" returned: 0 in 0.688s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:52:16 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-8a6a3323-63a7-4d78-bcda-956917e59ae8 tempest-VolumesSnapshotTestJSON-1781941103 None] <== create_volume: return (1592ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:52:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-8a6a3323-63a7-4d78-bcda-956917e59ae8 tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.596s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:52:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-1725a01a-f755-417b-971a-8bc58c91ce75 tempest-TestServerVolumeAttachmentScenario-1700580262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.305s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:52:16 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-1725a01a-f755-417b-971a-8bc58c91ce75 tempest-TestServerVolumeAttachmentScenario-1700580262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:52:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1869463638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7155157f-98b1-49c5-8e5f-577012d0e574,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93026975739d4caf9e879d1fad37cec6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:52:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:52:09Z,use_quota=True,user_id='82d3b16510634b5e906d8312d5082634',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:52:16 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-1725a01a-f755-417b-971a-8bc58c91ce75 tempest-TestServerVolumeAttachmentScenario-1700580262 None] Creating volume 7155157f-98b1-49c5-8e5f-577012d0e574 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:52:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-1725a01a-f755-417b-971a-8bc58c91ce75 tempest-TestServerVolumeAttachmentScenario-1700580262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:52:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-1725a01a-f755-417b-971a-8bc58c91ce75 tempest-TestServerVolumeAttachmentScenario-1700580262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:52:16 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-1725a01a-f755-417b-971a-8bc58c91ce75 tempest-TestServerVolumeAttachmentScenario-1700580262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:52:16 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-1725a01a-f755-417b-971a-8bc58c91ce75 tempest-TestServerVolumeAttachmentScenario-1700580262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:52:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-1725a01a-f755-417b-971a-8bc58c91ce75 tempest-TestServerVolumeAttachmentScenario-1700580262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:52:16 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-1725a01a-f755-417b-971a-8bc58c91ce75 tempest-TestServerVolumeAttachmentScenario-1700580262 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:52:16 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-1725a01a-f755-417b-971a-8bc58c91ce75 tempest-TestServerVolumeAttachmentScenario-1700580262 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:52:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1725a01a-f755-417b-971a-8bc58c91ce75 tempest-TestServerVolumeAttachmentScenario-1700580262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7155157f-98b1-49c5-8e5f-577012d0e574 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:52:16 devstack sudo[97471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7155157f-98b1-49c5-8e5f-577012d0e574 1073741824 Jul 08 01:52:16 devstack sudo[97471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:52:16 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8a6a3323-63a7-4d78-bcda-956917e59ae8 tempest-VolumesSnapshotTestJSON-1781941103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d8e849d-79ee-45b1-b200-06b46d1c2946) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4476fd7d-512d-4140-a943-456de92c545b', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:52:16 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8a6a3323-63a7-4d78-bcda-956917e59ae8 tempest-VolumesSnapshotTestJSON-1781941103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d5a1448-efeb-4db9-8e2b-54829eb34105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:52:16 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-8a6a3323-63a7-4d78-bcda-956917e59ae8 tempest-VolumesSnapshotTestJSON-1781941103 None] Volume volume-4476fd7d-512d-4140-a943-456de92c545b (4476fd7d-512d-4140-a943-456de92c545b): created successfully Jul 08 01:52:16 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8a6a3323-63a7-4d78-bcda-956917e59ae8 tempest-VolumesSnapshotTestJSON-1781941103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d5a1448-efeb-4db9-8e2b-54829eb34105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:52:16 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8a6a3323-63a7-4d78-bcda-956917e59ae8 tempest-VolumesSnapshotTestJSON-1781941103 None] Flow 'volume_create_manager' (e7e82add-63e7-46f9-b768-0b0bf4cdbc36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:52:16 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-8a6a3323-63a7-4d78-bcda-956917e59ae8 tempest-VolumesSnapshotTestJSON-1781941103 None] Created volume successfully. Jul 08 01:52:17 devstack sudo[97471]: pam_unix(sudo:session): session closed for user root Jul 08 01:52:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1725a01a-f755-417b-971a-8bc58c91ce75 tempest-TestServerVolumeAttachmentScenario-1700580262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7155157f-98b1-49c5-8e5f-577012d0e574 1073741824" returned: 0 in 0.831s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:52:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1725a01a-f755-417b-971a-8bc58c91ce75 tempest-TestServerVolumeAttachmentScenario-1700580262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7155157f-98b1-49c5-8e5f-577012d0e574 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:52:17 devstack sudo[97477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7155157f-98b1-49c5-8e5f-577012d0e574 Jul 08 01:52:17 devstack sudo[97477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:52:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-1cc9d969-7b70-4ead-999c-b23229bbd7c2 tempest-VolumesSnapshotTestJSON-1781941103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:52:17 devstack sudo[97477]: pam_unix(sudo:session): session closed for user root Jul 08 01:52:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1725a01a-f755-417b-971a-8bc58c91ce75 tempest-TestServerVolumeAttachmentScenario-1700580262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7155157f-98b1-49c5-8e5f-577012d0e574" returned: 0 in 0.852s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:52:17 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-1725a01a-f755-417b-971a-8bc58c91ce75 tempest-TestServerVolumeAttachmentScenario-1700580262 None] <== create_volume: return (1765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:52:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-1725a01a-f755-417b-971a-8bc58c91ce75 tempest-TestServerVolumeAttachmentScenario-1700580262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.768s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:52:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-3953d3b4-67ff-41eb-9a1a-c12de32cc27b tempest-TestServerVolumeAttachmentScenario-1700580262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.650s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:52:17 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-3953d3b4-67ff-41eb-9a1a-c12de32cc27b tempest-TestServerVolumeAttachmentScenario-1700580262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:52:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2139488595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7b32e87-a71d-4eba-9328-87c8526de819,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93026975739d4caf9e879d1fad37cec6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:52:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:52:09Z,use_quota=True,user_id='82d3b16510634b5e906d8312d5082634',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:52:17 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-3953d3b4-67ff-41eb-9a1a-c12de32cc27b tempest-TestServerVolumeAttachmentScenario-1700580262 None] Creating volume c7b32e87-a71d-4eba-9328-87c8526de819 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:52:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-3953d3b4-67ff-41eb-9a1a-c12de32cc27b tempest-TestServerVolumeAttachmentScenario-1700580262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:52:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-3953d3b4-67ff-41eb-9a1a-c12de32cc27b tempest-TestServerVolumeAttachmentScenario-1700580262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:52:17 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-3953d3b4-67ff-41eb-9a1a-c12de32cc27b tempest-TestServerVolumeAttachmentScenario-1700580262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:52:17 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-3953d3b4-67ff-41eb-9a1a-c12de32cc27b tempest-TestServerVolumeAttachmentScenario-1700580262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:52:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-3953d3b4-67ff-41eb-9a1a-c12de32cc27b tempest-TestServerVolumeAttachmentScenario-1700580262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:52:17 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-3953d3b4-67ff-41eb-9a1a-c12de32cc27b tempest-TestServerVolumeAttachmentScenario-1700580262 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:52:17 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-3953d3b4-67ff-41eb-9a1a-c12de32cc27b tempest-TestServerVolumeAttachmentScenario-1700580262 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:52:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-3953d3b4-67ff-41eb-9a1a-c12de32cc27b tempest-TestServerVolumeAttachmentScenario-1700580262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c7b32e87-a71d-4eba-9328-87c8526de819 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:52:18 devstack sudo[97480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c7b32e87-a71d-4eba-9328-87c8526de819 1073741824 Jul 08 01:52:18 devstack sudo[97480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:52:18 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1725a01a-f755-417b-971a-8bc58c91ce75 tempest-TestServerVolumeAttachmentScenario-1700580262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8abec4ac-7d89-49cb-ad98-7c8fcc2404f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7155157f-98b1-49c5-8e5f-577012d0e574', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:52:18 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1725a01a-f755-417b-971a-8bc58c91ce75 tempest-TestServerVolumeAttachmentScenario-1700580262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eace52d-b480-4a15-8779-4ea6ffd0010f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:52:18 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-1725a01a-f755-417b-971a-8bc58c91ce75 tempest-TestServerVolumeAttachmentScenario-1700580262 None] Volume volume-7155157f-98b1-49c5-8e5f-577012d0e574 (7155157f-98b1-49c5-8e5f-577012d0e574): created successfully Jul 08 01:52:18 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1725a01a-f755-417b-971a-8bc58c91ce75 tempest-TestServerVolumeAttachmentScenario-1700580262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eace52d-b480-4a15-8779-4ea6ffd0010f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:52:18 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1725a01a-f755-417b-971a-8bc58c91ce75 tempest-TestServerVolumeAttachmentScenario-1700580262 None] Flow 'volume_create_manager' (b99416ae-030a-4a7d-9468-e69b801b6e55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:52:18 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-1725a01a-f755-417b-971a-8bc58c91ce75 tempest-TestServerVolumeAttachmentScenario-1700580262 None] Created volume successfully. Jul 08 01:52:18 devstack sudo[97480]: pam_unix(sudo:session): session closed for user root Jul 08 01:52:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-3953d3b4-67ff-41eb-9a1a-c12de32cc27b tempest-TestServerVolumeAttachmentScenario-1700580262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c7b32e87-a71d-4eba-9328-87c8526de819 1073741824" returned: 0 in 0.973s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:52:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-3953d3b4-67ff-41eb-9a1a-c12de32cc27b tempest-TestServerVolumeAttachmentScenario-1700580262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c7b32e87-a71d-4eba-9328-87c8526de819 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:52:19 devstack sudo[97485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c7b32e87-a71d-4eba-9328-87c8526de819 Jul 08 01:52:19 devstack sudo[97485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:52:19 devstack sudo[97485]: pam_unix(sudo:session): session closed for user root Jul 08 01:52:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-3953d3b4-67ff-41eb-9a1a-c12de32cc27b tempest-TestServerVolumeAttachmentScenario-1700580262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c7b32e87-a71d-4eba-9328-87c8526de819" returned: 0 in 0.802s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:52:19 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-3953d3b4-67ff-41eb-9a1a-c12de32cc27b tempest-TestServerVolumeAttachmentScenario-1700580262 None] <== create_volume: return (1830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:52:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-3953d3b4-67ff-41eb-9a1a-c12de32cc27b tempest-TestServerVolumeAttachmentScenario-1700580262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.835s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:52:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5f159b71-68d3-4037-91a8-ff3899a8b7ae tempest-VolumesActionsTest-11317694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 5.142s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:52:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-3953d3b4-67ff-41eb-9a1a-c12de32cc27b tempest-TestServerVolumeAttachmentScenario-1700580262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ea60115-a1f6-40aa-bfca-fc8ce266cad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7b32e87-a71d-4eba-9328-87c8526de819', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:52:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-3953d3b4-67ff-41eb-9a1a-c12de32cc27b tempest-TestServerVolumeAttachmentScenario-1700580262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd68c03b-e32d-4f3a-a4e0-0d32d1a17ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:52:19 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f2dc8d8-f6ba-4691-b2b7-33b931284b49]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:52:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5f159b71-68d3-4037-91a8-ff3899a8b7ae tempest-VolumesActionsTest-11317694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-05100268-f3f4-4d59-a006-e1cd31dd0392 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:52:19 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-3953d3b4-67ff-41eb-9a1a-c12de32cc27b tempest-TestServerVolumeAttachmentScenario-1700580262 None] Volume volume-c7b32e87-a71d-4eba-9328-87c8526de819 (c7b32e87-a71d-4eba-9328-87c8526de819): created successfully Jul 08 01:52:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-3953d3b4-67ff-41eb-9a1a-c12de32cc27b tempest-TestServerVolumeAttachmentScenario-1700580262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd68c03b-e32d-4f3a-a4e0-0d32d1a17ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:52:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-3953d3b4-67ff-41eb-9a1a-c12de32cc27b tempest-TestServerVolumeAttachmentScenario-1700580262 None] Flow 'volume_create_manager' (4526f93b-02fe-42e5-b892-d2ccc4bbaf05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:52:19 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-3953d3b4-67ff-41eb-9a1a-c12de32cc27b tempest-TestServerVolumeAttachmentScenario-1700580262 None] Created volume successfully. Jul 08 01:52:19 devstack sudo[97498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-05100268-f3f4-4d59-a006-e1cd31dd0392 Jul 08 01:52:19 devstack sudo[97498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:52:20 devstack sudo[97498]: pam_unix(sudo:session): session closed for user root Jul 08 01:52:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5f159b71-68d3-4037-91a8-ff3899a8b7ae tempest-VolumesActionsTest-11317694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-05100268-f3f4-4d59-a006-e1cd31dd0392" returned: 0 in 0.761s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:52:20 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa8fec6-5896-45f1-9c94-efb301f7a0cb]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:52:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5f159b71-68d3-4037-91a8-ff3899a8b7ae tempest-VolumesActionsTest-11317694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-05100268-f3f4-4d59-a006-e1cd31dd0392 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:52:20 devstack sudo[97509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-05100268-f3f4-4d59-a006-e1cd31dd0392 Jul 08 01:52:20 devstack sudo[97509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:52:20 devstack cinder-volume[87134]: DEBUG oslo_service.periodic_task [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87134) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:52:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:52:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:52:20 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:52:20 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:52:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:52:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:52:20 devstack sudo[97511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:52:20 devstack sudo[97511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:52:21 devstack sudo[97509]: pam_unix(sudo:session): session closed for user root Jul 08 01:52:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5f159b71-68d3-4037-91a8-ff3899a8b7ae tempest-VolumesActionsTest-11317694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-05100268-f3f4-4d59-a006-e1cd31dd0392" returned: 0 in 0.767s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:52:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5f159b71-68d3-4037-91a8-ff3899a8b7ae tempest-VolumesActionsTest-11317694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-05100268-f3f4-4d59-a006-e1cd31dd0392 /opt/stack/data/cinder/conversion/05100268-f3f4-4d59-a006-e1cd31dd0392.temp_image.ef38618b-09ff-4447-81a4-460b9675b472h7en7cfw.img {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:52:21 devstack sudo[97516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-05100268-f3f4-4d59-a006-e1cd31dd0392 /opt/stack/data/cinder/conversion/05100268-f3f4-4d59-a006-e1cd31dd0392.temp_image.ef38618b-09ff-4447-81a4-460b9675b472h7en7cfw.img Jul 08 01:52:21 devstack sudo[97516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:52:21 devstack sudo[97511]: pam_unix(sudo:session): session closed for user root Jul 08 01:52:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.703s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:52:21 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:52:21 devstack cinder-volume[87134]: DEBUG oslo_service.periodic_task [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running periodic task VolumeManager._thread_info {{(pid=87134) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:52:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] thread count: 28 {{(pid=87134) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:52:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] thread info: [<_MainThread(MainThread, started 129378964615296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87134) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:52:27 devstack sudo[97516]: pam_unix(sudo:session): session closed for user root Jul 08 01:52:27 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5f159b71-68d3-4037-91a8-ff3899a8b7ae tempest-VolumesActionsTest-11317694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-05100268-f3f4-4d59-a006-e1cd31dd0392 /opt/stack/data/cinder/conversion/05100268-f3f4-4d59-a006-e1cd31dd0392.temp_image.ef38618b-09ff-4447-81a4-460b9675b472h7en7cfw.img" returned: 0 in 5.738s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:52:27 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b0800a-c663-4775-8c2c-6f7ba02a5521]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:52:27 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5f159b71-68d3-4037-91a8-ff3899a8b7ae tempest-VolumesActionsTest-11317694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-05100268-f3f4-4d59-a006-e1cd31dd0392 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:52:27 devstack sudo[97634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-05100268-f3f4-4d59-a006-e1cd31dd0392 Jul 08 01:52:27 devstack sudo[97634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:52:28 devstack sudo[97634]: pam_unix(sudo:session): session closed for user root Jul 08 01:52:28 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5f159b71-68d3-4037-91a8-ff3899a8b7ae tempest-VolumesActionsTest-11317694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-05100268-f3f4-4d59-a006-e1cd31dd0392" returned: 0 in 1.030s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:52:28 devstack cinder-volume[87134]: DEBUG cinder.image.image_utils [None req-5f159b71-68d3-4037-91a8-ff3899a8b7ae tempest-VolumesActionsTest-11317694 None] Image conversion details: src /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-05100268-f3f4-4d59-a006-e1cd31dd0392, size 1024.00 MB, duration 5.74 sec, destination /opt/stack/data/cinder/conversion/05100268-f3f4-4d59-a006-e1cd31dd0392.temp_image.ef38618b-09ff-4447-81a4-460b9675b472h7en7cfw.img {{(pid=87134) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:52:28 devstack cinder-volume[87134]: INFO cinder.image.image_utils [None req-5f159b71-68d3-4037-91a8-ff3899a8b7ae tempest-VolumesActionsTest-11317694 None] Converted 1024.00 MB image at 178.45 MB/s Jul 08 01:52:28 devstack cinder-volume[87134]: DEBUG dbcounter [-] [87134] Writing DB stats cinder:SELECT=66,cinder:INSERT=16,cinder:UPDATE=69,cinder:DELETE=6 {{(pid=87134) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:52:28 devstack cinder-volume[87134]: DEBUG dbcounter [-] [87134] Writing DB stats cinder:SELECT=71,cinder:INSERT=18,cinder:UPDATE=77,cinder:DELETE=4 {{(pid=87134) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:52:28 devstack cinder-volume[87134]: DEBUG cinder.image.image_utils [None req-5f159b71-68d3-4037-91a8-ff3899a8b7ae tempest-VolumesActionsTest-11317694 None] ef38618b-09ff-4447-81a4-460b9675b472 was raw, converting to qcow2 {{(pid=87134) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 08 01:52:28 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[522e07c0-d905-4f7f-9624-abd98512dcf4]: (4, 'raw') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:52:28 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5f159b71-68d3-4037-91a8-ff3899a8b7ae tempest-VolumesActionsTest-11317694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/05100268-f3f4-4d59-a006-e1cd31dd0392.temp_image.ef38618b-09ff-4447-81a4-460b9675b472h7en7cfw.img {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:52:28 devstack sudo[97641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/05100268-f3f4-4d59-a006-e1cd31dd0392.temp_image.ef38618b-09ff-4447-81a4-460b9675b472h7en7cfw.img Jul 08 01:52:28 devstack sudo[97641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:52:28 devstack sudo[97641]: pam_unix(sudo:session): session closed for user root Jul 08 01:52:28 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5f159b71-68d3-4037-91a8-ff3899a8b7ae tempest-VolumesActionsTest-11317694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/05100268-f3f4-4d59-a006-e1cd31dd0392.temp_image.ef38618b-09ff-4447-81a4-460b9675b472h7en7cfw.img" returned: 0 in 0.755s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:52:28 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5f159b71-68d3-4037-91a8-ff3899a8b7ae tempest-VolumesActionsTest-11317694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/05100268-f3f4-4d59-a006-e1cd31dd0392.temp_image.ef38618b-09ff-4447-81a4-460b9675b472h7en7cfw.img {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:52:29 devstack sudo[97645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/05100268-f3f4-4d59-a006-e1cd31dd0392.temp_image.ef38618b-09ff-4447-81a4-460b9675b472h7en7cfw.img Jul 08 01:52:29 devstack sudo[97645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:52:29 devstack sudo[97645]: pam_unix(sudo:session): session closed for user root Jul 08 01:52:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5f159b71-68d3-4037-91a8-ff3899a8b7ae tempest-VolumesActionsTest-11317694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/05100268-f3f4-4d59-a006-e1cd31dd0392.temp_image.ef38618b-09ff-4447-81a4-460b9675b472h7en7cfw.img" returned: 1 in 0.748s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:52:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5f159b71-68d3-4037-91a8-ff3899a8b7ae tempest-VolumesActionsTest-11317694 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/05100268-f3f4-4d59-a006-e1cd31dd0392.temp_image.ef38618b-09ff-4447-81a4-460b9675b472h7en7cfw.img' failed. Not Retrying. {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:52:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5f159b71-68d3-4037-91a8-ff3899a8b7ae tempest-VolumesActionsTest-11317694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/05100268-f3f4-4d59-a006-e1cd31dd0392.temp_image.ef38618b-09ff-4447-81a4-460b9675b472h7en7cfw.img /opt/stack/data/cinder/conversion/vol_upload_t3fah0tx {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:52:29 devstack sudo[97650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/05100268-f3f4-4d59-a006-e1cd31dd0392.temp_image.ef38618b-09ff-4447-81a4-460b9675b472h7en7cfw.img /opt/stack/data/cinder/conversion/vol_upload_t3fah0tx Jul 08 01:52:29 devstack sudo[97650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:52:30 devstack sudo[97650]: pam_unix(sudo:session): session closed for user root Jul 08 01:52:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5f159b71-68d3-4037-91a8-ff3899a8b7ae tempest-VolumesActionsTest-11317694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/05100268-f3f4-4d59-a006-e1cd31dd0392.temp_image.ef38618b-09ff-4447-81a4-460b9675b472h7en7cfw.img /opt/stack/data/cinder/conversion/vol_upload_t3fah0tx" returned: 0 in 0.768s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:52:30 devstack cinder-volume[87134]: DEBUG cinder.image.image_utils [None req-5f159b71-68d3-4037-91a8-ff3899a8b7ae tempest-VolumesActionsTest-11317694 None] Image conversion details: src /opt/stack/data/cinder/conversion/05100268-f3f4-4d59-a006-e1cd31dd0392.temp_image.ef38618b-09ff-4447-81a4-460b9675b472h7en7cfw.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_t3fah0tx {{(pid=87134) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:52:30 devstack cinder-volume[87134]: INFO cinder.image.image_utils [None req-5f159b71-68d3-4037-91a8-ff3899a8b7ae tempest-VolumesActionsTest-11317694 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 08 01:52:30 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a6ac53a-394e-4092-ad3d-650edf567566]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:52:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5f159b71-68d3-4037-91a8-ff3899a8b7ae tempest-VolumesActionsTest-11317694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_t3fah0tx {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:52:30 devstack sudo[97661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_t3fah0tx Jul 08 01:52:30 devstack sudo[97661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:52:31 devstack sudo[97661]: pam_unix(sudo:session): session closed for user root Jul 08 01:52:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5f159b71-68d3-4037-91a8-ff3899a8b7ae tempest-VolumesActionsTest-11317694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_t3fah0tx" returned: 0 in 0.797s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:52:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5f159b71-68d3-4037-91a8-ff3899a8b7ae tempest-VolumesActionsTest-11317694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:52:32 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5f159b71-68d3-4037-91a8-ff3899a8b7ae tempest-VolumesActionsTest-11317694 None] Uploaded volume to glance image-id: ef38618b-09ff-4447-81a4-460b9675b472. {{(pid=87134) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 08 01:52:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-da25e1f6-3d16-40d4-b0f5-82f693f7d309 tempest-GroupsTest-1407030482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.761s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:52:32 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-da25e1f6-3d16-40d4-b0f5-82f693f7d309 tempest-GroupsTest-1407030482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ff8077eb-01c1-41ae-b777-0b180f6c9830,created_at=2026-07-07T23:52:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1814669394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ff8077eb-01c1-41ae-b777-0b180f6c9830,host='devstack@QuobyteHD#QuobyteHD',id=c9473ac8-83e9-4025-b6c1-ad5e8e0858ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57e472f0b0e74e7495897c357c7bfa02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:52:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:52:16Z,use_quota=True,user_id='dd782e22763049ce8de7deda77fecf2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8dc8afc-ad01-4932-97d6-3d237b1850d3),volume_type_id=f8dc8afc-ad01-4932-97d6-3d237b1850d3)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:52:32 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-da25e1f6-3d16-40d4-b0f5-82f693f7d309 tempest-GroupsTest-1407030482 None] Creating volume c9473ac8-83e9-4025-b6c1-ad5e8e0858ba {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:52:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-da25e1f6-3d16-40d4-b0f5-82f693f7d309 tempest-GroupsTest-1407030482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:52:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-da25e1f6-3d16-40d4-b0f5-82f693f7d309 tempest-GroupsTest-1407030482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:52:32 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-da25e1f6-3d16-40d4-b0f5-82f693f7d309 tempest-GroupsTest-1407030482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:52:32 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-da25e1f6-3d16-40d4-b0f5-82f693f7d309 tempest-GroupsTest-1407030482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:52:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-da25e1f6-3d16-40d4-b0f5-82f693f7d309 tempest-GroupsTest-1407030482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:52:32 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-da25e1f6-3d16-40d4-b0f5-82f693f7d309 tempest-GroupsTest-1407030482 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:52:32 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-da25e1f6-3d16-40d4-b0f5-82f693f7d309 tempest-GroupsTest-1407030482 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:52:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-da25e1f6-3d16-40d4-b0f5-82f693f7d309 tempest-GroupsTest-1407030482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c9473ac8-83e9-4025-b6c1-ad5e8e0858ba 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:52:32 devstack sudo[97671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c9473ac8-83e9-4025-b6c1-ad5e8e0858ba 1073741824 Jul 08 01:52:32 devstack sudo[97671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:52:32 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-5f159b71-68d3-4037-91a8-ff3899a8b7ae tempest-VolumesActionsTest-11317694 None] Copy volume to image completed successfully. Jul 08 01:52:33 devstack sudo[97671]: pam_unix(sudo:session): session closed for user root Jul 08 01:52:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-da25e1f6-3d16-40d4-b0f5-82f693f7d309 tempest-GroupsTest-1407030482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c9473ac8-83e9-4025-b6c1-ad5e8e0858ba 1073741824" returned: 0 in 0.947s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:52:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-da25e1f6-3d16-40d4-b0f5-82f693f7d309 tempest-GroupsTest-1407030482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c9473ac8-83e9-4025-b6c1-ad5e8e0858ba {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:52:33 devstack sudo[97677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c9473ac8-83e9-4025-b6c1-ad5e8e0858ba Jul 08 01:52:33 devstack sudo[97677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:52:34 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-44c91901-2230-4196-979b-2a30ee8674b0 tempest-VolumesActionsTest-11317694 None] Acquiring lock "cinder-05100268-f3f4-4d59-a006-e1cd31dd0392-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:52:34 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-44c91901-2230-4196-979b-2a30ee8674b0 tempest-VolumesActionsTest-11317694 None] Lock "cinder-05100268-f3f4-4d59-a006-e1cd31dd0392-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:52:34 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-44c91901-2230-4196-979b-2a30ee8674b0 tempest-VolumesActionsTest-11317694 None] Acquiring lock "cinder-quobyte-05100268-f3f4-4d59-a006-e1cd31dd0392" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:52:34 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-44c91901-2230-4196-979b-2a30ee8674b0 tempest-VolumesActionsTest-11317694 None] Lock "cinder-quobyte-05100268-f3f4-4d59-a006-e1cd31dd0392" acquired by "delete_volume" :: waited 0.026s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:52:34 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ab1974-e9e8-4843-8085-0303acdc1846]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:52:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-44c91901-2230-4196-979b-2a30ee8674b0 tempest-VolumesActionsTest-11317694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-05100268-f3f4-4d59-a006-e1cd31dd0392 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:52:34 devstack sudo[97677]: pam_unix(sudo:session): session closed for user root Jul 08 01:52:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-da25e1f6-3d16-40d4-b0f5-82f693f7d309 tempest-GroupsTest-1407030482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c9473ac8-83e9-4025-b6c1-ad5e8e0858ba" returned: 0 in 0.793s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:52:34 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-da25e1f6-3d16-40d4-b0f5-82f693f7d309 tempest-GroupsTest-1407030482 None] <== create_volume: return (1797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:52:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-da25e1f6-3d16-40d4-b0f5-82f693f7d309 tempest-GroupsTest-1407030482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.801s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:52:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-1cc9d969-7b70-4ead-999c-b23229bbd7c2 tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 17.170s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:52:34 devstack sudo[97680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-05100268-f3f4-4d59-a006-e1cd31dd0392 Jul 08 01:52:34 devstack sudo[97680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:52:34 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-da25e1f6-3d16-40d4-b0f5-82f693f7d309 tempest-GroupsTest-1407030482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93fb1d7e-201d-485c-90b2-25cd130addea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9473ac8-83e9-4025-b6c1-ad5e8e0858ba', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:52:34 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-da25e1f6-3d16-40d4-b0f5-82f693f7d309 tempest-GroupsTest-1407030482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd7c2d3b-0377-4216-8e07-5cda6b522a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:52:34 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-1cc9d969-7b70-4ead-999c-b23229bbd7c2 tempest-VolumesSnapshotTestJSON-1781941103 None] Creating offline snapshot 1061b09d-b9cb-4088-8498-e3ba3db4dc29 of volume 4476fd7d-512d-4140-a943-456de92c545b {{(pid=87134) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:52:34 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-da25e1f6-3d16-40d4-b0f5-82f693f7d309 tempest-GroupsTest-1407030482 None] Volume volume-c9473ac8-83e9-4025-b6c1-ad5e8e0858ba (c9473ac8-83e9-4025-b6c1-ad5e8e0858ba): created successfully Jul 08 01:52:34 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-da25e1f6-3d16-40d4-b0f5-82f693f7d309 tempest-GroupsTest-1407030482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd7c2d3b-0377-4216-8e07-5cda6b522a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:52:34 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-da25e1f6-3d16-40d4-b0f5-82f693f7d309 tempest-GroupsTest-1407030482 None] Flow 'volume_create_manager' (e79090a5-abb6-4ae5-86b2-2be7f74fb7c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:52:34 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e94727-5a24-44ab-9f13-50d97c71f582]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:52:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1cc9d969-7b70-4ead-999c-b23229bbd7c2 tempest-VolumesSnapshotTestJSON-1781941103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4476fd7d-512d-4140-a943-456de92c545b {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:52:34 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-da25e1f6-3d16-40d4-b0f5-82f693f7d309 tempest-GroupsTest-1407030482 None] Created volume successfully. Jul 08 01:52:34 devstack sudo[97682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4476fd7d-512d-4140-a943-456de92c545b Jul 08 01:52:34 devstack sudo[97682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:52:35 devstack sudo[97680]: pam_unix(sudo:session): session closed for user root Jul 08 01:52:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-44c91901-2230-4196-979b-2a30ee8674b0 tempest-VolumesActionsTest-11317694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-05100268-f3f4-4d59-a006-e1cd31dd0392" returned: 0 in 0.902s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:52:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-44c91901-2230-4196-979b-2a30ee8674b0 tempest-VolumesActionsTest-11317694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-05100268-f3f4-4d59-a006-e1cd31dd0392 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:52:35 devstack sudo[97687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-05100268-f3f4-4d59-a006-e1cd31dd0392 Jul 08 01:52:35 devstack sudo[97687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:52:35 devstack sudo[97682]: pam_unix(sudo:session): session closed for user root Jul 08 01:52:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1cc9d969-7b70-4ead-999c-b23229bbd7c2 tempest-VolumesSnapshotTestJSON-1781941103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4476fd7d-512d-4140-a943-456de92c545b" returned: 0 in 0.913s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:52:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1cc9d969-7b70-4ead-999c-b23229bbd7c2 tempest-VolumesSnapshotTestJSON-1781941103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4476fd7d-512d-4140-a943-456de92c545b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4476fd7d-512d-4140-a943-456de92c545b.1061b09d-b9cb-4088-8498-e3ba3db4dc29 1G {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:52:35 devstack sudo[97692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4476fd7d-512d-4140-a943-456de92c545b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4476fd7d-512d-4140-a943-456de92c545b.1061b09d-b9cb-4088-8498-e3ba3db4dc29 1G Jul 08 01:52:35 devstack sudo[97692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:52:36 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-2040b7db-e9f7-4083-8c04-cf2cdd4a601e tempest-GroupsTest-1407030482 None] Update group completed successfully. Jul 08 01:52:36 devstack sudo[97687]: pam_unix(sudo:session): session closed for user root Jul 08 01:52:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-44c91901-2230-4196-979b-2a30ee8674b0 tempest-VolumesActionsTest-11317694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-05100268-f3f4-4d59-a006-e1cd31dd0392" returned: 0 in 0.876s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:52:36 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-44c91901-2230-4196-979b-2a30ee8674b0 tempest-VolumesActionsTest-11317694 None] Lock "cinder-quobyte-05100268-f3f4-4d59-a006-e1cd31dd0392" released by "delete_volume" :: held 1.825s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:52:36 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-44c91901-2230-4196-979b-2a30ee8674b0 tempest-VolumesActionsTest-11317694 None] Created reservations ['9a859a02-eff5-45e5-b4d9-f40f5e8eef8c', 'b6c674cf-e843-435b-95fb-9edc77745960', '01b6a095-19ef-41f8-885d-175f781ddc5d', '3161edae-a2a9-41db-97f2-ee36491db351'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:52:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-44c91901-2230-4196-979b-2a30ee8674b0 tempest-VolumesActionsTest-11317694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:52:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-44c91901-2230-4196-979b-2a30ee8674b0 tempest-VolumesActionsTest-11317694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:52:36 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-44c91901-2230-4196-979b-2a30ee8674b0 tempest-VolumesActionsTest-11317694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:52:36 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-44c91901-2230-4196-979b-2a30ee8674b0 tempest-VolumesActionsTest-11317694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:52:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-44c91901-2230-4196-979b-2a30ee8674b0 tempest-VolumesActionsTest-11317694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:52:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-44c91901-2230-4196-979b-2a30ee8674b0 tempest-VolumesActionsTest-11317694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:52:36 devstack sudo[97698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:52:36 devstack sudo[97698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:52:36 devstack sudo[97692]: pam_unix(sudo:session): session closed for user root Jul 08 01:52:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1cc9d969-7b70-4ead-999c-b23229bbd7c2 tempest-VolumesSnapshotTestJSON-1781941103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4476fd7d-512d-4140-a943-456de92c545b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4476fd7d-512d-4140-a943-456de92c545b.1061b09d-b9cb-4088-8498-e3ba3db4dc29 1G" returned: 0 in 1.042s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:52:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1cc9d969-7b70-4ead-999c-b23229bbd7c2 tempest-VolumesSnapshotTestJSON-1781941103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4476fd7d-512d-4140-a943-456de92c545b -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4476fd7d-512d-4140-a943-456de92c545b.1061b09d-b9cb-4088-8498-e3ba3db4dc29 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:52:36 devstack sudo[97700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4476fd7d-512d-4140-a943-456de92c545b -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4476fd7d-512d-4140-a943-456de92c545b.1061b09d-b9cb-4088-8498-e3ba3db4dc29 Jul 08 01:52:36 devstack sudo[97700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:52:37 devstack sudo[97698]: pam_unix(sudo:session): session closed for user root Jul 08 01:52:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-44c91901-2230-4196-979b-2a30ee8674b0 tempest-VolumesActionsTest-11317694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.771s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:52:37 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-44c91901-2230-4196-979b-2a30ee8674b0 tempest-VolumesActionsTest-11317694 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:52:37 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-44c91901-2230-4196-979b-2a30ee8674b0 tempest-VolumesActionsTest-11317694 None] Deleted volume successfully. Jul 08 01:52:37 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-44c91901-2230-4196-979b-2a30ee8674b0 tempest-VolumesActionsTest-11317694 None] Lock "cinder-05100268-f3f4-4d59-a006-e1cd31dd0392-delete_volume" released by "delete_volume" :: held 2.943s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:52:37 devstack sudo[97700]: pam_unix(sudo:session): session closed for user root Jul 08 01:52:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1cc9d969-7b70-4ead-999c-b23229bbd7c2 tempest-VolumesSnapshotTestJSON-1781941103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4476fd7d-512d-4140-a943-456de92c545b -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4476fd7d-512d-4140-a943-456de92c545b.1061b09d-b9cb-4088-8498-e3ba3db4dc29" returned: 0 in 1.017s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:52:37 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-1cc9d969-7b70-4ead-999c-b23229bbd7c2 tempest-VolumesSnapshotTestJSON-1781941103 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4476fd7d-512d-4140-a943-456de92c545b.1061b09d-b9cb-4088-8498-e3ba3db4dc29 is being set with open permissions: ugo+rw Jul 08 01:52:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1cc9d969-7b70-4ead-999c-b23229bbd7c2 tempest-VolumesSnapshotTestJSON-1781941103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4476fd7d-512d-4140-a943-456de92c545b.1061b09d-b9cb-4088-8498-e3ba3db4dc29 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:52:37 devstack sudo[97706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4476fd7d-512d-4140-a943-456de92c545b.1061b09d-b9cb-4088-8498-e3ba3db4dc29 Jul 08 01:52:37 devstack sudo[97706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:52:37 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-5acaecdc-ba60-4c1d-99da-58dafb2af5ba tempest-GroupsTest-1407030482 None] Update group completed successfully. Jul 08 01:52:38 devstack sudo[97706]: pam_unix(sudo:session): session closed for user root Jul 08 01:52:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1cc9d969-7b70-4ead-999c-b23229bbd7c2 tempest-VolumesSnapshotTestJSON-1781941103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4476fd7d-512d-4140-a943-456de92c545b.1061b09d-b9cb-4088-8498-e3ba3db4dc29" returned: 0 in 0.793s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:52:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1cc9d969-7b70-4ead-999c-b23229bbd7c2 tempest-VolumesSnapshotTestJSON-1781941103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4476fd7d-512d-4140-a943-456de92c545b.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:52:38 devstack sudo[97710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4476fd7d-512d-4140-a943-456de92c545b.info Jul 08 01:52:38 devstack sudo[97710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:52:39 devstack sudo[97710]: pam_unix(sudo:session): session closed for user root Jul 08 01:52:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1cc9d969-7b70-4ead-999c-b23229bbd7c2 tempest-VolumesSnapshotTestJSON-1781941103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4476fd7d-512d-4140-a943-456de92c545b.info" returned: 0 in 0.864s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:52:39 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-1cc9d969-7b70-4ead-999c-b23229bbd7c2 tempest-VolumesSnapshotTestJSON-1781941103 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4476fd7d-512d-4140-a943-456de92c545b.info is being set with open permissions: ugo+rw Jul 08 01:52:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1cc9d969-7b70-4ead-999c-b23229bbd7c2 tempest-VolumesSnapshotTestJSON-1781941103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4476fd7d-512d-4140-a943-456de92c545b.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:52:39 devstack sudo[97734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4476fd7d-512d-4140-a943-456de92c545b.info Jul 08 01:52:39 devstack sudo[97734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:52:39 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7acb7149-e3eb-42b8-a3c1-892288d1574f tempest-GroupsTest-1407030482 None] Acquiring lock "cinder-quobyte-3e971ba3-8921-492d-8561-5a6bfa613581" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:52:39 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7acb7149-e3eb-42b8-a3c1-892288d1574f tempest-GroupsTest-1407030482 None] Lock "cinder-quobyte-3e971ba3-8921-492d-8561-5a6bfa613581" acquired by "delete_volume" :: waited 0.030s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:52:39 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc7a9d99-ee22-41c5-9f7c-09ffcb69ed35]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:52:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7acb7149-e3eb-42b8-a3c1-892288d1574f tempest-GroupsTest-1407030482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3e971ba3-8921-492d-8561-5a6bfa613581 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:52:40 devstack sudo[97736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3e971ba3-8921-492d-8561-5a6bfa613581 Jul 08 01:52:40 devstack sudo[97736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:52:40 devstack sudo[97734]: pam_unix(sudo:session): session closed for user root Jul 08 01:52:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1cc9d969-7b70-4ead-999c-b23229bbd7c2 tempest-VolumesSnapshotTestJSON-1781941103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4476fd7d-512d-4140-a943-456de92c545b.info" returned: 0 in 0.894s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:52:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-1cc9d969-7b70-4ead-999c-b23229bbd7c2 tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.751s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:52:40 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-1cc9d969-7b70-4ead-999c-b23229bbd7c2 tempest-VolumesSnapshotTestJSON-1781941103 None] Create snapshot completed successfully Jul 08 01:52:40 devstack sudo[97736]: pam_unix(sudo:session): session closed for user root Jul 08 01:52:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7acb7149-e3eb-42b8-a3c1-892288d1574f tempest-GroupsTest-1407030482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3e971ba3-8921-492d-8561-5a6bfa613581" returned: 0 in 0.918s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:52:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7acb7149-e3eb-42b8-a3c1-892288d1574f tempest-GroupsTest-1407030482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3e971ba3-8921-492d-8561-5a6bfa613581 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:52:40 devstack sudo[97742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3e971ba3-8921-492d-8561-5a6bfa613581 Jul 08 01:52:40 devstack sudo[97742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:52:41 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-9725e756-2a38-4a33-ba7b-114dc877b946 tempest-VolumesSnapshotTestJSON-1781941103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:52:41 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-9725e756-2a38-4a33-ba7b-114dc877b946 tempest-VolumesSnapshotTestJSON-1781941103 None] Flow 'volume_create_manager' (550a4d04-57f4-4686-a7c1-722ee7d84b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:52:41 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-9725e756-2a38-4a33-ba7b-114dc877b946 tempest-VolumesSnapshotTestJSON-1781941103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86bfccec-1a6e-43f6-aaea-a8697afc8036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:52:41 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-9725e756-2a38-4a33-ba7b-114dc877b946 tempest-VolumesSnapshotTestJSON-1781941103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86bfccec-1a6e-43f6-aaea-a8697afc8036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:52:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1766291869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8322c15-0567-4ce7-9348-25e6e6ca2255,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d35d25a53f04475397d55628d5c33338',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:52:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1061b09d-b9cb-4088-8498-e3ba3db4dc29,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:52:41Z,use_quota=True,user_id='a8c972c3a0194d0399a1068466ad9ba0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:52:41 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-9725e756-2a38-4a33-ba7b-114dc877b946 tempest-VolumesSnapshotTestJSON-1781941103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40017f11-f820-44c7-8628-b612ae75cdab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:52:41 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-9725e756-2a38-4a33-ba7b-114dc877b946 tempest-VolumesSnapshotTestJSON-1781941103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40017f11-f820-44c7-8628-b612ae75cdab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:52:41 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-9725e756-2a38-4a33-ba7b-114dc877b946 tempest-VolumesSnapshotTestJSON-1781941103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a35a4f6-f3be-4c36-8442-6ccc8280cba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:52:41 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-9725e756-2a38-4a33-ba7b-114dc877b946 tempest-VolumesSnapshotTestJSON-1781941103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a35a4f6-f3be-4c36-8442-6ccc8280cba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b8322c15-0567-4ce7-9348-25e6e6ca2255', 'volume_name': 'volume-b8322c15-0567-4ce7-9348-25e6e6ca2255', 'volume_size': 1, 'snapshot_id': '1061b09d-b9cb-4088-8498-e3ba3db4dc29'}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:52:41 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-9725e756-2a38-4a33-ba7b-114dc877b946 tempest-VolumesSnapshotTestJSON-1781941103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (265b115a-7b33-488e-87b3-435cfd3e5a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:52:41 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-9725e756-2a38-4a33-ba7b-114dc877b946 tempest-VolumesSnapshotTestJSON-1781941103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (265b115a-7b33-488e-87b3-435cfd3e5a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:52:41 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-9725e756-2a38-4a33-ba7b-114dc877b946 tempest-VolumesSnapshotTestJSON-1781941103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4cc1618-df89-4022-aaac-23860bd44b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:52:41 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-9725e756-2a38-4a33-ba7b-114dc877b946 tempest-VolumesSnapshotTestJSON-1781941103 None] Volume b8322c15-0567-4ce7-9348-25e6e6ca2255: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b8322c15-0567-4ce7-9348-25e6e6ca2255', 'volume_size': 1, 'snapshot_id': '1061b09d-b9cb-4088-8498-e3ba3db4dc29'} Jul 08 01:52:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-9725e756-2a38-4a33-ba7b-114dc877b946 tempest-VolumesSnapshotTestJSON-1781941103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:52:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-9725e756-2a38-4a33-ba7b-114dc877b946 tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:52:41 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-9725e756-2a38-4a33-ba7b-114dc877b946 tempest-VolumesSnapshotTestJSON-1781941103 None] Acquiring lock "cinder-quobyte-1061b09d-b9cb-4088-8498-e3ba3db4dc29-b8322c15-0567-4ce7-9348-25e6e6ca2255" by "_create_volume_from_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:52:41 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-9725e756-2a38-4a33-ba7b-114dc877b946 tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "cinder-quobyte-1061b09d-b9cb-4088-8498-e3ba3db4dc29-b8322c15-0567-4ce7-9348-25e6e6ca2255" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:52:41 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-9725e756-2a38-4a33-ba7b-114dc877b946 tempest-VolumesSnapshotTestJSON-1781941103 None] Creating volume b8322c15-0567-4ce7-9348-25e6e6ca2255 from snapshot 1061b09d-b9cb-4088-8498-e3ba3db4dc29 {{(pid=87134) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 01:52:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-9725e756-2a38-4a33-ba7b-114dc877b946 tempest-VolumesSnapshotTestJSON-1781941103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:52:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-9725e756-2a38-4a33-ba7b-114dc877b946 tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:52:41 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-9725e756-2a38-4a33-ba7b-114dc877b946 tempest-VolumesSnapshotTestJSON-1781941103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:52:41 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-9725e756-2a38-4a33-ba7b-114dc877b946 tempest-VolumesSnapshotTestJSON-1781941103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:52:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-9725e756-2a38-4a33-ba7b-114dc877b946 tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:52:41 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-9725e756-2a38-4a33-ba7b-114dc877b946 tempest-VolumesSnapshotTestJSON-1781941103 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:52:41 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-9725e756-2a38-4a33-ba7b-114dc877b946 tempest-VolumesSnapshotTestJSON-1781941103 None] Acquiring lock "cinder-quobyte-b8322c15-0567-4ce7-9348-25e6e6ca2255" by "_copy_volume_from_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:52:41 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-9725e756-2a38-4a33-ba7b-114dc877b946 tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "cinder-quobyte-b8322c15-0567-4ce7-9348-25e6e6ca2255" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:52:41 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-9725e756-2a38-4a33-ba7b-114dc877b946 tempest-VolumesSnapshotTestJSON-1781941103 None] snapshot: 1061b09d-b9cb-4088-8498-e3ba3db4dc29, volume: b8322c15-0567-4ce7-9348-25e6e6ca2255, {{(pid=87134) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 01:52:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-9725e756-2a38-4a33-ba7b-114dc877b946 tempest-VolumesSnapshotTestJSON-1781941103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:52:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-9725e756-2a38-4a33-ba7b-114dc877b946 tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:52:41 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-9725e756-2a38-4a33-ba7b-114dc877b946 tempest-VolumesSnapshotTestJSON-1781941103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:52:41 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-9725e756-2a38-4a33-ba7b-114dc877b946 tempest-VolumesSnapshotTestJSON-1781941103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:52:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-9725e756-2a38-4a33-ba7b-114dc877b946 tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:52:41 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[9879eb79-c691-4872-8e2a-5e821f848e54]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:52:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9725e756-2a38-4a33-ba7b-114dc877b946 tempest-VolumesSnapshotTestJSON-1781941103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4476fd7d-512d-4140-a943-456de92c545b.1061b09d-b9cb-4088-8498-e3ba3db4dc29 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:52:41 devstack sudo[97742]: pam_unix(sudo:session): session closed for user root Jul 08 01:52:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7acb7149-e3eb-42b8-a3c1-892288d1574f tempest-GroupsTest-1407030482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3e971ba3-8921-492d-8561-5a6bfa613581" returned: 0 in 0.911s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:52:41 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7acb7149-e3eb-42b8-a3c1-892288d1574f tempest-GroupsTest-1407030482 None] Lock "cinder-quobyte-3e971ba3-8921-492d-8561-5a6bfa613581" released by "delete_volume" :: held 1.886s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:52:41 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7acb7149-e3eb-42b8-a3c1-892288d1574f tempest-GroupsTest-1407030482 None] Acquiring lock "cinder-quobyte-c9473ac8-83e9-4025-b6c1-ad5e8e0858ba" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:52:41 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7acb7149-e3eb-42b8-a3c1-892288d1574f tempest-GroupsTest-1407030482 None] Lock "cinder-quobyte-c9473ac8-83e9-4025-b6c1-ad5e8e0858ba" acquired by "delete_volume" :: waited 0.020s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:52:41 devstack sudo[97746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4476fd7d-512d-4140-a943-456de92c545b.1061b09d-b9cb-4088-8498-e3ba3db4dc29 Jul 08 01:52:41 devstack sudo[97746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:52:41 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa40fbcc-5b92-4c0e-8f4d-37b646e50034]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:52:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7acb7149-e3eb-42b8-a3c1-892288d1574f tempest-GroupsTest-1407030482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c9473ac8-83e9-4025-b6c1-ad5e8e0858ba {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:52:41 devstack sudo[97748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c9473ac8-83e9-4025-b6c1-ad5e8e0858ba Jul 08 01:52:41 devstack sudo[97748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:52:42 devstack sudo[97746]: pam_unix(sudo:session): session closed for user root Jul 08 01:52:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9725e756-2a38-4a33-ba7b-114dc877b946 tempest-VolumesSnapshotTestJSON-1781941103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4476fd7d-512d-4140-a943-456de92c545b.1061b09d-b9cb-4088-8498-e3ba3db4dc29" returned: 0 in 1.046s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:52:42 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-9725e756-2a38-4a33-ba7b-114dc877b946 tempest-VolumesSnapshotTestJSON-1781941103 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4476fd7d-512d-4140-a943-456de92c545b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:52:42 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-9725e756-2a38-4a33-ba7b-114dc877b946 tempest-VolumesSnapshotTestJSON-1781941103 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4476fd7d-512d-4140-a943-456de92c545b {{(pid=87134) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 01:52:42 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-9725e756-2a38-4a33-ba7b-114dc877b946 tempest-VolumesSnapshotTestJSON-1781941103 None] Creating direct copy from snapshot {{(pid=87134) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 01:52:42 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3df74b-960b-474f-a77a-5b331a2d0d49]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:52:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9725e756-2a38-4a33-ba7b-114dc877b946 tempest-VolumesSnapshotTestJSON-1781941103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4476fd7d-512d-4140-a943-456de92c545b {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:52:42 devstack sudo[97748]: pam_unix(sudo:session): session closed for user root Jul 08 01:52:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7acb7149-e3eb-42b8-a3c1-892288d1574f tempest-GroupsTest-1407030482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c9473ac8-83e9-4025-b6c1-ad5e8e0858ba" returned: 0 in 0.931s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:52:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7acb7149-e3eb-42b8-a3c1-892288d1574f tempest-GroupsTest-1407030482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c9473ac8-83e9-4025-b6c1-ad5e8e0858ba {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:52:42 devstack sudo[97758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c9473ac8-83e9-4025-b6c1-ad5e8e0858ba Jul 08 01:52:42 devstack sudo[97758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:52:42 devstack sudo[97757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4476fd7d-512d-4140-a943-456de92c545b Jul 08 01:52:42 devstack sudo[97757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:52:43 devstack sudo[97758]: pam_unix(sudo:session): session closed for user root Jul 08 01:52:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7acb7149-e3eb-42b8-a3c1-892288d1574f tempest-GroupsTest-1407030482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c9473ac8-83e9-4025-b6c1-ad5e8e0858ba" returned: 0 in 0.771s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:52:43 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7acb7149-e3eb-42b8-a3c1-892288d1574f tempest-GroupsTest-1407030482 None] Lock "cinder-quobyte-c9473ac8-83e9-4025-b6c1-ad5e8e0858ba" released by "delete_volume" :: held 1.765s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:52:43 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-7acb7149-e3eb-42b8-a3c1-892288d1574f tempest-GroupsTest-1407030482 None] Created reservations ['6685f972-f187-4dae-9213-95c7a6f09f37'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:52:43 devstack cinder-volume[87134]: WARNING cinder.quota [None req-7acb7149-e3eb-42b8-a3c1-892288d1574f tempest-GroupsTest-1407030482 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-176757643 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-176757643, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:52:43 devstack cinder-volume[87134]: WARNING cinder.quota [None req-7acb7149-e3eb-42b8-a3c1-892288d1574f tempest-GroupsTest-1407030482 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-176757643 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-176757643, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:52:43 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-7acb7149-e3eb-42b8-a3c1-892288d1574f tempest-GroupsTest-1407030482 None] Created reservations ['5c8ed71d-7e7a-4c7a-8b18-504ae22b3916', 'b6b2b684-3550-44df-8491-0d14bb6b64c2', '82ae26fe-711a-4097-897e-5f38064857c8', '82c5cbca-5e1d-4aea-9395-9c09c8b46222'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:52:43 devstack sudo[97757]: pam_unix(sudo:session): session closed for user root Jul 08 01:52:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9725e756-2a38-4a33-ba7b-114dc877b946 tempest-VolumesSnapshotTestJSON-1781941103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4476fd7d-512d-4140-a943-456de92c545b" returned: 0 in 1.003s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:52:43 devstack cinder-volume[87134]: DEBUG cinder.utils [None req-9725e756-2a38-4a33-ba7b-114dc877b946 tempest-VolumesSnapshotTestJSON-1781941103 None] Path /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b8322c15-0567-4ce7-9348-25e6e6ca2255 not found in is_blk_device check {{(pid=87134) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 01:52:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9725e756-2a38-4a33-ba7b-114dc877b946 tempest-VolumesSnapshotTestJSON-1781941103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4476fd7d-512d-4140-a943-456de92c545b /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b8322c15-0567-4ce7-9348-25e6e6ca2255 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:52:43 devstack sudo[97765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4476fd7d-512d-4140-a943-456de92c545b /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b8322c15-0567-4ce7-9348-25e6e6ca2255 Jul 08 01:52:43 devstack sudo[97765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:52:43 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-7acb7149-e3eb-42b8-a3c1-892288d1574f tempest-GroupsTest-1407030482 None] Created reservations ['fb4995b1-d5ad-43f5-b1b7-8bc4e25efd8c', 'e37c21c2-d9e0-43bc-aa96-7a0242485153', '099919b5-05db-4979-9757-84cc0982bbba', '036cba76-ff29-421e-bbc6-a4e8d9c1ccb7'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:52:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7acb7149-e3eb-42b8-a3c1-892288d1574f tempest-GroupsTest-1407030482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:52:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7acb7149-e3eb-42b8-a3c1-892288d1574f tempest-GroupsTest-1407030482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:52:43 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-7acb7149-e3eb-42b8-a3c1-892288d1574f tempest-GroupsTest-1407030482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:52:43 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-7acb7149-e3eb-42b8-a3c1-892288d1574f tempest-GroupsTest-1407030482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:52:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7acb7149-e3eb-42b8-a3c1-892288d1574f tempest-GroupsTest-1407030482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:52:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7acb7149-e3eb-42b8-a3c1-892288d1574f tempest-GroupsTest-1407030482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:52:44 devstack sudo[97767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:52:44 devstack sudo[97767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:52:44 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-c17e6fb1-126f-4b5e-85b3-a141e994bacb tempest-VolumesCloneTest-1845431664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:52:44 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c17e6fb1-126f-4b5e-85b3-a141e994bacb tempest-VolumesCloneTest-1845431664 None] Flow 'volume_create_manager' (a6a35fe8-b72f-4528-b257-0d90fffe0aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:52:44 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c17e6fb1-126f-4b5e-85b3-a141e994bacb tempest-VolumesCloneTest-1845431664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f90d3ba-0127-4243-a707-0e96b8acf28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:52:44 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c17e6fb1-126f-4b5e-85b3-a141e994bacb tempest-VolumesCloneTest-1845431664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f90d3ba-0127-4243-a707-0e96b8acf28a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:52:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-716505103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea81b298-09ea-41cc-a402-88511bc7cc32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46e2190252904afdbda39afaf04bb613',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:52:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:52:44Z,use_quota=True,user_id='909f61c8060444289278fa460ff85dd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:52:44 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c17e6fb1-126f-4b5e-85b3-a141e994bacb tempest-VolumesCloneTest-1845431664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42586010-34f9-44a3-9ea0-871e6e1662df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:52:44 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c17e6fb1-126f-4b5e-85b3-a141e994bacb tempest-VolumesCloneTest-1845431664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42586010-34f9-44a3-9ea0-871e6e1662df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:52:44 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c17e6fb1-126f-4b5e-85b3-a141e994bacb tempest-VolumesCloneTest-1845431664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bca2e9b9-8ef5-4291-b784-c6cab21b4ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:52:44 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c17e6fb1-126f-4b5e-85b3-a141e994bacb tempest-VolumesCloneTest-1845431664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bca2e9b9-8ef5-4291-b784-c6cab21b4ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea81b298-09ea-41cc-a402-88511bc7cc32', 'volume_name': 'volume-ea81b298-09ea-41cc-a402-88511bc7cc32', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:52:44 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c17e6fb1-126f-4b5e-85b3-a141e994bacb tempest-VolumesCloneTest-1845431664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (109d8eaa-1696-491d-916f-9da67d88ce93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:52:44 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c17e6fb1-126f-4b5e-85b3-a141e994bacb tempest-VolumesCloneTest-1845431664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (109d8eaa-1696-491d-916f-9da67d88ce93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:52:44 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c17e6fb1-126f-4b5e-85b3-a141e994bacb tempest-VolumesCloneTest-1845431664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (755a2522-c95e-428b-9230-4cb0f2649e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:52:44 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-c17e6fb1-126f-4b5e-85b3-a141e994bacb tempest-VolumesCloneTest-1845431664 None] Volume ea81b298-09ea-41cc-a402-88511bc7cc32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea81b298-09ea-41cc-a402-88511bc7cc32', 'volume_size': 1} Jul 08 01:52:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c17e6fb1-126f-4b5e-85b3-a141e994bacb tempest-VolumesCloneTest-1845431664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:52:44 devstack sudo[97767]: pam_unix(sudo:session): session closed for user root Jul 08 01:52:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7acb7149-e3eb-42b8-a3c1-892288d1574f tempest-GroupsTest-1407030482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.730s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:52:44 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-7acb7149-e3eb-42b8-a3c1-892288d1574f tempest-GroupsTest-1407030482 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:52:44 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-7acb7149-e3eb-42b8-a3c1-892288d1574f tempest-GroupsTest-1407030482 None] Delete group completed successfully. Jul 08 01:52:49 devstack sudo[97765]: pam_unix(sudo:session): session closed for user root Jul 08 01:52:49 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9725e756-2a38-4a33-ba7b-114dc877b946 tempest-VolumesSnapshotTestJSON-1781941103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4476fd7d-512d-4140-a943-456de92c545b /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b8322c15-0567-4ce7-9348-25e6e6ca2255" returned: 0 in 6.069s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:52:49 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53e824c-9b9d-41d9-a88a-0bb572b4211f]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:52:49 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9725e756-2a38-4a33-ba7b-114dc877b946 tempest-VolumesSnapshotTestJSON-1781941103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4476fd7d-512d-4140-a943-456de92c545b {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:52:49 devstack sudo[97781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4476fd7d-512d-4140-a943-456de92c545b Jul 08 01:52:49 devstack sudo[97781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:52:51 devstack sudo[97781]: pam_unix(sudo:session): session closed for user root Jul 08 01:52:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9725e756-2a38-4a33-ba7b-114dc877b946 tempest-VolumesSnapshotTestJSON-1781941103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4476fd7d-512d-4140-a943-456de92c545b" returned: 0 in 1.185s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:52:51 devstack cinder-volume[87134]: DEBUG cinder.image.image_utils [None req-9725e756-2a38-4a33-ba7b-114dc877b946 tempest-VolumesSnapshotTestJSON-1781941103 None] Image conversion details: src /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4476fd7d-512d-4140-a943-456de92c545b, size 1024.00 MB, duration 6.07 sec, destination /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b8322c15-0567-4ce7-9348-25e6e6ca2255 {{(pid=87134) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:52:51 devstack cinder-volume[87134]: INFO cinder.image.image_utils [None req-9725e756-2a38-4a33-ba7b-114dc877b946 tempest-VolumesSnapshotTestJSON-1781941103 None] Converted 1024.00 MB image at 168.69 MB/s Jul 08 01:52:51 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-9725e756-2a38-4a33-ba7b-114dc877b946 tempest-VolumesSnapshotTestJSON-1781941103 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b8322c15-0567-4ce7-9348-25e6e6ca2255 is being set with open permissions: ugo+rw Jul 08 01:52:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9725e756-2a38-4a33-ba7b-114dc877b946 tempest-VolumesSnapshotTestJSON-1781941103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b8322c15-0567-4ce7-9348-25e6e6ca2255 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:52:51 devstack sudo[97787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b8322c15-0567-4ce7-9348-25e6e6ca2255 Jul 08 01:52:51 devstack sudo[97787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:52:51 devstack sudo[97787]: pam_unix(sudo:session): session closed for user root Jul 08 01:52:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9725e756-2a38-4a33-ba7b-114dc877b946 tempest-VolumesSnapshotTestJSON-1781941103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b8322c15-0567-4ce7-9348-25e6e6ca2255" returned: 0 in 0.687s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:52:51 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-9725e756-2a38-4a33-ba7b-114dc877b946 tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "cinder-quobyte-b8322c15-0567-4ce7-9348-25e6e6ca2255" released by "_copy_volume_from_snapshot" :: held 10.126s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:52:51 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-9725e756-2a38-4a33-ba7b-114dc877b946 tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "cinder-quobyte-1061b09d-b9cb-4088-8498-e3ba3db4dc29-b8322c15-0567-4ce7-9348-25e6e6ca2255" released by "_create_volume_from_snapshot" :: held 10.172s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:52:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-9725e756-2a38-4a33-ba7b-114dc877b946 tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.193s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:52:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c17e6fb1-126f-4b5e-85b3-a141e994bacb tempest-VolumesCloneTest-1845431664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.060s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:52:51 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-c17e6fb1-126f-4b5e-85b3-a141e994bacb tempest-VolumesCloneTest-1845431664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:52:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-716505103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea81b298-09ea-41cc-a402-88511bc7cc32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46e2190252904afdbda39afaf04bb613',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:52:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:52:44Z,use_quota=True,user_id='909f61c8060444289278fa460ff85dd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:52:51 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-c17e6fb1-126f-4b5e-85b3-a141e994bacb tempest-VolumesCloneTest-1845431664 None] Creating volume ea81b298-09ea-41cc-a402-88511bc7cc32 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:52:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c17e6fb1-126f-4b5e-85b3-a141e994bacb tempest-VolumesCloneTest-1845431664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:52:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c17e6fb1-126f-4b5e-85b3-a141e994bacb tempest-VolumesCloneTest-1845431664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:52:51 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-c17e6fb1-126f-4b5e-85b3-a141e994bacb tempest-VolumesCloneTest-1845431664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:52:51 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-c17e6fb1-126f-4b5e-85b3-a141e994bacb tempest-VolumesCloneTest-1845431664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:52:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c17e6fb1-126f-4b5e-85b3-a141e994bacb tempest-VolumesCloneTest-1845431664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:52:51 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-c17e6fb1-126f-4b5e-85b3-a141e994bacb tempest-VolumesCloneTest-1845431664 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:52:51 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-c17e6fb1-126f-4b5e-85b3-a141e994bacb tempest-VolumesCloneTest-1845431664 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:52:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c17e6fb1-126f-4b5e-85b3-a141e994bacb tempest-VolumesCloneTest-1845431664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ea81b298-09ea-41cc-a402-88511bc7cc32 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:52:51 devstack sudo[97790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ea81b298-09ea-41cc-a402-88511bc7cc32 1073741824 Jul 08 01:52:51 devstack sudo[97790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:52:51 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-9725e756-2a38-4a33-ba7b-114dc877b946 tempest-VolumesSnapshotTestJSON-1781941103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4cc1618-df89-4022-aaac-23860bd44b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8322c15-0567-4ce7-9348-25e6e6ca2255', 'volume_size': 1, 'snapshot_id': '1061b09d-b9cb-4088-8498-e3ba3db4dc29'}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:52:51 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-9725e756-2a38-4a33-ba7b-114dc877b946 tempest-VolumesSnapshotTestJSON-1781941103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b3adf0a-7c17-467a-8145-30c49c5d3b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:52:51 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-9725e756-2a38-4a33-ba7b-114dc877b946 tempest-VolumesSnapshotTestJSON-1781941103 None] Volume volume-b8322c15-0567-4ce7-9348-25e6e6ca2255 (b8322c15-0567-4ce7-9348-25e6e6ca2255): created successfully Jul 08 01:52:51 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-9725e756-2a38-4a33-ba7b-114dc877b946 tempest-VolumesSnapshotTestJSON-1781941103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b3adf0a-7c17-467a-8145-30c49c5d3b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:52:51 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-9725e756-2a38-4a33-ba7b-114dc877b946 tempest-VolumesSnapshotTestJSON-1781941103 None] Flow 'volume_create_manager' (550a4d04-57f4-4686-a7c1-722ee7d84b87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:52:51 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-9725e756-2a38-4a33-ba7b-114dc877b946 tempest-VolumesSnapshotTestJSON-1781941103 None] Created volume successfully. Jul 08 01:52:52 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-52491605-771b-4213-add5-bd712c87cf8f tempest-VolumesSnapshotTestJSON-1781941103 None] Acquiring lock "cinder-b8322c15-0567-4ce7-9348-25e6e6ca2255-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:52:52 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-52491605-771b-4213-add5-bd712c87cf8f tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "cinder-b8322c15-0567-4ce7-9348-25e6e6ca2255-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:52:52 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-52491605-771b-4213-add5-bd712c87cf8f tempest-VolumesSnapshotTestJSON-1781941103 None] Acquiring lock "cinder-quobyte-b8322c15-0567-4ce7-9348-25e6e6ca2255" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:52:52 devstack sudo[97790]: pam_unix(sudo:session): session closed for user root Jul 08 01:52:52 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c17e6fb1-126f-4b5e-85b3-a141e994bacb tempest-VolumesCloneTest-1845431664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ea81b298-09ea-41cc-a402-88511bc7cc32 1073741824" returned: 0 in 1.056s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:52:52 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-52491605-771b-4213-add5-bd712c87cf8f tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "cinder-quobyte-b8322c15-0567-4ce7-9348-25e6e6ca2255" acquired by "delete_volume" :: waited 0.017s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:52:52 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8cfd4b-b020-47c7-bb78-41419ae68449]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:52:52 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-52491605-771b-4213-add5-bd712c87cf8f tempest-VolumesSnapshotTestJSON-1781941103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b8322c15-0567-4ce7-9348-25e6e6ca2255 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:52:52 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c17e6fb1-126f-4b5e-85b3-a141e994bacb tempest-VolumesCloneTest-1845431664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ea81b298-09ea-41cc-a402-88511bc7cc32 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:52:52 devstack sudo[97799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ea81b298-09ea-41cc-a402-88511bc7cc32 Jul 08 01:52:52 devstack sudo[97799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:52:52 devstack sudo[97798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b8322c15-0567-4ce7-9348-25e6e6ca2255 Jul 08 01:52:52 devstack sudo[97798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:52:53 devstack sudo[97799]: pam_unix(sudo:session): session closed for user root Jul 08 01:52:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c17e6fb1-126f-4b5e-85b3-a141e994bacb tempest-VolumesCloneTest-1845431664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ea81b298-09ea-41cc-a402-88511bc7cc32" returned: 0 in 0.756s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:52:53 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-c17e6fb1-126f-4b5e-85b3-a141e994bacb tempest-VolumesCloneTest-1845431664 None] <== create_volume: return (1890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:52:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c17e6fb1-126f-4b5e-85b3-a141e994bacb tempest-VolumesCloneTest-1845431664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.893s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:52:53 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c17e6fb1-126f-4b5e-85b3-a141e994bacb tempest-VolumesCloneTest-1845431664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (755a2522-c95e-428b-9230-4cb0f2649e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea81b298-09ea-41cc-a402-88511bc7cc32', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:52:53 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c17e6fb1-126f-4b5e-85b3-a141e994bacb tempest-VolumesCloneTest-1845431664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f976816-638c-4b7f-9df9-a0ed852c5dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:52:53 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-c17e6fb1-126f-4b5e-85b3-a141e994bacb tempest-VolumesCloneTest-1845431664 None] Volume volume-ea81b298-09ea-41cc-a402-88511bc7cc32 (ea81b298-09ea-41cc-a402-88511bc7cc32): created successfully Jul 08 01:52:53 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c17e6fb1-126f-4b5e-85b3-a141e994bacb tempest-VolumesCloneTest-1845431664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f976816-638c-4b7f-9df9-a0ed852c5dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:52:53 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c17e6fb1-126f-4b5e-85b3-a141e994bacb tempest-VolumesCloneTest-1845431664 None] Flow 'volume_create_manager' (a6a35fe8-b72f-4528-b257-0d90fffe0aaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:52:53 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-c17e6fb1-126f-4b5e-85b3-a141e994bacb tempest-VolumesCloneTest-1845431664 None] Created volume successfully. Jul 08 01:52:53 devstack sudo[97798]: pam_unix(sudo:session): session closed for user root Jul 08 01:52:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-52491605-771b-4213-add5-bd712c87cf8f tempest-VolumesSnapshotTestJSON-1781941103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b8322c15-0567-4ce7-9348-25e6e6ca2255" returned: 0 in 1.003s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:52:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-52491605-771b-4213-add5-bd712c87cf8f tempest-VolumesSnapshotTestJSON-1781941103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b8322c15-0567-4ce7-9348-25e6e6ca2255 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:52:53 devstack sudo[97809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b8322c15-0567-4ce7-9348-25e6e6ca2255 Jul 08 01:52:53 devstack sudo[97809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:52:54 devstack sudo[97809]: pam_unix(sudo:session): session closed for user root Jul 08 01:52:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-52491605-771b-4213-add5-bd712c87cf8f tempest-VolumesSnapshotTestJSON-1781941103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b8322c15-0567-4ce7-9348-25e6e6ca2255" returned: 0 in 0.714s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:52:54 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-52491605-771b-4213-add5-bd712c87cf8f tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "cinder-quobyte-b8322c15-0567-4ce7-9348-25e6e6ca2255" released by "delete_volume" :: held 1.764s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:52:54 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-52491605-771b-4213-add5-bd712c87cf8f tempest-VolumesSnapshotTestJSON-1781941103 None] Created reservations ['9d678d09-0803-48d8-97f2-53cfa26cea49', '29e97a28-1e14-4313-8682-0a331af01201', '3ca8304e-6b31-43c0-9f4c-351e171a5757', '847fe3a8-1bfa-4cff-870e-75a5088b1521'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:52:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-52491605-771b-4213-add5-bd712c87cf8f tempest-VolumesSnapshotTestJSON-1781941103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:52:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-52491605-771b-4213-add5-bd712c87cf8f tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:52:54 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-52491605-771b-4213-add5-bd712c87cf8f tempest-VolumesSnapshotTestJSON-1781941103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:52:54 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-52491605-771b-4213-add5-bd712c87cf8f tempest-VolumesSnapshotTestJSON-1781941103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:52:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-52491605-771b-4213-add5-bd712c87cf8f tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:52:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-52491605-771b-4213-add5-bd712c87cf8f tempest-VolumesSnapshotTestJSON-1781941103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:52:54 devstack sudo[97812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:52:54 devstack sudo[97812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:52:55 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-89cc824b-c028-4de5-87e4-86ab981a6573 tempest-VolumesSnapshotTestJSON-1781941103 None] Acquiring lock "cinder-1061b09d-b9cb-4088-8498-e3ba3db4dc29-delete_snapshot" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:52:55 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-89cc824b-c028-4de5-87e4-86ab981a6573 tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "cinder-1061b09d-b9cb-4088-8498-e3ba3db4dc29-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:52:55 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-89cc824b-c028-4de5-87e4-86ab981a6573 tempest-VolumesSnapshotTestJSON-1781941103 None] Acquiring lock "cinder-quobyte-4476fd7d-512d-4140-a943-456de92c545b" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:52:55 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-89cc824b-c028-4de5-87e4-86ab981a6573 tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "cinder-quobyte-4476fd7d-512d-4140-a943-456de92c545b" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:52:55 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-89cc824b-c028-4de5-87e4-86ab981a6573 tempest-VolumesSnapshotTestJSON-1781941103 None] Acquiring lock "cinder-quobyte-1061b09d-b9cb-4088-8498-e3ba3db4dc29" by "_delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:52:55 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-89cc824b-c028-4de5-87e4-86ab981a6573 tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "cinder-quobyte-1061b09d-b9cb-4088-8498-e3ba3db4dc29" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:52:55 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-89cc824b-c028-4de5-87e4-86ab981a6573 tempest-VolumesSnapshotTestJSON-1781941103 None] Deleting offline snapshot 1061b09d-b9cb-4088-8498-e3ba3db4dc29 of volume 4476fd7d-512d-4140-a943-456de92c545b {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:52:55 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-89cc824b-c028-4de5-87e4-86ab981a6573 tempest-VolumesSnapshotTestJSON-1781941103 None] snapshot_file for this snap is: volume-4476fd7d-512d-4140-a943-456de92c545b.1061b09d-b9cb-4088-8498-e3ba3db4dc29 {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:52:55 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9c2034-0bcf-435c-aba3-8e6010652605]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:52:55 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-89cc824b-c028-4de5-87e4-86ab981a6573 tempest-VolumesSnapshotTestJSON-1781941103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4476fd7d-512d-4140-a943-456de92c545b.1061b09d-b9cb-4088-8498-e3ba3db4dc29 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:52:55 devstack sudo[97814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4476fd7d-512d-4140-a943-456de92c545b.1061b09d-b9cb-4088-8498-e3ba3db4dc29 Jul 08 01:52:55 devstack sudo[97814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:52:55 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-5068e6ee-ccdd-44b1-b097-0e43b1d80743 tempest-VolumesCloneTest-1845431664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:52:55 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5068e6ee-ccdd-44b1-b097-0e43b1d80743 tempest-VolumesCloneTest-1845431664 None] Flow 'volume_create_manager' (25935985-fbd6-453b-8fbc-14c56c292a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:52:55 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5068e6ee-ccdd-44b1-b097-0e43b1d80743 tempest-VolumesCloneTest-1845431664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (873f70fd-b80a-4ab6-b0af-a8db82fdbef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:52:55 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5068e6ee-ccdd-44b1-b097-0e43b1d80743 tempest-VolumesCloneTest-1845431664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (873f70fd-b80a-4ab6-b0af-a8db82fdbef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:52:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1249994852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9be4f871-25ca-4f0f-b940-a0cfa2d78063,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46e2190252904afdbda39afaf04bb613',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:52:55Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=ea81b298-09ea-41cc-a402-88511bc7cc32,status='creating',terminated_at=None,updated_at=2026-07-07T23:52:55Z,use_quota=True,user_id='909f61c8060444289278fa460ff85dd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:52:55 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5068e6ee-ccdd-44b1-b097-0e43b1d80743 tempest-VolumesCloneTest-1845431664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4cdf4e2-a565-4634-830c-721cb1914804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:52:55 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5068e6ee-ccdd-44b1-b097-0e43b1d80743 tempest-VolumesCloneTest-1845431664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4cdf4e2-a565-4634-830c-721cb1914804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:52:55 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5068e6ee-ccdd-44b1-b097-0e43b1d80743 tempest-VolumesCloneTest-1845431664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b988c20-389f-420f-abe4-efa9c80de6a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:52:55 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5068e6ee-ccdd-44b1-b097-0e43b1d80743 tempest-VolumesCloneTest-1845431664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b988c20-389f-420f-abe4-efa9c80de6a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '9be4f871-25ca-4f0f-b940-a0cfa2d78063', 'volume_name': 'volume-9be4f871-25ca-4f0f-b940-a0cfa2d78063', 'volume_size': 2, 'source_volid': 'ea81b298-09ea-41cc-a402-88511bc7cc32', 'source_volstatus': 'available'}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:52:55 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5068e6ee-ccdd-44b1-b097-0e43b1d80743 tempest-VolumesCloneTest-1845431664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e635b6bc-82a6-45a3-9ca2-169cfb15254c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:52:55 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5068e6ee-ccdd-44b1-b097-0e43b1d80743 tempest-VolumesCloneTest-1845431664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e635b6bc-82a6-45a3-9ca2-169cfb15254c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:52:55 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5068e6ee-ccdd-44b1-b097-0e43b1d80743 tempest-VolumesCloneTest-1845431664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae9a8a08-bc1d-42f4-bf34-dff62ca2ce6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:52:55 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-5068e6ee-ccdd-44b1-b097-0e43b1d80743 tempest-VolumesCloneTest-1845431664 None] Volume 9be4f871-25ca-4f0f-b940-a0cfa2d78063: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-9be4f871-25ca-4f0f-b940-a0cfa2d78063', 'volume_size': 2, 'source_volid': 'ea81b298-09ea-41cc-a402-88511bc7cc32', 'source_volstatus': 'available'} Jul 08 01:52:55 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5068e6ee-ccdd-44b1-b097-0e43b1d80743 tempest-VolumesCloneTest-1845431664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:52:55 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5068e6ee-ccdd-44b1-b097-0e43b1d80743 tempest-VolumesCloneTest-1845431664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:52:55 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-5068e6ee-ccdd-44b1-b097-0e43b1d80743 tempest-VolumesCloneTest-1845431664 None] Cloning volume ea81b298-09ea-41cc-a402-88511bc7cc32 to volume 9be4f871-25ca-4f0f-b940-a0cfa2d78063 Jul 08 01:52:55 devstack sudo[97812]: pam_unix(sudo:session): session closed for user root Jul 08 01:52:55 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-52491605-771b-4213-add5-bd712c87cf8f tempest-VolumesSnapshotTestJSON-1781941103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.994s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:52:55 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-5068e6ee-ccdd-44b1-b097-0e43b1d80743 tempest-VolumesCloneTest-1845431664 None] Creating offline snapshot a768d615-ece4-48e1-be28-f45c88301235 of volume ea81b298-09ea-41cc-a402-88511bc7cc32 {{(pid=87134) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:52:55 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-52491605-771b-4213-add5-bd712c87cf8f tempest-VolumesSnapshotTestJSON-1781941103 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:52:55 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-52491605-771b-4213-add5-bd712c87cf8f tempest-VolumesSnapshotTestJSON-1781941103 None] Deleted volume successfully. Jul 08 01:52:55 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ceac72-61cb-4fa9-af04-5598fd13613e]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:52:55 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5068e6ee-ccdd-44b1-b097-0e43b1d80743 tempest-VolumesCloneTest-1845431664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ea81b298-09ea-41cc-a402-88511bc7cc32 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:52:55 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-52491605-771b-4213-add5-bd712c87cf8f tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "cinder-b8322c15-0567-4ce7-9348-25e6e6ca2255-delete_volume" released by "delete_volume" :: held 3.025s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:52:55 devstack sudo[97817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ea81b298-09ea-41cc-a402-88511bc7cc32 Jul 08 01:52:55 devstack sudo[97817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:52:56 devstack sudo[97814]: pam_unix(sudo:session): session closed for user root Jul 08 01:52:56 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-89cc824b-c028-4de5-87e4-86ab981a6573 tempest-VolumesSnapshotTestJSON-1781941103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4476fd7d-512d-4140-a943-456de92c545b.1061b09d-b9cb-4088-8498-e3ba3db4dc29" returned: 0 in 0.967s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:52:56 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-89cc824b-c028-4de5-87e4-86ab981a6573 tempest-VolumesSnapshotTestJSON-1781941103 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4476fd7d-512d-4140-a943-456de92c545b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:52:56 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb806153-7f20-4d50-b30c-e30678cdca5e]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:52:56 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-89cc824b-c028-4de5-87e4-86ab981a6573 tempest-VolumesSnapshotTestJSON-1781941103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4476fd7d-512d-4140-a943-456de92c545b {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:52:56 devstack sudo[97822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4476fd7d-512d-4140-a943-456de92c545b Jul 08 01:52:56 devstack sudo[97822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:52:56 devstack sudo[97817]: pam_unix(sudo:session): session closed for user root Jul 08 01:52:56 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5068e6ee-ccdd-44b1-b097-0e43b1d80743 tempest-VolumesCloneTest-1845431664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ea81b298-09ea-41cc-a402-88511bc7cc32" returned: 0 in 1.040s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:52:56 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5068e6ee-ccdd-44b1-b097-0e43b1d80743 tempest-VolumesCloneTest-1845431664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ea81b298-09ea-41cc-a402-88511bc7cc32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ea81b298-09ea-41cc-a402-88511bc7cc32.a768d615-ece4-48e1-be28-f45c88301235 1G {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:52:56 devstack sudo[97835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ea81b298-09ea-41cc-a402-88511bc7cc32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ea81b298-09ea-41cc-a402-88511bc7cc32.a768d615-ece4-48e1-be28-f45c88301235 1G Jul 08 01:52:56 devstack sudo[97835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:52:56 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-cc000ce4-a0cc-4d2d-8b7a-05bd168d8f20 req-fe4a8662-d4cf-49ac-8dd4-dc8c65887dd0 tempest-TestServerVolumeAttachmentScenario-1700580262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:52:57 devstack sudo[97822]: pam_unix(sudo:session): session closed for user root Jul 08 01:52:57 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-89cc824b-c028-4de5-87e4-86ab981a6573 tempest-VolumesSnapshotTestJSON-1781941103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4476fd7d-512d-4140-a943-456de92c545b" returned: 0 in 0.921s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:52:57 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-89cc824b-c028-4de5-87e4-86ab981a6573 tempest-VolumesSnapshotTestJSON-1781941103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4476fd7d-512d-4140-a943-456de92c545b.1061b09d-b9cb-4088-8498-e3ba3db4dc29 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:52:57 devstack sudo[97840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4476fd7d-512d-4140-a943-456de92c545b.1061b09d-b9cb-4088-8498-e3ba3db4dc29 Jul 08 01:52:57 devstack sudo[97840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:52:57 devstack sudo[97835]: pam_unix(sudo:session): session closed for user root Jul 08 01:52:57 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5068e6ee-ccdd-44b1-b097-0e43b1d80743 tempest-VolumesCloneTest-1845431664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ea81b298-09ea-41cc-a402-88511bc7cc32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ea81b298-09ea-41cc-a402-88511bc7cc32.a768d615-ece4-48e1-be28-f45c88301235 1G" returned: 0 in 0.955s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:52:57 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5068e6ee-ccdd-44b1-b097-0e43b1d80743 tempest-VolumesCloneTest-1845431664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea81b298-09ea-41cc-a402-88511bc7cc32 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ea81b298-09ea-41cc-a402-88511bc7cc32.a768d615-ece4-48e1-be28-f45c88301235 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:52:57 devstack sudo[97846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea81b298-09ea-41cc-a402-88511bc7cc32 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ea81b298-09ea-41cc-a402-88511bc7cc32.a768d615-ece4-48e1-be28-f45c88301235 Jul 08 01:52:57 devstack sudo[97846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:52:58 devstack sudo[97840]: pam_unix(sudo:session): session closed for user root Jul 08 01:52:58 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-89cc824b-c028-4de5-87e4-86ab981a6573 tempest-VolumesSnapshotTestJSON-1781941103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4476fd7d-512d-4140-a943-456de92c545b.1061b09d-b9cb-4088-8498-e3ba3db4dc29" returned: 0 in 0.903s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:52:58 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-89cc824b-c028-4de5-87e4-86ab981a6573 tempest-VolumesSnapshotTestJSON-1781941103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4476fd7d-512d-4140-a943-456de92c545b.1061b09d-b9cb-4088-8498-e3ba3db4dc29 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:52:58 devstack sudo[97852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4476fd7d-512d-4140-a943-456de92c545b.1061b09d-b9cb-4088-8498-e3ba3db4dc29 Jul 08 01:52:58 devstack sudo[97852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:52:58 devstack sudo[97846]: pam_unix(sudo:session): session closed for user root Jul 08 01:52:58 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5068e6ee-ccdd-44b1-b097-0e43b1d80743 tempest-VolumesCloneTest-1845431664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea81b298-09ea-41cc-a402-88511bc7cc32 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ea81b298-09ea-41cc-a402-88511bc7cc32.a768d615-ece4-48e1-be28-f45c88301235" returned: 0 in 0.820s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:52:58 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-5068e6ee-ccdd-44b1-b097-0e43b1d80743 tempest-VolumesCloneTest-1845431664 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ea81b298-09ea-41cc-a402-88511bc7cc32.a768d615-ece4-48e1-be28-f45c88301235 is being set with open permissions: ugo+rw Jul 08 01:52:58 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5068e6ee-ccdd-44b1-b097-0e43b1d80743 tempest-VolumesCloneTest-1845431664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ea81b298-09ea-41cc-a402-88511bc7cc32.a768d615-ece4-48e1-be28-f45c88301235 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:52:58 devstack sudo[97857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ea81b298-09ea-41cc-a402-88511bc7cc32.a768d615-ece4-48e1-be28-f45c88301235 Jul 08 01:52:58 devstack sudo[97857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:52:58 devstack sudo[97852]: pam_unix(sudo:session): session closed for user root Jul 08 01:52:58 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-89cc824b-c028-4de5-87e4-86ab981a6573 tempest-VolumesSnapshotTestJSON-1781941103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4476fd7d-512d-4140-a943-456de92c545b.1061b09d-b9cb-4088-8498-e3ba3db4dc29" returned: 0 in 0.792s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:52:58 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-89cc824b-c028-4de5-87e4-86ab981a6573 tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "cinder-quobyte-1061b09d-b9cb-4088-8498-e3ba3db4dc29" released by "_delete_snapshot" :: held 3.756s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:52:58 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-89cc824b-c028-4de5-87e4-86ab981a6573 tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "cinder-quobyte-4476fd7d-512d-4140-a943-456de92c545b" released by "delete_snapshot" :: held 3.789s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:52:59 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-89cc824b-c028-4de5-87e4-86ab981a6573 tempest-VolumesSnapshotTestJSON-1781941103 None] Created reservations ['da289304-bf0f-4982-b08e-757996292ca1', '0d211e9b-c43e-4ff0-b960-9f31f2874cfd', '30cc420a-53ed-4cbb-94ce-6dab7bdc7bf0', 'c0464a6c-8c33-4da3-a267-8273bc7d59ba'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:52:59 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-89cc824b-c028-4de5-87e4-86ab981a6573 tempest-VolumesSnapshotTestJSON-1781941103 None] Delete snapshot completed successfully. Jul 08 01:52:59 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-89cc824b-c028-4de5-87e4-86ab981a6573 tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "cinder-1061b09d-b9cb-4088-8498-e3ba3db4dc29-delete_snapshot" released by "delete_snapshot" :: held 3.956s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:52:59 devstack sudo[97857]: pam_unix(sudo:session): session closed for user root Jul 08 01:52:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5068e6ee-ccdd-44b1-b097-0e43b1d80743 tempest-VolumesCloneTest-1845431664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ea81b298-09ea-41cc-a402-88511bc7cc32.a768d615-ece4-48e1-be28-f45c88301235" returned: 0 in 0.766s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:52:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5068e6ee-ccdd-44b1-b097-0e43b1d80743 tempest-VolumesCloneTest-1845431664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ea81b298-09ea-41cc-a402-88511bc7cc32.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:52:59 devstack sudo[97861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ea81b298-09ea-41cc-a402-88511bc7cc32.info Jul 08 01:52:59 devstack sudo[97861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:52:59 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-682815ca-2566-45df-97fb-61041ae70eb3 tempest-VolumesSnapshotTestJSON-1781941103 None] Acquiring lock "cinder-4476fd7d-512d-4140-a943-456de92c545b-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:52:59 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-682815ca-2566-45df-97fb-61041ae70eb3 tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "cinder-4476fd7d-512d-4140-a943-456de92c545b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:52:59 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-682815ca-2566-45df-97fb-61041ae70eb3 tempest-VolumesSnapshotTestJSON-1781941103 None] Acquiring lock "cinder-quobyte-4476fd7d-512d-4140-a943-456de92c545b" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:52:59 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-682815ca-2566-45df-97fb-61041ae70eb3 tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "cinder-quobyte-4476fd7d-512d-4140-a943-456de92c545b" acquired by "delete_volume" :: waited 0.018s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:52:59 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[79baf673-86a2-4e57-953c-623ac31a69bb]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:52:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-682815ca-2566-45df-97fb-61041ae70eb3 tempest-VolumesSnapshotTestJSON-1781941103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4476fd7d-512d-4140-a943-456de92c545b {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:52:59 devstack sudo[97863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4476fd7d-512d-4140-a943-456de92c545b Jul 08 01:52:59 devstack sudo[97863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:00 devstack sudo[97861]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5068e6ee-ccdd-44b1-b097-0e43b1d80743 tempest-VolumesCloneTest-1845431664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ea81b298-09ea-41cc-a402-88511bc7cc32.info" returned: 0 in 0.799s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:00 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-5068e6ee-ccdd-44b1-b097-0e43b1d80743 tempest-VolumesCloneTest-1845431664 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ea81b298-09ea-41cc-a402-88511bc7cc32.info is being set with open permissions: ugo+rw Jul 08 01:53:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5068e6ee-ccdd-44b1-b097-0e43b1d80743 tempest-VolumesCloneTest-1845431664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ea81b298-09ea-41cc-a402-88511bc7cc32.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:00 devstack sudo[97866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ea81b298-09ea-41cc-a402-88511bc7cc32.info Jul 08 01:53:00 devstack sudo[97866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:00 devstack sudo[97863]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-682815ca-2566-45df-97fb-61041ae70eb3 tempest-VolumesSnapshotTestJSON-1781941103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4476fd7d-512d-4140-a943-456de92c545b" returned: 0 in 0.814s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-682815ca-2566-45df-97fb-61041ae70eb3 tempest-VolumesSnapshotTestJSON-1781941103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4476fd7d-512d-4140-a943-456de92c545b {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:00 devstack sudo[97871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4476fd7d-512d-4140-a943-456de92c545b Jul 08 01:53:00 devstack sudo[97871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:00 devstack sudo[97866]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5068e6ee-ccdd-44b1-b097-0e43b1d80743 tempest-VolumesCloneTest-1845431664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ea81b298-09ea-41cc-a402-88511bc7cc32.info" returned: 0 in 0.760s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:00 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-5068e6ee-ccdd-44b1-b097-0e43b1d80743 tempest-VolumesCloneTest-1845431664 None] Acquiring lock "cinder-quobyte-9be4f871-25ca-4f0f-b940-a0cfa2d78063" by "_copy_volume_from_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:53:00 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-5068e6ee-ccdd-44b1-b097-0e43b1d80743 tempest-VolumesCloneTest-1845431664 None] Lock "cinder-quobyte-9be4f871-25ca-4f0f-b940-a0cfa2d78063" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:53:00 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-5068e6ee-ccdd-44b1-b097-0e43b1d80743 tempest-VolumesCloneTest-1845431664 None] snapshot: a768d615-ece4-48e1-be28-f45c88301235, volume: 9be4f871-25ca-4f0f-b940-a0cfa2d78063, {{(pid=87134) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 01:53:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5068e6ee-ccdd-44b1-b097-0e43b1d80743 tempest-VolumesCloneTest-1845431664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:53:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5068e6ee-ccdd-44b1-b097-0e43b1d80743 tempest-VolumesCloneTest-1845431664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:53:00 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-5068e6ee-ccdd-44b1-b097-0e43b1d80743 tempest-VolumesCloneTest-1845431664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:53:00 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-5068e6ee-ccdd-44b1-b097-0e43b1d80743 tempest-VolumesCloneTest-1845431664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:53:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5068e6ee-ccdd-44b1-b097-0e43b1d80743 tempest-VolumesCloneTest-1845431664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:53:00 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9437bf-8a44-4494-afb4-ffad44cbefd5]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:53:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5068e6ee-ccdd-44b1-b097-0e43b1d80743 tempest-VolumesCloneTest-1845431664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ea81b298-09ea-41cc-a402-88511bc7cc32.a768d615-ece4-48e1-be28-f45c88301235 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:01 devstack sudo[97874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ea81b298-09ea-41cc-a402-88511bc7cc32.a768d615-ece4-48e1-be28-f45c88301235 Jul 08 01:53:01 devstack sudo[97874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:01 devstack sudo[97871]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-682815ca-2566-45df-97fb-61041ae70eb3 tempest-VolumesSnapshotTestJSON-1781941103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4476fd7d-512d-4140-a943-456de92c545b" returned: 0 in 0.764s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:01 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-682815ca-2566-45df-97fb-61041ae70eb3 tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "cinder-quobyte-4476fd7d-512d-4140-a943-456de92c545b" released by "delete_volume" :: held 1.664s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:53:01 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-682815ca-2566-45df-97fb-61041ae70eb3 tempest-VolumesSnapshotTestJSON-1781941103 None] Created reservations ['188fcc85-4f61-415c-b245-6e65334cda38', 'd8307807-7ff1-457e-a1fb-47baa579a113', 'c4595ad6-338f-48bd-9f4f-772f3fea9232', '740fa87d-4e31-4a53-988a-a56d25bf2d1d'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:53:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-682815ca-2566-45df-97fb-61041ae70eb3 tempest-VolumesSnapshotTestJSON-1781941103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:53:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-682815ca-2566-45df-97fb-61041ae70eb3 tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:53:01 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-682815ca-2566-45df-97fb-61041ae70eb3 tempest-VolumesSnapshotTestJSON-1781941103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:53:01 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-682815ca-2566-45df-97fb-61041ae70eb3 tempest-VolumesSnapshotTestJSON-1781941103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:53:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-682815ca-2566-45df-97fb-61041ae70eb3 tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:53:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-682815ca-2566-45df-97fb-61041ae70eb3 tempest-VolumesSnapshotTestJSON-1781941103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:01 devstack sudo[97877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:53:01 devstack sudo[97877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:01 devstack sudo[97874]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5068e6ee-ccdd-44b1-b097-0e43b1d80743 tempest-VolumesCloneTest-1845431664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ea81b298-09ea-41cc-a402-88511bc7cc32.a768d615-ece4-48e1-be28-f45c88301235" returned: 0 in 0.900s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:01 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-5068e6ee-ccdd-44b1-b097-0e43b1d80743 tempest-VolumesCloneTest-1845431664 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea81b298-09ea-41cc-a402-88511bc7cc32(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:53:01 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-5068e6ee-ccdd-44b1-b097-0e43b1d80743 tempest-VolumesCloneTest-1845431664 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ea81b298-09ea-41cc-a402-88511bc7cc32 {{(pid=87134) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 01:53:01 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-5068e6ee-ccdd-44b1-b097-0e43b1d80743 tempest-VolumesCloneTest-1845431664 None] Creating direct copy from snapshot {{(pid=87134) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 01:53:01 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a6fc1f-d328-48d9-8718-ff2f8f266d12]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:53:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5068e6ee-ccdd-44b1-b097-0e43b1d80743 tempest-VolumesCloneTest-1845431664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ea81b298-09ea-41cc-a402-88511bc7cc32 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:02 devstack sudo[97882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ea81b298-09ea-41cc-a402-88511bc7cc32 Jul 08 01:53:02 devstack sudo[97882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:02 devstack sudo[97877]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-682815ca-2566-45df-97fb-61041ae70eb3 tempest-VolumesSnapshotTestJSON-1781941103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.745s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:02 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-682815ca-2566-45df-97fb-61041ae70eb3 tempest-VolumesSnapshotTestJSON-1781941103 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:53:02 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-682815ca-2566-45df-97fb-61041ae70eb3 tempest-VolumesSnapshotTestJSON-1781941103 None] Deleted volume successfully. Jul 08 01:53:02 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-682815ca-2566-45df-97fb-61041ae70eb3 tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "cinder-4476fd7d-512d-4140-a943-456de92c545b-delete_volume" released by "delete_volume" :: held 2.707s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:53:02 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-c53f32fe-f29f-49f7-a74a-f8b482cc0903 tempest-VolumeTypesAccessTest-561181343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:53:02 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c53f32fe-f29f-49f7-a74a-f8b482cc0903 tempest-VolumeTypesAccessTest-561181343 None] Flow 'volume_create_manager' (cd5f9ce0-0a63-46c6-ade9-ac22475e06a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:53:02 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c53f32fe-f29f-49f7-a74a-f8b482cc0903 tempest-VolumeTypesAccessTest-561181343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fc14060-bc95-4ac2-a805-b123fa75c58b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:53:02 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c53f32fe-f29f-49f7-a74a-f8b482cc0903 tempest-VolumeTypesAccessTest-561181343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fc14060-bc95-4ac2-a805-b123fa75c58b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:53:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1522137002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=062d8783-818d-43fb-b016-2d15cc4f78bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0691b1e0887f4eed9efe4b6692579265',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:53:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:53:02Z,use_quota=True,user_id='e4afd7f337ea422bad378228d8f8d02c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f6edf8c-96cc-42b0-bf10-7b5e4860d58c),volume_type_id=2f6edf8c-96cc-42b0-bf10-7b5e4860d58c)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:53:02 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c53f32fe-f29f-49f7-a74a-f8b482cc0903 tempest-VolumeTypesAccessTest-561181343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fe326c4-7dce-4f86-847e-72d1ba2a2e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:53:02 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c53f32fe-f29f-49f7-a74a-f8b482cc0903 tempest-VolumeTypesAccessTest-561181343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fe326c4-7dce-4f86-847e-72d1ba2a2e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:53:02 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c53f32fe-f29f-49f7-a74a-f8b482cc0903 tempest-VolumeTypesAccessTest-561181343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3171369-9247-4a60-acc5-ed05315850ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:53:02 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c53f32fe-f29f-49f7-a74a-f8b482cc0903 tempest-VolumeTypesAccessTest-561181343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3171369-9247-4a60-acc5-ed05315850ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '062d8783-818d-43fb-b016-2d15cc4f78bd', 'volume_name': 'volume-062d8783-818d-43fb-b016-2d15cc4f78bd', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:53:02 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c53f32fe-f29f-49f7-a74a-f8b482cc0903 tempest-VolumeTypesAccessTest-561181343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d26b1b2-9182-46f8-abe6-8c015775a25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:53:02 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c53f32fe-f29f-49f7-a74a-f8b482cc0903 tempest-VolumeTypesAccessTest-561181343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d26b1b2-9182-46f8-abe6-8c015775a25a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:53:02 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c53f32fe-f29f-49f7-a74a-f8b482cc0903 tempest-VolumeTypesAccessTest-561181343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f54d86d-afe9-444e-ba80-ea312ee642e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:53:02 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-c53f32fe-f29f-49f7-a74a-f8b482cc0903 tempest-VolumeTypesAccessTest-561181343 None] Volume 062d8783-818d-43fb-b016-2d15cc4f78bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-062d8783-818d-43fb-b016-2d15cc4f78bd', 'volume_size': 1} Jul 08 01:53:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c53f32fe-f29f-49f7-a74a-f8b482cc0903 tempest-VolumeTypesAccessTest-561181343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:53:02 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-74b50b2d-b32a-47b1-baf9-2d891053f677 tempest-VolumesSnapshotTestJSON-1781941103 None] Acquiring lock "cinder-47b93fcb-0cb5-454a-abc0-98c177f4f1ef-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:53:02 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-74b50b2d-b32a-47b1-baf9-2d891053f677 tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "cinder-47b93fcb-0cb5-454a-abc0-98c177f4f1ef-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:53:02 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-74b50b2d-b32a-47b1-baf9-2d891053f677 tempest-VolumesSnapshotTestJSON-1781941103 None] Acquiring lock "cinder-quobyte-47b93fcb-0cb5-454a-abc0-98c177f4f1ef" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:53:02 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-74b50b2d-b32a-47b1-baf9-2d891053f677 tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "cinder-quobyte-47b93fcb-0cb5-454a-abc0-98c177f4f1ef" acquired by "delete_volume" :: waited 0.019s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:53:02 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f7cd3c-602f-446c-a523-c4b90ebe466c]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:53:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-74b50b2d-b32a-47b1-baf9-2d891053f677 tempest-VolumesSnapshotTestJSON-1781941103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-47b93fcb-0cb5-454a-abc0-98c177f4f1ef {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:02 devstack sudo[97889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-47b93fcb-0cb5-454a-abc0-98c177f4f1ef Jul 08 01:53:02 devstack sudo[97889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:02 devstack sudo[97882]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5068e6ee-ccdd-44b1-b097-0e43b1d80743 tempest-VolumesCloneTest-1845431664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ea81b298-09ea-41cc-a402-88511bc7cc32" returned: 0 in 0.883s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:02 devstack cinder-volume[87134]: DEBUG cinder.utils [None req-5068e6ee-ccdd-44b1-b097-0e43b1d80743 tempest-VolumesCloneTest-1845431664 None] Path /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9be4f871-25ca-4f0f-b940-a0cfa2d78063 not found in is_blk_device check {{(pid=87134) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 01:53:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5068e6ee-ccdd-44b1-b097-0e43b1d80743 tempest-VolumesCloneTest-1845431664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ea81b298-09ea-41cc-a402-88511bc7cc32 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9be4f871-25ca-4f0f-b940-a0cfa2d78063 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:02 devstack sudo[97891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ea81b298-09ea-41cc-a402-88511bc7cc32 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9be4f871-25ca-4f0f-b940-a0cfa2d78063 Jul 08 01:53:02 devstack sudo[97891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:03 devstack sudo[97889]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:03 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-74b50b2d-b32a-47b1-baf9-2d891053f677 tempest-VolumesSnapshotTestJSON-1781941103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-47b93fcb-0cb5-454a-abc0-98c177f4f1ef" returned: 0 in 0.845s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:03 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-74b50b2d-b32a-47b1-baf9-2d891053f677 tempest-VolumesSnapshotTestJSON-1781941103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-47b93fcb-0cb5-454a-abc0-98c177f4f1ef {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:03 devstack sudo[97899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-47b93fcb-0cb5-454a-abc0-98c177f4f1ef Jul 08 01:53:03 devstack sudo[97899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:04 devstack sudo[97899]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:05 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-74b50b2d-b32a-47b1-baf9-2d891053f677 tempest-VolumesSnapshotTestJSON-1781941103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-47b93fcb-0cb5-454a-abc0-98c177f4f1ef" returned: 0 in 1.492s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:05 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-74b50b2d-b32a-47b1-baf9-2d891053f677 tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "cinder-quobyte-47b93fcb-0cb5-454a-abc0-98c177f4f1ef" released by "delete_volume" :: held 2.418s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:53:05 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-74b50b2d-b32a-47b1-baf9-2d891053f677 tempest-VolumesSnapshotTestJSON-1781941103 None] Created reservations ['1220e6cf-d880-4a5e-8f41-450ded549add', '923f8319-282c-4027-abaa-bd0d69921ef0', '33da9a5c-0518-4f9a-888f-de0ca36e8178', '079d996b-bcf5-4369-b237-09e4e0049f6e'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:53:05 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-74b50b2d-b32a-47b1-baf9-2d891053f677 tempest-VolumesSnapshotTestJSON-1781941103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:53:05 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-74b50b2d-b32a-47b1-baf9-2d891053f677 tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:53:05 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-74b50b2d-b32a-47b1-baf9-2d891053f677 tempest-VolumesSnapshotTestJSON-1781941103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:53:05 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-74b50b2d-b32a-47b1-baf9-2d891053f677 tempest-VolumesSnapshotTestJSON-1781941103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:53:05 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-74b50b2d-b32a-47b1-baf9-2d891053f677 tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:53:05 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-74b50b2d-b32a-47b1-baf9-2d891053f677 tempest-VolumesSnapshotTestJSON-1781941103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:05 devstack sudo[97910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:53:05 devstack sudo[97910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:06 devstack sudo[97910]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:06 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-74b50b2d-b32a-47b1-baf9-2d891053f677 tempest-VolumesSnapshotTestJSON-1781941103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 1.475s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:06 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-74b50b2d-b32a-47b1-baf9-2d891053f677 tempest-VolumesSnapshotTestJSON-1781941103 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:53:06 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-74b50b2d-b32a-47b1-baf9-2d891053f677 tempest-VolumesSnapshotTestJSON-1781941103 None] Deleted volume successfully. Jul 08 01:53:06 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-74b50b2d-b32a-47b1-baf9-2d891053f677 tempest-VolumesSnapshotTestJSON-1781941103 None] Lock "cinder-47b93fcb-0cb5-454a-abc0-98c177f4f1ef-delete_volume" released by "delete_volume" :: held 4.399s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:53:08 devstack sudo[97891]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:08 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5068e6ee-ccdd-44b1-b097-0e43b1d80743 tempest-VolumesCloneTest-1845431664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ea81b298-09ea-41cc-a402-88511bc7cc32 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9be4f871-25ca-4f0f-b940-a0cfa2d78063" returned: 0 in 5.692s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:08 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[f27b94a2-4ed6-4f88-afac-89bffdd18224]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:53:08 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5068e6ee-ccdd-44b1-b097-0e43b1d80743 tempest-VolumesCloneTest-1845431664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ea81b298-09ea-41cc-a402-88511bc7cc32 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:08 devstack sudo[97923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ea81b298-09ea-41cc-a402-88511bc7cc32 Jul 08 01:53:08 devstack sudo[97923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:09 devstack sudo[97923]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:09 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5068e6ee-ccdd-44b1-b097-0e43b1d80743 tempest-VolumesCloneTest-1845431664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ea81b298-09ea-41cc-a402-88511bc7cc32" returned: 0 in 0.979s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:09 devstack cinder-volume[87134]: DEBUG cinder.image.image_utils [None req-5068e6ee-ccdd-44b1-b097-0e43b1d80743 tempest-VolumesCloneTest-1845431664 None] Image conversion details: src /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ea81b298-09ea-41cc-a402-88511bc7cc32, size 1024.00 MB, duration 5.69 sec, destination /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9be4f871-25ca-4f0f-b940-a0cfa2d78063 {{(pid=87134) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:53:09 devstack cinder-volume[87134]: INFO cinder.image.image_utils [None req-5068e6ee-ccdd-44b1-b097-0e43b1d80743 tempest-VolumesCloneTest-1845431664 None] Converted 1024.00 MB image at 179.86 MB/s Jul 08 01:53:09 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-5068e6ee-ccdd-44b1-b097-0e43b1d80743 tempest-VolumesCloneTest-1845431664 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9be4f871-25ca-4f0f-b940-a0cfa2d78063 is being set with open permissions: ugo+rw Jul 08 01:53:09 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5068e6ee-ccdd-44b1-b097-0e43b1d80743 tempest-VolumesCloneTest-1845431664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9be4f871-25ca-4f0f-b940-a0cfa2d78063 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:09 devstack sudo[97929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9be4f871-25ca-4f0f-b940-a0cfa2d78063 Jul 08 01:53:09 devstack sudo[97929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:10 devstack sudo[97929]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:10 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5068e6ee-ccdd-44b1-b097-0e43b1d80743 tempest-VolumesCloneTest-1845431664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9be4f871-25ca-4f0f-b940-a0cfa2d78063" returned: 0 in 0.660s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:10 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-5068e6ee-ccdd-44b1-b097-0e43b1d80743 tempest-VolumesCloneTest-1845431664 None] Lock "cinder-quobyte-9be4f871-25ca-4f0f-b940-a0cfa2d78063" released by "_copy_volume_from_snapshot" :: held 9.221s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:53:10 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-5068e6ee-ccdd-44b1-b097-0e43b1d80743 tempest-VolumesCloneTest-1845431664 None] Acquiring lock "cinder-quobyte-a768d615-ece4-48e1-be28-f45c88301235" by "_delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:53:10 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-5068e6ee-ccdd-44b1-b097-0e43b1d80743 tempest-VolumesCloneTest-1845431664 None] Lock "cinder-quobyte-a768d615-ece4-48e1-be28-f45c88301235" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:53:10 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-5068e6ee-ccdd-44b1-b097-0e43b1d80743 tempest-VolumesCloneTest-1845431664 None] Deleting offline snapshot a768d615-ece4-48e1-be28-f45c88301235 of volume ea81b298-09ea-41cc-a402-88511bc7cc32 {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:53:10 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-5068e6ee-ccdd-44b1-b097-0e43b1d80743 tempest-VolumesCloneTest-1845431664 None] snapshot_file for this snap is: volume-ea81b298-09ea-41cc-a402-88511bc7cc32.a768d615-ece4-48e1-be28-f45c88301235 {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:53:10 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7056837-879e-4858-8c7a-710bb250f992]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:53:10 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5068e6ee-ccdd-44b1-b097-0e43b1d80743 tempest-VolumesCloneTest-1845431664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ea81b298-09ea-41cc-a402-88511bc7cc32.a768d615-ece4-48e1-be28-f45c88301235 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:10 devstack sudo[97932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ea81b298-09ea-41cc-a402-88511bc7cc32.a768d615-ece4-48e1-be28-f45c88301235 Jul 08 01:53:10 devstack sudo[97932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:11 devstack sudo[97932]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:11 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5068e6ee-ccdd-44b1-b097-0e43b1d80743 tempest-VolumesCloneTest-1845431664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ea81b298-09ea-41cc-a402-88511bc7cc32.a768d615-ece4-48e1-be28-f45c88301235" returned: 0 in 0.842s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:11 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-5068e6ee-ccdd-44b1-b097-0e43b1d80743 tempest-VolumesCloneTest-1845431664 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea81b298-09ea-41cc-a402-88511bc7cc32(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:53:11 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[861ba2c0-8d6e-44e5-a19d-6872fba4d828]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:53:11 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5068e6ee-ccdd-44b1-b097-0e43b1d80743 tempest-VolumesCloneTest-1845431664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ea81b298-09ea-41cc-a402-88511bc7cc32 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:11 devstack sudo[97939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ea81b298-09ea-41cc-a402-88511bc7cc32 Jul 08 01:53:11 devstack sudo[97939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:11 devstack sudo[97939]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:11 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5068e6ee-ccdd-44b1-b097-0e43b1d80743 tempest-VolumesCloneTest-1845431664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ea81b298-09ea-41cc-a402-88511bc7cc32" returned: 0 in 0.817s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:11 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5068e6ee-ccdd-44b1-b097-0e43b1d80743 tempest-VolumesCloneTest-1845431664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ea81b298-09ea-41cc-a402-88511bc7cc32.a768d615-ece4-48e1-be28-f45c88301235 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:11 devstack sudo[97945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ea81b298-09ea-41cc-a402-88511bc7cc32.a768d615-ece4-48e1-be28-f45c88301235 Jul 08 01:53:11 devstack sudo[97945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:12 devstack sudo[97945]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:12 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5068e6ee-ccdd-44b1-b097-0e43b1d80743 tempest-VolumesCloneTest-1845431664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ea81b298-09ea-41cc-a402-88511bc7cc32.a768d615-ece4-48e1-be28-f45c88301235" returned: 0 in 0.833s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:12 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5068e6ee-ccdd-44b1-b097-0e43b1d80743 tempest-VolumesCloneTest-1845431664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ea81b298-09ea-41cc-a402-88511bc7cc32.a768d615-ece4-48e1-be28-f45c88301235 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:12 devstack sudo[97951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ea81b298-09ea-41cc-a402-88511bc7cc32.a768d615-ece4-48e1-be28-f45c88301235 Jul 08 01:53:12 devstack sudo[97951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:13 devstack sudo[97951]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5068e6ee-ccdd-44b1-b097-0e43b1d80743 tempest-VolumesCloneTest-1845431664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ea81b298-09ea-41cc-a402-88511bc7cc32.a768d615-ece4-48e1-be28-f45c88301235" returned: 0 in 0.684s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:13 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-5068e6ee-ccdd-44b1-b097-0e43b1d80743 tempest-VolumesCloneTest-1845431664 None] Lock "cinder-quobyte-a768d615-ece4-48e1-be28-f45c88301235" released by "_delete_snapshot" :: held 3.311s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:53:13 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8b3de3e-0a07-480a-b95e-74c52a974d83 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:53:13 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c8b3de3e-0a07-480a-b95e-74c52a974d83 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Flow 'volume_create_manager' (8de9142c-dff9-432f-a668-c13ce1e8576c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:53:13 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c8b3de3e-0a07-480a-b95e-74c52a974d83 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e2d7bff-6a9a-435f-886b-a4f7dd0ab825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:53:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5068e6ee-ccdd-44b1-b097-0e43b1d80743 tempest-VolumesCloneTest-1845431664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.948s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:53:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-cc000ce4-a0cc-4d2d-8b7a-05bd168d8f20 req-fe4a8662-d4cf-49ac-8dd4-dc8c65887dd0 tempest-TestServerVolumeAttachmentScenario-1700580262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 16.738s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:53:13 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c8b3de3e-0a07-480a-b95e-74c52a974d83 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e2d7bff-6a9a-435f-886b-a4f7dd0ab825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:53:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1518265588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65d89ff0-b6ce-43c2-b976-0362f46db5f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bf4aac49b274607a367ad12d9aff8fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:53:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:53:13Z,use_quota=True,user_id='d6180b715eed408f874b4797f93d3be5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:53:13 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c8b3de3e-0a07-480a-b95e-74c52a974d83 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e122f1cc-6199-4c2b-af72-5da18f4291c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:53:13 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c8b3de3e-0a07-480a-b95e-74c52a974d83 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e122f1cc-6199-4c2b-af72-5da18f4291c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:53:13 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c8b3de3e-0a07-480a-b95e-74c52a974d83 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca6fbb98-3b98-4814-b128-da2e13a5ab00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:53:13 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c8b3de3e-0a07-480a-b95e-74c52a974d83 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca6fbb98-3b98-4814-b128-da2e13a5ab00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65d89ff0-b6ce-43c2-b976-0362f46db5f4', 'volume_name': 'volume-65d89ff0-b6ce-43c2-b976-0362f46db5f4', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:53:13 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c8b3de3e-0a07-480a-b95e-74c52a974d83 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d7f2070-9d5a-4ec9-9c0d-37506b8e2e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:53:13 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c8b3de3e-0a07-480a-b95e-74c52a974d83 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d7f2070-9d5a-4ec9-9c0d-37506b8e2e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:53:13 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c8b3de3e-0a07-480a-b95e-74c52a974d83 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ac5c4e5-ced4-4ee9-975e-00951ac1fac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:53:13 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-c8b3de3e-0a07-480a-b95e-74c52a974d83 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Volume 65d89ff0-b6ce-43c2-b976-0362f46db5f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65d89ff0-b6ce-43c2-b976-0362f46db5f4', 'volume_size': 1} Jul 08 01:53:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c8b3de3e-0a07-480a-b95e-74c52a974d83 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:53:13 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[e218c58c-4ab6-426f-9835-f5f18d3c3001]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:53:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-cc000ce4-a0cc-4d2d-8b7a-05bd168d8f20 req-fe4a8662-d4cf-49ac-8dd4-dc8c65887dd0 tempest-TestServerVolumeAttachmentScenario-1700580262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7155157f-98b1-49c5-8e5f-577012d0e574 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:13 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5068e6ee-ccdd-44b1-b097-0e43b1d80743 tempest-VolumesCloneTest-1845431664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae9a8a08-bc1d-42f4-bf34-dff62ca2ce6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9be4f871-25ca-4f0f-b940-a0cfa2d78063', 'volume_size': 2, 'source_volid': 'ea81b298-09ea-41cc-a402-88511bc7cc32', 'source_volstatus': 'available'}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:53:13 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5068e6ee-ccdd-44b1-b097-0e43b1d80743 tempest-VolumesCloneTest-1845431664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61eb3692-cad9-4a59-abb7-84ead80f72a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:53:13 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-5068e6ee-ccdd-44b1-b097-0e43b1d80743 tempest-VolumesCloneTest-1845431664 None] Volume volume-9be4f871-25ca-4f0f-b940-a0cfa2d78063 (9be4f871-25ca-4f0f-b940-a0cfa2d78063): created successfully Jul 08 01:53:13 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5068e6ee-ccdd-44b1-b097-0e43b1d80743 tempest-VolumesCloneTest-1845431664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61eb3692-cad9-4a59-abb7-84ead80f72a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:53:13 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5068e6ee-ccdd-44b1-b097-0e43b1d80743 tempest-VolumesCloneTest-1845431664 None] Flow 'volume_create_manager' (25935985-fbd6-453b-8fbc-14c56c292a47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:53:13 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-5068e6ee-ccdd-44b1-b097-0e43b1d80743 tempest-VolumesCloneTest-1845431664 None] Created volume successfully. Jul 08 01:53:13 devstack sudo[97954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7155157f-98b1-49c5-8e5f-577012d0e574 Jul 08 01:53:13 devstack sudo[97954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:14 devstack sudo[97954]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:14 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-cc000ce4-a0cc-4d2d-8b7a-05bd168d8f20 req-fe4a8662-d4cf-49ac-8dd4-dc8c65887dd0 tempest-TestServerVolumeAttachmentScenario-1700580262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7155157f-98b1-49c5-8e5f-577012d0e574" returned: 0 in 0.767s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:14 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-cc000ce4-a0cc-4d2d-8b7a-05bd168d8f20 req-fe4a8662-d4cf-49ac-8dd4-dc8c65887dd0 tempest-TestServerVolumeAttachmentScenario-1700580262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.817s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:53:14 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c53f32fe-f29f-49f7-a74a-f8b482cc0903 tempest-VolumeTypesAccessTest-561181343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.953s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:53:14 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-c53f32fe-f29f-49f7-a74a-f8b482cc0903 tempest-VolumeTypesAccessTest-561181343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:53:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1522137002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=062d8783-818d-43fb-b016-2d15cc4f78bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0691b1e0887f4eed9efe4b6692579265',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:53:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:53:02Z,use_quota=True,user_id='e4afd7f337ea422bad378228d8f8d02c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f6edf8c-96cc-42b0-bf10-7b5e4860d58c),volume_type_id=2f6edf8c-96cc-42b0-bf10-7b5e4860d58c)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:53:14 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-c53f32fe-f29f-49f7-a74a-f8b482cc0903 tempest-VolumeTypesAccessTest-561181343 None] Creating volume 062d8783-818d-43fb-b016-2d15cc4f78bd {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:53:14 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c53f32fe-f29f-49f7-a74a-f8b482cc0903 tempest-VolumeTypesAccessTest-561181343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:53:14 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c53f32fe-f29f-49f7-a74a-f8b482cc0903 tempest-VolumeTypesAccessTest-561181343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:53:14 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-c53f32fe-f29f-49f7-a74a-f8b482cc0903 tempest-VolumeTypesAccessTest-561181343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:53:14 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-c53f32fe-f29f-49f7-a74a-f8b482cc0903 tempest-VolumeTypesAccessTest-561181343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:53:14 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c53f32fe-f29f-49f7-a74a-f8b482cc0903 tempest-VolumeTypesAccessTest-561181343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:53:14 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-c53f32fe-f29f-49f7-a74a-f8b482cc0903 tempest-VolumeTypesAccessTest-561181343 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:53:14 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-c53f32fe-f29f-49f7-a74a-f8b482cc0903 tempest-VolumeTypesAccessTest-561181343 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:53:14 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c53f32fe-f29f-49f7-a74a-f8b482cc0903 tempest-VolumeTypesAccessTest-561181343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-062d8783-818d-43fb-b016-2d15cc4f78bd 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:14 devstack sudo[97959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-062d8783-818d-43fb-b016-2d15cc4f78bd 1073741824 Jul 08 01:53:14 devstack sudo[97959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:14 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [req-cc000ce4-a0cc-4d2d-8b7a-05bd168d8f20 req-fe4a8662-d4cf-49ac-8dd4-dc8c65887dd0 tempest-TestServerVolumeAttachmentScenario-1700580262 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17', 'name': 'volume-7155157f-98b1-49c5-8e5f-577012d0e574', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6beb60e0-f5e0-4db7-b4ca-9062efdc329e', 'enforce_multipath': True} {{(pid=87134) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:53:14 devstack cinder-volume[87134]: INFO cinder.volume.manager [req-cc000ce4-a0cc-4d2d-8b7a-05bd168d8f20 req-fe4a8662-d4cf-49ac-8dd4-dc8c65887dd0 tempest-TestServerVolumeAttachmentScenario-1700580262 None] attachment_update completed successfully. Jul 08 01:53:14 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a189434d-90a6-4a89-91d9-03469a2ac084 tempest-VolumesCloneTest-1845431664 None] Acquiring lock "cinder-9be4f871-25ca-4f0f-b940-a0cfa2d78063-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:53:15 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a189434d-90a6-4a89-91d9-03469a2ac084 tempest-VolumesCloneTest-1845431664 None] Lock "cinder-9be4f871-25ca-4f0f-b940-a0cfa2d78063-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:53:15 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a189434d-90a6-4a89-91d9-03469a2ac084 tempest-VolumesCloneTest-1845431664 None] Acquiring lock "cinder-quobyte-9be4f871-25ca-4f0f-b940-a0cfa2d78063" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:53:15 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a189434d-90a6-4a89-91d9-03469a2ac084 tempest-VolumesCloneTest-1845431664 None] Lock "cinder-quobyte-9be4f871-25ca-4f0f-b940-a0cfa2d78063" acquired by "delete_volume" :: waited 0.026s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:53:15 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[1094da37-fd26-4222-84d6-4a6e8d4201e9]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:53:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a189434d-90a6-4a89-91d9-03469a2ac084 tempest-VolumesCloneTest-1845431664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9be4f871-25ca-4f0f-b940-a0cfa2d78063 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:15 devstack sudo[98025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9be4f871-25ca-4f0f-b940-a0cfa2d78063 Jul 08 01:53:15 devstack sudo[98025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:15 devstack sudo[97959]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c53f32fe-f29f-49f7-a74a-f8b482cc0903 tempest-VolumeTypesAccessTest-561181343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-062d8783-818d-43fb-b016-2d15cc4f78bd 1073741824" returned: 0 in 1.063s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c53f32fe-f29f-49f7-a74a-f8b482cc0903 tempest-VolumeTypesAccessTest-561181343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-062d8783-818d-43fb-b016-2d15cc4f78bd {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:15 devstack sudo[98350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-062d8783-818d-43fb-b016-2d15cc4f78bd Jul 08 01:53:15 devstack sudo[98350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:16 devstack sudo[98025]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a189434d-90a6-4a89-91d9-03469a2ac084 tempest-VolumesCloneTest-1845431664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9be4f871-25ca-4f0f-b940-a0cfa2d78063" returned: 0 in 0.944s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a189434d-90a6-4a89-91d9-03469a2ac084 tempest-VolumesCloneTest-1845431664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9be4f871-25ca-4f0f-b940-a0cfa2d78063 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:16 devstack sudo[98355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9be4f871-25ca-4f0f-b940-a0cfa2d78063 Jul 08 01:53:16 devstack sudo[98355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:16 devstack sudo[98350]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c53f32fe-f29f-49f7-a74a-f8b482cc0903 tempest-VolumeTypesAccessTest-561181343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-062d8783-818d-43fb-b016-2d15cc4f78bd" returned: 0 in 0.679s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:16 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-c53f32fe-f29f-49f7-a74a-f8b482cc0903 tempest-VolumeTypesAccessTest-561181343 None] <== create_volume: return (1799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:53:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c53f32fe-f29f-49f7-a74a-f8b482cc0903 tempest-VolumeTypesAccessTest-561181343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.802s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:53:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c8b3de3e-0a07-480a-b95e-74c52a974d83 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.579s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:53:16 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-c8b3de3e-0a07-480a-b95e-74c52a974d83 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:53:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1518265588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65d89ff0-b6ce-43c2-b976-0362f46db5f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bf4aac49b274607a367ad12d9aff8fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:53:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:53:13Z,use_quota=True,user_id='d6180b715eed408f874b4797f93d3be5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:53:16 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-c8b3de3e-0a07-480a-b95e-74c52a974d83 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Creating volume 65d89ff0-b6ce-43c2-b976-0362f46db5f4 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:53:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c8b3de3e-0a07-480a-b95e-74c52a974d83 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:53:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c8b3de3e-0a07-480a-b95e-74c52a974d83 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:53:16 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-c8b3de3e-0a07-480a-b95e-74c52a974d83 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:53:16 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-c8b3de3e-0a07-480a-b95e-74c52a974d83 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:53:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c8b3de3e-0a07-480a-b95e-74c52a974d83 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:53:16 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-c8b3de3e-0a07-480a-b95e-74c52a974d83 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:53:16 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-c8b3de3e-0a07-480a-b95e-74c52a974d83 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:53:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c8b3de3e-0a07-480a-b95e-74c52a974d83 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-65d89ff0-b6ce-43c2-b976-0362f46db5f4 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:16 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c53f32fe-f29f-49f7-a74a-f8b482cc0903 tempest-VolumeTypesAccessTest-561181343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f54d86d-afe9-444e-ba80-ea312ee642e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-062d8783-818d-43fb-b016-2d15cc4f78bd', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:53:16 devstack sudo[98358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-65d89ff0-b6ce-43c2-b976-0362f46db5f4 1073741824 Jul 08 01:53:16 devstack sudo[98358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:16 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c53f32fe-f29f-49f7-a74a-f8b482cc0903 tempest-VolumeTypesAccessTest-561181343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (827e51b3-9f1d-460f-9388-e93d027b4b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:53:16 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-c53f32fe-f29f-49f7-a74a-f8b482cc0903 tempest-VolumeTypesAccessTest-561181343 None] Volume volume-062d8783-818d-43fb-b016-2d15cc4f78bd (062d8783-818d-43fb-b016-2d15cc4f78bd): created successfully Jul 08 01:53:16 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c53f32fe-f29f-49f7-a74a-f8b482cc0903 tempest-VolumeTypesAccessTest-561181343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (827e51b3-9f1d-460f-9388-e93d027b4b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:53:16 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c53f32fe-f29f-49f7-a74a-f8b482cc0903 tempest-VolumeTypesAccessTest-561181343 None] Flow 'volume_create_manager' (cd5f9ce0-0a63-46c6-ade9-ac22475e06a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:53:16 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-c53f32fe-f29f-49f7-a74a-f8b482cc0903 tempest-VolumeTypesAccessTest-561181343 None] Created volume successfully. Jul 08 01:53:16 devstack sudo[98355]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a189434d-90a6-4a89-91d9-03469a2ac084 tempest-VolumesCloneTest-1845431664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9be4f871-25ca-4f0f-b940-a0cfa2d78063" returned: 0 in 0.684s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:16 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a189434d-90a6-4a89-91d9-03469a2ac084 tempest-VolumesCloneTest-1845431664 None] Lock "cinder-quobyte-9be4f871-25ca-4f0f-b940-a0cfa2d78063" released by "delete_volume" :: held 1.690s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:53:16 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-a189434d-90a6-4a89-91d9-03469a2ac084 tempest-VolumesCloneTest-1845431664 None] Created reservations ['78304468-f48f-4975-8cd1-4292f7bb5a93', 'd5e1400f-6d4e-4ac7-b3f2-5495a0783384', 'b2340237-d041-4456-b284-9fbcc68056c9', 'c4cad2e2-b138-49bf-9a9c-0f393ef7649d'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:53:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-a189434d-90a6-4a89-91d9-03469a2ac084 tempest-VolumesCloneTest-1845431664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:53:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-a189434d-90a6-4a89-91d9-03469a2ac084 tempest-VolumesCloneTest-1845431664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:53:16 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-a189434d-90a6-4a89-91d9-03469a2ac084 tempest-VolumesCloneTest-1845431664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:53:16 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-a189434d-90a6-4a89-91d9-03469a2ac084 tempest-VolumesCloneTest-1845431664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:53:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-a189434d-90a6-4a89-91d9-03469a2ac084 tempest-VolumesCloneTest-1845431664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:53:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a189434d-90a6-4a89-91d9-03469a2ac084 tempest-VolumesCloneTest-1845431664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:16 devstack sudo[98364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:53:16 devstack sudo[98364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:17 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-c8d2ff29-4e41-45fd-955f-f1837c4a05cd tempest-VolumeTypesAccessTest-561181343 None] Acquiring lock "cinder-062d8783-818d-43fb-b016-2d15cc4f78bd-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:53:17 devstack sudo[98358]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c8b3de3e-0a07-480a-b95e-74c52a974d83 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-65d89ff0-b6ce-43c2-b976-0362f46db5f4 1073741824" returned: 0 in 1.025s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:17 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-c8d2ff29-4e41-45fd-955f-f1837c4a05cd tempest-VolumeTypesAccessTest-561181343 None] Lock "cinder-062d8783-818d-43fb-b016-2d15cc4f78bd-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:53:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c8b3de3e-0a07-480a-b95e-74c52a974d83 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-65d89ff0-b6ce-43c2-b976-0362f46db5f4 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:17 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-c8d2ff29-4e41-45fd-955f-f1837c4a05cd tempest-VolumeTypesAccessTest-561181343 None] Acquiring lock "cinder-quobyte-062d8783-818d-43fb-b016-2d15cc4f78bd" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:53:17 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-c8d2ff29-4e41-45fd-955f-f1837c4a05cd tempest-VolumeTypesAccessTest-561181343 None] Lock "cinder-quobyte-062d8783-818d-43fb-b016-2d15cc4f78bd" acquired by "delete_volume" :: waited 0.018s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:53:17 devstack sudo[98367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-65d89ff0-b6ce-43c2-b976-0362f46db5f4 Jul 08 01:53:17 devstack sudo[98367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:17 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-5235f57d-eaa4-4808-8ded-71d9398aaa4b tempest-VolumesCloneTest-1845431664 None] Acquiring lock "cinder-ea81b298-09ea-41cc-a402-88511bc7cc32-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:53:17 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[7129460f-2733-48d5-b6b2-31aa92a2302b]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:53:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c8d2ff29-4e41-45fd-955f-f1837c4a05cd tempest-VolumeTypesAccessTest-561181343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-062d8783-818d-43fb-b016-2d15cc4f78bd {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:17 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-5235f57d-eaa4-4808-8ded-71d9398aaa4b tempest-VolumesCloneTest-1845431664 None] Lock "cinder-ea81b298-09ea-41cc-a402-88511bc7cc32-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:53:17 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-5235f57d-eaa4-4808-8ded-71d9398aaa4b tempest-VolumesCloneTest-1845431664 None] Acquiring lock "cinder-quobyte-ea81b298-09ea-41cc-a402-88511bc7cc32" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:53:17 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-5235f57d-eaa4-4808-8ded-71d9398aaa4b tempest-VolumesCloneTest-1845431664 None] Lock "cinder-quobyte-ea81b298-09ea-41cc-a402-88511bc7cc32" acquired by "delete_volume" :: waited 0.027s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:53:17 devstack sudo[98369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-062d8783-818d-43fb-b016-2d15cc4f78bd Jul 08 01:53:17 devstack sudo[98369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:17 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bedf4ce-8cd3-4116-ae0f-81c573443808]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:53:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5235f57d-eaa4-4808-8ded-71d9398aaa4b tempest-VolumesCloneTest-1845431664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ea81b298-09ea-41cc-a402-88511bc7cc32 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:17 devstack sudo[98364]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a189434d-90a6-4a89-91d9-03469a2ac084 tempest-VolumesCloneTest-1845431664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.891s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:17 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-a189434d-90a6-4a89-91d9-03469a2ac084 tempest-VolumesCloneTest-1845431664 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:53:17 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-a189434d-90a6-4a89-91d9-03469a2ac084 tempest-VolumesCloneTest-1845431664 None] Deleted volume successfully. Jul 08 01:53:17 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a189434d-90a6-4a89-91d9-03469a2ac084 tempest-VolumesCloneTest-1845431664 None] Lock "cinder-9be4f871-25ca-4f0f-b940-a0cfa2d78063-delete_volume" released by "delete_volume" :: held 2.846s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:53:17 devstack sudo[98372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ea81b298-09ea-41cc-a402-88511bc7cc32 Jul 08 01:53:17 devstack sudo[98372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:18 devstack sudo[98367]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c8b3de3e-0a07-480a-b95e-74c52a974d83 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-65d89ff0-b6ce-43c2-b976-0362f46db5f4" returned: 0 in 0.899s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:18 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-c8b3de3e-0a07-480a-b95e-74c52a974d83 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] <== create_volume: return (2015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:53:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c8b3de3e-0a07-480a-b95e-74c52a974d83 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.019s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:53:18 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c8b3de3e-0a07-480a-b95e-74c52a974d83 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ac5c4e5-ced4-4ee9-975e-00951ac1fac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65d89ff0-b6ce-43c2-b976-0362f46db5f4', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:53:18 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c8b3de3e-0a07-480a-b95e-74c52a974d83 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1df8be3e-a535-49f8-ac77-e76c5512d1bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:53:18 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-c8b3de3e-0a07-480a-b95e-74c52a974d83 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Volume volume-65d89ff0-b6ce-43c2-b976-0362f46db5f4 (65d89ff0-b6ce-43c2-b976-0362f46db5f4): created successfully Jul 08 01:53:18 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c8b3de3e-0a07-480a-b95e-74c52a974d83 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1df8be3e-a535-49f8-ac77-e76c5512d1bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:53:18 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c8b3de3e-0a07-480a-b95e-74c52a974d83 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Flow 'volume_create_manager' (8de9142c-dff9-432f-a668-c13ce1e8576c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:53:18 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-c8b3de3e-0a07-480a-b95e-74c52a974d83 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Created volume successfully. Jul 08 01:53:18 devstack sudo[98369]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c8d2ff29-4e41-45fd-955f-f1837c4a05cd tempest-VolumeTypesAccessTest-561181343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-062d8783-818d-43fb-b016-2d15cc4f78bd" returned: 0 in 1.003s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c8d2ff29-4e41-45fd-955f-f1837c4a05cd tempest-VolumeTypesAccessTest-561181343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-062d8783-818d-43fb-b016-2d15cc4f78bd {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:18 devstack sudo[98380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-062d8783-818d-43fb-b016-2d15cc4f78bd Jul 08 01:53:18 devstack sudo[98380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:18 devstack sudo[98372]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5235f57d-eaa4-4808-8ded-71d9398aaa4b tempest-VolumesCloneTest-1845431664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ea81b298-09ea-41cc-a402-88511bc7cc32" returned: 0 in 0.875s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5235f57d-eaa4-4808-8ded-71d9398aaa4b tempest-VolumesCloneTest-1845431664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ea81b298-09ea-41cc-a402-88511bc7cc32 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:18 devstack sudo[98383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ea81b298-09ea-41cc-a402-88511bc7cc32 Jul 08 01:53:18 devstack sudo[98383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:19 devstack sudo[98380]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c8d2ff29-4e41-45fd-955f-f1837c4a05cd tempest-VolumeTypesAccessTest-561181343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-062d8783-818d-43fb-b016-2d15cc4f78bd" returned: 0 in 0.722s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:19 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-c8d2ff29-4e41-45fd-955f-f1837c4a05cd tempest-VolumeTypesAccessTest-561181343 None] Lock "cinder-quobyte-062d8783-818d-43fb-b016-2d15cc4f78bd" released by "delete_volume" :: held 1.797s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:53:19 devstack cinder-volume[87134]: WARNING cinder.quota [None req-c8d2ff29-4e41-45fd-955f-f1837c4a05cd tempest-VolumeTypesAccessTest-561181343 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1718797316 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1718797316, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:53:19 devstack cinder-volume[87134]: WARNING cinder.quota [None req-c8d2ff29-4e41-45fd-955f-f1837c4a05cd tempest-VolumeTypesAccessTest-561181343 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1718797316 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1718797316, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:53:19 devstack sudo[98383]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5235f57d-eaa4-4808-8ded-71d9398aaa4b tempest-VolumesCloneTest-1845431664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ea81b298-09ea-41cc-a402-88511bc7cc32" returned: 0 in 0.694s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:19 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-c8d2ff29-4e41-45fd-955f-f1837c4a05cd tempest-VolumeTypesAccessTest-561181343 None] Created reservations ['a811fa96-31cd-4dda-980e-bd7824b5c279', 'f880809d-eb50-4052-a778-3f4c89f7adb3', 'f4493337-c1f9-4b80-92ba-5bd5b0c63d5d', '0ae4ae72-b88b-4043-9a20-19f11d358ef5'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:53:19 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-5235f57d-eaa4-4808-8ded-71d9398aaa4b tempest-VolumesCloneTest-1845431664 None] Lock "cinder-quobyte-ea81b298-09ea-41cc-a402-88511bc7cc32" released by "delete_volume" :: held 1.689s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:53:19 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-5235f57d-eaa4-4808-8ded-71d9398aaa4b tempest-VolumesCloneTest-1845431664 None] Created reservations ['04077b66-ffa8-4b2a-9e20-986a1c9262ca', 'b517e1b2-dff7-40d6-a7d5-3b7f3de1f86b', 'd4ba3f5d-bb9c-4fd9-90d6-b030cf8448e3', 'a61ad5f0-9469-4f53-8c7a-38d0ebb70e87'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:53:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c8d2ff29-4e41-45fd-955f-f1837c4a05cd tempest-VolumeTypesAccessTest-561181343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:53:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c8d2ff29-4e41-45fd-955f-f1837c4a05cd tempest-VolumeTypesAccessTest-561181343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:53:19 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-c8d2ff29-4e41-45fd-955f-f1837c4a05cd tempest-VolumeTypesAccessTest-561181343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:53:19 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-c8d2ff29-4e41-45fd-955f-f1837c4a05cd tempest-VolumeTypesAccessTest-561181343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:53:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c8d2ff29-4e41-45fd-955f-f1837c4a05cd tempest-VolumeTypesAccessTest-561181343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:53:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c8d2ff29-4e41-45fd-955f-f1837c4a05cd tempest-VolumeTypesAccessTest-561181343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:19 devstack sudo[98387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:53:19 devstack sudo[98387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5235f57d-eaa4-4808-8ded-71d9398aaa4b tempest-VolumesCloneTest-1845431664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:53:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5235f57d-eaa4-4808-8ded-71d9398aaa4b tempest-VolumesCloneTest-1845431664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:53:19 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-5235f57d-eaa4-4808-8ded-71d9398aaa4b tempest-VolumesCloneTest-1845431664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:53:19 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-5235f57d-eaa4-4808-8ded-71d9398aaa4b tempest-VolumesCloneTest-1845431664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:53:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5235f57d-eaa4-4808-8ded-71d9398aaa4b tempest-VolumesCloneTest-1845431664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:53:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5235f57d-eaa4-4808-8ded-71d9398aaa4b tempest-VolumesCloneTest-1845431664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:19 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3a37dca-6b7a-4a49-b575-27b2278e9fe7 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:53:19 devstack sudo[98389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:53:19 devstack sudo[98389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-d3a37dca-6b7a-4a49-b575-27b2278e9fe7 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Flow 'volume_create_manager' (ab57ac5c-0db9-4144-9368-29e4603c8cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:53:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-d3a37dca-6b7a-4a49-b575-27b2278e9fe7 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3184f37-6eef-4c8a-8a0f-10e78d2a8efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:53:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-d3a37dca-6b7a-4a49-b575-27b2278e9fe7 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3184f37-6eef-4c8a-8a0f-10e78d2a8efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:53:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1224517873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f733f1a-1d38-481f-89ca-7f40a040c5ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bf4aac49b274607a367ad12d9aff8fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:53:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:53:19Z,use_quota=True,user_id='d6180b715eed408f874b4797f93d3be5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:53:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-d3a37dca-6b7a-4a49-b575-27b2278e9fe7 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af5e2f32-4484-4fe8-ae61-3e5a0d3cbd1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:53:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-d3a37dca-6b7a-4a49-b575-27b2278e9fe7 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af5e2f32-4484-4fe8-ae61-3e5a0d3cbd1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:53:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-d3a37dca-6b7a-4a49-b575-27b2278e9fe7 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f415c19-2d66-4404-9d04-47d7cc9858bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:53:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-d3a37dca-6b7a-4a49-b575-27b2278e9fe7 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f415c19-2d66-4404-9d04-47d7cc9858bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f733f1a-1d38-481f-89ca-7f40a040c5ff', 'volume_name': 'volume-1f733f1a-1d38-481f-89ca-7f40a040c5ff', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:53:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-d3a37dca-6b7a-4a49-b575-27b2278e9fe7 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01811e88-1774-4be0-a4b4-1c952eccf785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:53:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-d3a37dca-6b7a-4a49-b575-27b2278e9fe7 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01811e88-1774-4be0-a4b4-1c952eccf785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:53:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-d3a37dca-6b7a-4a49-b575-27b2278e9fe7 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88d8becc-e22b-4d67-92db-6c4e17b1fe3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:53:19 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-d3a37dca-6b7a-4a49-b575-27b2278e9fe7 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Volume 1f733f1a-1d38-481f-89ca-7f40a040c5ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f733f1a-1d38-481f-89ca-7f40a040c5ff', 'volume_size': 1} Jul 08 01:53:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-d3a37dca-6b7a-4a49-b575-27b2278e9fe7 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:53:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-d3a37dca-6b7a-4a49-b575-27b2278e9fe7 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:53:19 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-d3a37dca-6b7a-4a49-b575-27b2278e9fe7 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:53:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1224517873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f733f1a-1d38-481f-89ca-7f40a040c5ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bf4aac49b274607a367ad12d9aff8fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:53:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:53:19Z,use_quota=True,user_id='d6180b715eed408f874b4797f93d3be5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:53:19 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-d3a37dca-6b7a-4a49-b575-27b2278e9fe7 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Creating volume 1f733f1a-1d38-481f-89ca-7f40a040c5ff {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:53:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-d3a37dca-6b7a-4a49-b575-27b2278e9fe7 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:53:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-d3a37dca-6b7a-4a49-b575-27b2278e9fe7 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:53:19 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-d3a37dca-6b7a-4a49-b575-27b2278e9fe7 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:53:19 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-d3a37dca-6b7a-4a49-b575-27b2278e9fe7 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:53:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-d3a37dca-6b7a-4a49-b575-27b2278e9fe7 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:53:19 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-d3a37dca-6b7a-4a49-b575-27b2278e9fe7 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:53:19 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-d3a37dca-6b7a-4a49-b575-27b2278e9fe7 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:53:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d3a37dca-6b7a-4a49-b575-27b2278e9fe7 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1f733f1a-1d38-481f-89ca-7f40a040c5ff 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:19 devstack sudo[98391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1f733f1a-1d38-481f-89ca-7f40a040c5ff 1073741824 Jul 08 01:53:19 devstack sudo[98391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:20 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e56fc59-f0b6-447b-b7e5-a078e55d655d tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:53:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1e56fc59-f0b6-447b-b7e5-a078e55d655d tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Flow 'volume_create_manager' (ff3efc91-1143-478a-9835-fcaa03d1838f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:53:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1e56fc59-f0b6-447b-b7e5-a078e55d655d tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9da4bf3d-04ad-4469-b4a2-9dcb9cb22198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:53:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1e56fc59-f0b6-447b-b7e5-a078e55d655d tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9da4bf3d-04ad-4469-b4a2-9dcb9cb22198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:53:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1620296482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d63d0068-251a-4340-adea-36b537c6ac50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bf4aac49b274607a367ad12d9aff8fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:53:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:53:20Z,use_quota=True,user_id='d6180b715eed408f874b4797f93d3be5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:53:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1e56fc59-f0b6-447b-b7e5-a078e55d655d tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (302fe3cc-3cdd-43fb-8a6a-738f2ce16764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:53:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1e56fc59-f0b6-447b-b7e5-a078e55d655d tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (302fe3cc-3cdd-43fb-8a6a-738f2ce16764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:53:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1e56fc59-f0b6-447b-b7e5-a078e55d655d tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (616a56ea-58dc-4516-ac46-6ab0a76b6f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:53:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1e56fc59-f0b6-447b-b7e5-a078e55d655d tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (616a56ea-58dc-4516-ac46-6ab0a76b6f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd63d0068-251a-4340-adea-36b537c6ac50', 'volume_name': 'volume-d63d0068-251a-4340-adea-36b537c6ac50', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:53:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1e56fc59-f0b6-447b-b7e5-a078e55d655d tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d06fc22-260e-4a72-b203-b611da8622ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:53:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1e56fc59-f0b6-447b-b7e5-a078e55d655d tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d06fc22-260e-4a72-b203-b611da8622ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:53:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1e56fc59-f0b6-447b-b7e5-a078e55d655d tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0504da2a-e827-4ce9-9f79-6f234381cd01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:53:20 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-1e56fc59-f0b6-447b-b7e5-a078e55d655d tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Volume d63d0068-251a-4340-adea-36b537c6ac50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d63d0068-251a-4340-adea-36b537c6ac50', 'volume_size': 1} Jul 08 01:53:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-1e56fc59-f0b6-447b-b7e5-a078e55d655d tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:53:20 devstack sudo[98387]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c8d2ff29-4e41-45fd-955f-f1837c4a05cd tempest-VolumeTypesAccessTest-561181343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 1.086s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:20 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-c8d2ff29-4e41-45fd-955f-f1837c4a05cd tempest-VolumeTypesAccessTest-561181343 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:53:20 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-c8d2ff29-4e41-45fd-955f-f1837c4a05cd tempest-VolumeTypesAccessTest-561181343 None] Deleted volume successfully. Jul 08 01:53:20 devstack sudo[98389]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:20 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-c8d2ff29-4e41-45fd-955f-f1837c4a05cd tempest-VolumeTypesAccessTest-561181343 None] Lock "cinder-062d8783-818d-43fb-b016-2d15cc4f78bd-delete_volume" released by "delete_volume" :: held 3.309s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:53:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5235f57d-eaa4-4808-8ded-71d9398aaa4b tempest-VolumesCloneTest-1845431664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 1.018s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:20 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-5235f57d-eaa4-4808-8ded-71d9398aaa4b tempest-VolumesCloneTest-1845431664 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:53:20 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-5235f57d-eaa4-4808-8ded-71d9398aaa4b tempest-VolumesCloneTest-1845431664 None] Deleted volume successfully. Jul 08 01:53:20 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-5235f57d-eaa4-4808-8ded-71d9398aaa4b tempest-VolumesCloneTest-1845431664 None] Lock "cinder-ea81b298-09ea-41cc-a402-88511bc7cc32-delete_volume" released by "delete_volume" :: held 3.174s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:53:20 devstack cinder-volume[87134]: DEBUG oslo_service.periodic_task [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87134) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:53:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:53:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:53:20 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:53:20 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:53:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:53:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:20 devstack sudo[98395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:53:20 devstack sudo[98395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:21 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4d80370-ab11-4453-8130-b1337745e6ff tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:53:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-a4d80370-ab11-4453-8130-b1337745e6ff tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Flow 'volume_create_manager' (38060055-c090-44b2-85a1-f925a10b3f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:53:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-a4d80370-ab11-4453-8130-b1337745e6ff tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00a67354-58f2-4e3f-9aca-8d3ade8c0098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:53:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-a4d80370-ab11-4453-8130-b1337745e6ff tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00a67354-58f2-4e3f-9aca-8d3ade8c0098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:53:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-460582202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46f809a1-858d-4de6-8780-6783f8fcb4fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bf4aac49b274607a367ad12d9aff8fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:53:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:53:21Z,use_quota=True,user_id='d6180b715eed408f874b4797f93d3be5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:53:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-a4d80370-ab11-4453-8130-b1337745e6ff tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09503143-46de-4146-bf1f-444da946a50c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:53:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-a4d80370-ab11-4453-8130-b1337745e6ff tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09503143-46de-4146-bf1f-444da946a50c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:53:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-a4d80370-ab11-4453-8130-b1337745e6ff tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1247fab2-7a70-4bc2-928e-924d41b45a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:53:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-a4d80370-ab11-4453-8130-b1337745e6ff tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1247fab2-7a70-4bc2-928e-924d41b45a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46f809a1-858d-4de6-8780-6783f8fcb4fe', 'volume_name': 'volume-46f809a1-858d-4de6-8780-6783f8fcb4fe', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:53:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-a4d80370-ab11-4453-8130-b1337745e6ff tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e99b4d23-77be-4f42-9926-eb313c378bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:53:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-a4d80370-ab11-4453-8130-b1337745e6ff tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e99b4d23-77be-4f42-9926-eb313c378bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:53:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-a4d80370-ab11-4453-8130-b1337745e6ff tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bf4dcc8-b865-4232-967a-30df44bd5242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:53:21 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-a4d80370-ab11-4453-8130-b1337745e6ff tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Volume 46f809a1-858d-4de6-8780-6783f8fcb4fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46f809a1-858d-4de6-8780-6783f8fcb4fe', 'volume_size': 1} Jul 08 01:53:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-a4d80370-ab11-4453-8130-b1337745e6ff tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:53:21 devstack sudo[98391]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d3a37dca-6b7a-4a49-b575-27b2278e9fe7 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1f733f1a-1d38-481f-89ca-7f40a040c5ff 1073741824" returned: 0 in 1.788s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d3a37dca-6b7a-4a49-b575-27b2278e9fe7 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1f733f1a-1d38-481f-89ca-7f40a040c5ff {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:21 devstack sudo[98402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1f733f1a-1d38-481f-89ca-7f40a040c5ff Jul 08 01:53:21 devstack sudo[98402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:21 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc118a6c-8186-442d-baac-718a4fb2df16 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:53:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-dc118a6c-8186-442d-baac-718a4fb2df16 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Flow 'volume_create_manager' (042370c7-f87e-4833-873e-fb7090a62b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:53:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-dc118a6c-8186-442d-baac-718a4fb2df16 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e1be0de-cc68-4882-9a9e-9ad31b7a9f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:53:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-dc118a6c-8186-442d-baac-718a4fb2df16 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e1be0de-cc68-4882-9a9e-9ad31b7a9f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:53:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-447951336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d3f984a-9dec-485e-b5a6-de07f5439751,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bf4aac49b274607a367ad12d9aff8fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:53:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:53:22Z,use_quota=True,user_id='d6180b715eed408f874b4797f93d3be5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:53:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-dc118a6c-8186-442d-baac-718a4fb2df16 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (037f8a7f-23f1-489e-92aa-d5fb263bb820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:53:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-dc118a6c-8186-442d-baac-718a4fb2df16 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (037f8a7f-23f1-489e-92aa-d5fb263bb820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:53:22 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-dc118a6c-8186-442d-baac-718a4fb2df16 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38845c68-231f-48f2-aebe-2dc10d17a71d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:53:22 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-dc118a6c-8186-442d-baac-718a4fb2df16 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38845c68-231f-48f2-aebe-2dc10d17a71d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d3f984a-9dec-485e-b5a6-de07f5439751', 'volume_name': 'volume-2d3f984a-9dec-485e-b5a6-de07f5439751', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:53:22 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-dc118a6c-8186-442d-baac-718a4fb2df16 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adf9c88c-81d6-48f6-8079-f5b3227e0d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:53:22 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-dc118a6c-8186-442d-baac-718a4fb2df16 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adf9c88c-81d6-48f6-8079-f5b3227e0d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:53:22 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-dc118a6c-8186-442d-baac-718a4fb2df16 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c859d8d4-0bb7-4a42-a605-7e14a6dd3519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:53:22 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-dc118a6c-8186-442d-baac-718a4fb2df16 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Volume 2d3f984a-9dec-485e-b5a6-de07f5439751: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d3f984a-9dec-485e-b5a6-de07f5439751', 'volume_size': 1} Jul 08 01:53:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-dc118a6c-8186-442d-baac-718a4fb2df16 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:53:22 devstack sudo[98395]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 1.177s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:22 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:53:22 devstack cinder-volume[87134]: DEBUG oslo_service.periodic_task [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running periodic task VolumeManager._thread_info {{(pid=87134) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:53:22 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] thread count: 28 {{(pid=87134) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:53:22 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] thread info: [<_MainThread(MainThread, started 129378964615296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87134) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:53:22 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-be801680-ef7b-4df4-af02-d7f54a6a2a43 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:53:22 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-be801680-ef7b-4df4-af02-d7f54a6a2a43 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Flow 'volume_create_manager' (e220429c-9448-4096-a5ed-cfaef70d187b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:53:22 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-be801680-ef7b-4df4-af02-d7f54a6a2a43 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74bd300c-0671-4547-a8a6-a6e5c38697dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:53:22 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-be801680-ef7b-4df4-af02-d7f54a6a2a43 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74bd300c-0671-4547-a8a6-a6e5c38697dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:53:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-915022878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4f7644b-991a-4a53-a276-75759939ea59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bf4aac49b274607a367ad12d9aff8fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:53:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:53:22Z,use_quota=True,user_id='d6180b715eed408f874b4797f93d3be5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:53:22 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-be801680-ef7b-4df4-af02-d7f54a6a2a43 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5efc6996-00b8-4737-9cf3-e1ac0a0b79d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:53:22 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-be801680-ef7b-4df4-af02-d7f54a6a2a43 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5efc6996-00b8-4737-9cf3-e1ac0a0b79d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:53:22 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-be801680-ef7b-4df4-af02-d7f54a6a2a43 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd5a4dea-d7f7-4584-a3d5-d114ab9c02cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:53:22 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-be801680-ef7b-4df4-af02-d7f54a6a2a43 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd5a4dea-d7f7-4584-a3d5-d114ab9c02cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4f7644b-991a-4a53-a276-75759939ea59', 'volume_name': 'volume-c4f7644b-991a-4a53-a276-75759939ea59', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:53:22 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-be801680-ef7b-4df4-af02-d7f54a6a2a43 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08122d2b-943f-48a1-8e9c-d92e8032c557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:53:22 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-be801680-ef7b-4df4-af02-d7f54a6a2a43 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08122d2b-943f-48a1-8e9c-d92e8032c557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:53:22 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-be801680-ef7b-4df4-af02-d7f54a6a2a43 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f6ff050-54dc-4259-9582-b99f95700c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:53:22 devstack sudo[98402]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:22 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-be801680-ef7b-4df4-af02-d7f54a6a2a43 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Volume c4f7644b-991a-4a53-a276-75759939ea59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4f7644b-991a-4a53-a276-75759939ea59', 'volume_size': 1} Jul 08 01:53:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-be801680-ef7b-4df4-af02-d7f54a6a2a43 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:53:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d3a37dca-6b7a-4a49-b575-27b2278e9fe7 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1f733f1a-1d38-481f-89ca-7f40a040c5ff" returned: 0 in 0.837s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:22 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-d3a37dca-6b7a-4a49-b575-27b2278e9fe7 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] <== create_volume: return (2732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:53:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-d3a37dca-6b7a-4a49-b575-27b2278e9fe7 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.741s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:53:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-1e56fc59-f0b6-447b-b7e5-a078e55d655d tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.126s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:53:22 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-1e56fc59-f0b6-447b-b7e5-a078e55d655d tempest-CreateVolumesFromSourceVolumeTest-295757694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:53:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1620296482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d63d0068-251a-4340-adea-36b537c6ac50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bf4aac49b274607a367ad12d9aff8fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:53:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:53:20Z,use_quota=True,user_id='d6180b715eed408f874b4797f93d3be5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:53:22 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-1e56fc59-f0b6-447b-b7e5-a078e55d655d tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Creating volume d63d0068-251a-4340-adea-36b537c6ac50 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:53:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-1e56fc59-f0b6-447b-b7e5-a078e55d655d tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:53:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-1e56fc59-f0b6-447b-b7e5-a078e55d655d tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:53:22 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-1e56fc59-f0b6-447b-b7e5-a078e55d655d tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:53:22 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-1e56fc59-f0b6-447b-b7e5-a078e55d655d tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:53:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-1e56fc59-f0b6-447b-b7e5-a078e55d655d tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:53:22 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-1e56fc59-f0b6-447b-b7e5-a078e55d655d tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:53:22 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-1e56fc59-f0b6-447b-b7e5-a078e55d655d tempest-CreateVolumesFromSourceVolumeTest-295757694 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:53:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1e56fc59-f0b6-447b-b7e5-a078e55d655d tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d63d0068-251a-4340-adea-36b537c6ac50 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:22 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-d3a37dca-6b7a-4a49-b575-27b2278e9fe7 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88d8becc-e22b-4d67-92db-6c4e17b1fe3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f733f1a-1d38-481f-89ca-7f40a040c5ff', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:53:22 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-d3a37dca-6b7a-4a49-b575-27b2278e9fe7 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76b8b429-3456-4d5f-b14c-23aa74cd6fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:53:22 devstack sudo[98407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d63d0068-251a-4340-adea-36b537c6ac50 1073741824 Jul 08 01:53:22 devstack sudo[98407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:22 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-d3a37dca-6b7a-4a49-b575-27b2278e9fe7 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Volume volume-1f733f1a-1d38-481f-89ca-7f40a040c5ff (1f733f1a-1d38-481f-89ca-7f40a040c5ff): created successfully Jul 08 01:53:22 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-d3a37dca-6b7a-4a49-b575-27b2278e9fe7 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76b8b429-3456-4d5f-b14c-23aa74cd6fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:53:22 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-d3a37dca-6b7a-4a49-b575-27b2278e9fe7 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Flow 'volume_create_manager' (ab57ac5c-0db9-4144-9368-29e4603c8cd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:53:22 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-d3a37dca-6b7a-4a49-b575-27b2278e9fe7 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Created volume successfully. Jul 08 01:53:23 devstack sudo[98407]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:23 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1e56fc59-f0b6-447b-b7e5-a078e55d655d tempest-CreateVolumesFromSourceVolumeTest-295757694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d63d0068-251a-4340-adea-36b537c6ac50 1073741824" returned: 0 in 1.066s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:23 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1e56fc59-f0b6-447b-b7e5-a078e55d655d tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d63d0068-251a-4340-adea-36b537c6ac50 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:23 devstack sudo[98414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d63d0068-251a-4340-adea-36b537c6ac50 Jul 08 01:53:23 devstack sudo[98414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:24 devstack sudo[98414]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1e56fc59-f0b6-447b-b7e5-a078e55d655d tempest-CreateVolumesFromSourceVolumeTest-295757694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d63d0068-251a-4340-adea-36b537c6ac50" returned: 0 in 0.823s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:24 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-1e56fc59-f0b6-447b-b7e5-a078e55d655d tempest-CreateVolumesFromSourceVolumeTest-295757694 None] <== create_volume: return (1955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:53:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-1e56fc59-f0b6-447b-b7e5-a078e55d655d tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.957s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:53:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-a4d80370-ab11-4453-8130-b1337745e6ff tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.259s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:53:24 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-a4d80370-ab11-4453-8130-b1337745e6ff tempest-CreateVolumesFromSourceVolumeTest-295757694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:53:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-460582202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46f809a1-858d-4de6-8780-6783f8fcb4fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bf4aac49b274607a367ad12d9aff8fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:53:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:53:21Z,use_quota=True,user_id='d6180b715eed408f874b4797f93d3be5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:53:24 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-a4d80370-ab11-4453-8130-b1337745e6ff tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Creating volume 46f809a1-858d-4de6-8780-6783f8fcb4fe {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:53:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-a4d80370-ab11-4453-8130-b1337745e6ff tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:53:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-a4d80370-ab11-4453-8130-b1337745e6ff tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:53:24 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-a4d80370-ab11-4453-8130-b1337745e6ff tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:53:24 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-a4d80370-ab11-4453-8130-b1337745e6ff tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:53:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-a4d80370-ab11-4453-8130-b1337745e6ff tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:53:24 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-a4d80370-ab11-4453-8130-b1337745e6ff tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:53:24 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-a4d80370-ab11-4453-8130-b1337745e6ff tempest-CreateVolumesFromSourceVolumeTest-295757694 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:53:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a4d80370-ab11-4453-8130-b1337745e6ff tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-46f809a1-858d-4de6-8780-6783f8fcb4fe 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:24 devstack sudo[98417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-46f809a1-858d-4de6-8780-6783f8fcb4fe 1073741824 Jul 08 01:53:24 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1e56fc59-f0b6-447b-b7e5-a078e55d655d tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0504da2a-e827-4ce9-9f79-6f234381cd01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d63d0068-251a-4340-adea-36b537c6ac50', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:53:24 devstack sudo[98417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:24 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1e56fc59-f0b6-447b-b7e5-a078e55d655d tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e4aea5e-d4f9-4643-a056-404ae492ef7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:53:24 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-1e56fc59-f0b6-447b-b7e5-a078e55d655d tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Volume volume-d63d0068-251a-4340-adea-36b537c6ac50 (d63d0068-251a-4340-adea-36b537c6ac50): created successfully Jul 08 01:53:24 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1e56fc59-f0b6-447b-b7e5-a078e55d655d tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e4aea5e-d4f9-4643-a056-404ae492ef7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:53:24 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1e56fc59-f0b6-447b-b7e5-a078e55d655d tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Flow 'volume_create_manager' (ff3efc91-1143-478a-9835-fcaa03d1838f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:53:24 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-1e56fc59-f0b6-447b-b7e5-a078e55d655d tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Created volume successfully. Jul 08 01:53:25 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dac46df-a04e-4a72-9913-aefff6bf83be tempest-VolumesListTestJSON-1951517864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:53:25 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6dac46df-a04e-4a72-9913-aefff6bf83be tempest-VolumesListTestJSON-1951517864 None] Flow 'volume_create_manager' (08b0d2e6-61d8-46c7-84a5-5db9c0d6e1dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:53:25 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6dac46df-a04e-4a72-9913-aefff6bf83be tempest-VolumesListTestJSON-1951517864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (015bd933-df6a-43a0-b2c6-79790bcf3db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:53:25 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6dac46df-a04e-4a72-9913-aefff6bf83be tempest-VolumesListTestJSON-1951517864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (015bd933-df6a-43a0-b2c6-79790bcf3db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:53:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-574285410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d5a624a-895e-4a8d-a27c-d988b6551fb5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='87f64de143b5439bb7296dd9eedac47c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:53:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:53:25Z,use_quota=True,user_id='6deea91ba22749f689bb0b8a08545884',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:53:25 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6dac46df-a04e-4a72-9913-aefff6bf83be tempest-VolumesListTestJSON-1951517864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e4359e2-665c-4a0d-944e-c76f9e976938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:53:25 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6dac46df-a04e-4a72-9913-aefff6bf83be tempest-VolumesListTestJSON-1951517864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e4359e2-665c-4a0d-944e-c76f9e976938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:53:25 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6dac46df-a04e-4a72-9913-aefff6bf83be tempest-VolumesListTestJSON-1951517864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7e30856-55c8-4949-bcde-dd19b134cdd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:53:25 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6dac46df-a04e-4a72-9913-aefff6bf83be tempest-VolumesListTestJSON-1951517864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7e30856-55c8-4949-bcde-dd19b134cdd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d5a624a-895e-4a8d-a27c-d988b6551fb5', 'volume_name': 'volume-1d5a624a-895e-4a8d-a27c-d988b6551fb5', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:53:25 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6dac46df-a04e-4a72-9913-aefff6bf83be tempest-VolumesListTestJSON-1951517864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71ff8bf8-773a-4723-9353-0dbd3989cb69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:53:25 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6dac46df-a04e-4a72-9913-aefff6bf83be tempest-VolumesListTestJSON-1951517864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71ff8bf8-773a-4723-9353-0dbd3989cb69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:53:25 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6dac46df-a04e-4a72-9913-aefff6bf83be tempest-VolumesListTestJSON-1951517864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0f74c34-be8b-4e51-8ad9-09c1a986e683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:53:25 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-6dac46df-a04e-4a72-9913-aefff6bf83be tempest-VolumesListTestJSON-1951517864 None] Volume 1d5a624a-895e-4a8d-a27c-d988b6551fb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d5a624a-895e-4a8d-a27c-d988b6551fb5', 'volume_size': 1} Jul 08 01:53:25 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6dac46df-a04e-4a72-9913-aefff6bf83be tempest-VolumesListTestJSON-1951517864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:53:25 devstack sudo[98417]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:25 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a4d80370-ab11-4453-8130-b1337745e6ff tempest-CreateVolumesFromSourceVolumeTest-295757694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-46f809a1-858d-4de6-8780-6783f8fcb4fe 1073741824" returned: 0 in 1.167s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:25 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a4d80370-ab11-4453-8130-b1337745e6ff tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-46f809a1-858d-4de6-8780-6783f8fcb4fe {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:25 devstack sudo[98427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-46f809a1-858d-4de6-8780-6783f8fcb4fe Jul 08 01:53:25 devstack sudo[98427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:26 devstack sudo[98427]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:26 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a4d80370-ab11-4453-8130-b1337745e6ff tempest-CreateVolumesFromSourceVolumeTest-295757694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-46f809a1-858d-4de6-8780-6783f8fcb4fe" returned: 0 in 0.671s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:26 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-a4d80370-ab11-4453-8130-b1337745e6ff tempest-CreateVolumesFromSourceVolumeTest-295757694 None] <== create_volume: return (1898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:53:26 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-a4d80370-ab11-4453-8130-b1337745e6ff tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.904s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:53:26 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-dc118a6c-8186-442d-baac-718a4fb2df16 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.342s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:53:26 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-dc118a6c-8186-442d-baac-718a4fb2df16 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:53:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-447951336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d3f984a-9dec-485e-b5a6-de07f5439751,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bf4aac49b274607a367ad12d9aff8fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:53:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:53:22Z,use_quota=True,user_id='d6180b715eed408f874b4797f93d3be5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:53:26 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-dc118a6c-8186-442d-baac-718a4fb2df16 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Creating volume 2d3f984a-9dec-485e-b5a6-de07f5439751 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:53:26 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-dc118a6c-8186-442d-baac-718a4fb2df16 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:53:26 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-dc118a6c-8186-442d-baac-718a4fb2df16 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:53:26 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-dc118a6c-8186-442d-baac-718a4fb2df16 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:53:26 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-dc118a6c-8186-442d-baac-718a4fb2df16 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:53:26 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-dc118a6c-8186-442d-baac-718a4fb2df16 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:53:26 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-dc118a6c-8186-442d-baac-718a4fb2df16 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:53:26 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-dc118a6c-8186-442d-baac-718a4fb2df16 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:53:26 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-dc118a6c-8186-442d-baac-718a4fb2df16 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-2d3f984a-9dec-485e-b5a6-de07f5439751 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:26 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-a4d80370-ab11-4453-8130-b1337745e6ff tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bf4dcc8-b865-4232-967a-30df44bd5242) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46f809a1-858d-4de6-8780-6783f8fcb4fe', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:53:26 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-a4d80370-ab11-4453-8130-b1337745e6ff tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb93774e-5d98-4ea9-be62-295561924d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:53:26 devstack sudo[98430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-2d3f984a-9dec-485e-b5a6-de07f5439751 1073741824 Jul 08 01:53:26 devstack sudo[98430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:26 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-a4d80370-ab11-4453-8130-b1337745e6ff tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Volume volume-46f809a1-858d-4de6-8780-6783f8fcb4fe (46f809a1-858d-4de6-8780-6783f8fcb4fe): created successfully Jul 08 01:53:26 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-a4d80370-ab11-4453-8130-b1337745e6ff tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb93774e-5d98-4ea9-be62-295561924d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:53:26 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-a4d80370-ab11-4453-8130-b1337745e6ff tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Flow 'volume_create_manager' (38060055-c090-44b2-85a1-f925a10b3f6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:53:26 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-a4d80370-ab11-4453-8130-b1337745e6ff tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Created volume successfully. Jul 08 01:53:27 devstack sudo[98430]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:27 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-dc118a6c-8186-442d-baac-718a4fb2df16 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-2d3f984a-9dec-485e-b5a6-de07f5439751 1073741824" returned: 0 in 1.036s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:27 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-dc118a6c-8186-442d-baac-718a4fb2df16 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-2d3f984a-9dec-485e-b5a6-de07f5439751 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:27 devstack sudo[98470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-2d3f984a-9dec-485e-b5a6-de07f5439751 Jul 08 01:53:27 devstack sudo[98470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:28 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-70d26182-6acb-49b5-8ad8-4cc42eff96cc req-0bd3386f-a50a-4917-ac0e-c19bf12022c8 tempest-TestServerVolumeAttachmentScenario-1700580262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:53:28 devstack sudo[98470]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:28 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-dc118a6c-8186-442d-baac-718a4fb2df16 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-2d3f984a-9dec-485e-b5a6-de07f5439751" returned: 0 in 0.735s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:28 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-dc118a6c-8186-442d-baac-718a4fb2df16 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] <== create_volume: return (1836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:53:28 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-dc118a6c-8186-442d-baac-718a4fb2df16 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.839s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:53:28 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-be801680-ef7b-4df4-af02-d7f54a6a2a43 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.723s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:53:28 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-be801680-ef7b-4df4-af02-d7f54a6a2a43 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:53:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-915022878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4f7644b-991a-4a53-a276-75759939ea59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bf4aac49b274607a367ad12d9aff8fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:53:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:53:22Z,use_quota=True,user_id='d6180b715eed408f874b4797f93d3be5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:53:28 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-be801680-ef7b-4df4-af02-d7f54a6a2a43 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Creating volume c4f7644b-991a-4a53-a276-75759939ea59 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:53:28 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-be801680-ef7b-4df4-af02-d7f54a6a2a43 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:53:28 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-be801680-ef7b-4df4-af02-d7f54a6a2a43 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:53:28 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-be801680-ef7b-4df4-af02-d7f54a6a2a43 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:53:28 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-be801680-ef7b-4df4-af02-d7f54a6a2a43 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:53:28 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-be801680-ef7b-4df4-af02-d7f54a6a2a43 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:53:28 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-be801680-ef7b-4df4-af02-d7f54a6a2a43 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:53:28 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-be801680-ef7b-4df4-af02-d7f54a6a2a43 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:53:28 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-be801680-ef7b-4df4-af02-d7f54a6a2a43 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c4f7644b-991a-4a53-a276-75759939ea59 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:28 devstack cinder-volume[87134]: DEBUG dbcounter [-] [87134] Writing DB stats cinder:SELECT=94,cinder:UPDATE=110,cinder:DELETE=9,cinder:INSERT=32 {{(pid=87134) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:53:28 devstack sudo[98483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c4f7644b-991a-4a53-a276-75759939ea59 1073741824 Jul 08 01:53:28 devstack sudo[98483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:28 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-dc118a6c-8186-442d-baac-718a4fb2df16 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c859d8d4-0bb7-4a42-a605-7e14a6dd3519) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d3f984a-9dec-485e-b5a6-de07f5439751', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:53:28 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-dc118a6c-8186-442d-baac-718a4fb2df16 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82173399-ce72-4528-aedf-876aed075ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:53:28 devstack cinder-volume[87134]: DEBUG dbcounter [-] [87134] Writing DB stats cinder:UPDATE=121,cinder:SELECT=90,cinder:INSERT=21,cinder:DELETE=8 {{(pid=87134) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:53:28 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-dc118a6c-8186-442d-baac-718a4fb2df16 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Volume volume-2d3f984a-9dec-485e-b5a6-de07f5439751 (2d3f984a-9dec-485e-b5a6-de07f5439751): created successfully Jul 08 01:53:28 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-dc118a6c-8186-442d-baac-718a4fb2df16 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82173399-ce72-4528-aedf-876aed075ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:53:28 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-dc118a6c-8186-442d-baac-718a4fb2df16 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Flow 'volume_create_manager' (042370c7-f87e-4833-873e-fb7090a62b6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:53:28 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-dc118a6c-8186-442d-baac-718a4fb2df16 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Created volume successfully. Jul 08 01:53:29 devstack sudo[98483]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-be801680-ef7b-4df4-af02-d7f54a6a2a43 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c4f7644b-991a-4a53-a276-75759939ea59 1073741824" returned: 0 in 0.970s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-be801680-ef7b-4df4-af02-d7f54a6a2a43 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c4f7644b-991a-4a53-a276-75759939ea59 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:29 devstack sudo[98489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c4f7644b-991a-4a53-a276-75759939ea59 Jul 08 01:53:29 devstack sudo[98489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:29 devstack sudo[98489]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-be801680-ef7b-4df4-af02-d7f54a6a2a43 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c4f7644b-991a-4a53-a276-75759939ea59" returned: 0 in 0.696s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:29 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-be801680-ef7b-4df4-af02-d7f54a6a2a43 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] <== create_volume: return (1711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:53:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-be801680-ef7b-4df4-af02-d7f54a6a2a43 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.714s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:53:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6dac46df-a04e-4a72-9913-aefff6bf83be tempest-VolumesListTestJSON-1951517864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.498s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:53:29 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-6dac46df-a04e-4a72-9913-aefff6bf83be tempest-VolumesListTestJSON-1951517864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:53:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-574285410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d5a624a-895e-4a8d-a27c-d988b6551fb5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='87f64de143b5439bb7296dd9eedac47c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:53:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:53:25Z,use_quota=True,user_id='6deea91ba22749f689bb0b8a08545884',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:53:29 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-6dac46df-a04e-4a72-9913-aefff6bf83be tempest-VolumesListTestJSON-1951517864 None] Creating volume 1d5a624a-895e-4a8d-a27c-d988b6551fb5 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:53:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6dac46df-a04e-4a72-9913-aefff6bf83be tempest-VolumesListTestJSON-1951517864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:53:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6dac46df-a04e-4a72-9913-aefff6bf83be tempest-VolumesListTestJSON-1951517864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:53:29 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-6dac46df-a04e-4a72-9913-aefff6bf83be tempest-VolumesListTestJSON-1951517864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:53:29 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-6dac46df-a04e-4a72-9913-aefff6bf83be tempest-VolumesListTestJSON-1951517864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:53:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6dac46df-a04e-4a72-9913-aefff6bf83be tempest-VolumesListTestJSON-1951517864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:53:29 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-6dac46df-a04e-4a72-9913-aefff6bf83be tempest-VolumesListTestJSON-1951517864 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:53:29 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-6dac46df-a04e-4a72-9913-aefff6bf83be tempest-VolumesListTestJSON-1951517864 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:53:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6dac46df-a04e-4a72-9913-aefff6bf83be tempest-VolumesListTestJSON-1951517864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1d5a624a-895e-4a8d-a27c-d988b6551fb5 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:29 devstack sudo[98492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1d5a624a-895e-4a8d-a27c-d988b6551fb5 1073741824 Jul 08 01:53:29 devstack sudo[98492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:29 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-be801680-ef7b-4df4-af02-d7f54a6a2a43 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f6ff050-54dc-4259-9582-b99f95700c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4f7644b-991a-4a53-a276-75759939ea59', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:53:30 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-be801680-ef7b-4df4-af02-d7f54a6a2a43 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ff5c04e-ee58-4799-80ab-7a0adc7ffa7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:53:30 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-be801680-ef7b-4df4-af02-d7f54a6a2a43 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Volume volume-c4f7644b-991a-4a53-a276-75759939ea59 (c4f7644b-991a-4a53-a276-75759939ea59): created successfully Jul 08 01:53:30 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-be801680-ef7b-4df4-af02-d7f54a6a2a43 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ff5c04e-ee58-4799-80ab-7a0adc7ffa7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:53:30 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-be801680-ef7b-4df4-af02-d7f54a6a2a43 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Flow 'volume_create_manager' (e220429c-9448-4096-a5ed-cfaef70d187b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:53:30 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-be801680-ef7b-4df4-af02-d7f54a6a2a43 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Created volume successfully. Jul 08 01:53:30 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-0cd2f6e7-8877-4207-9700-5764e2cf5ca2 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Acquiring lock "cinder-c4f7644b-991a-4a53-a276-75759939ea59-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:53:30 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-0cd2f6e7-8877-4207-9700-5764e2cf5ca2 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Lock "cinder-c4f7644b-991a-4a53-a276-75759939ea59-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:53:30 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-0cd2f6e7-8877-4207-9700-5764e2cf5ca2 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Acquiring lock "cinder-quobyte-c4f7644b-991a-4a53-a276-75759939ea59" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:53:30 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-0cd2f6e7-8877-4207-9700-5764e2cf5ca2 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Lock "cinder-quobyte-c4f7644b-991a-4a53-a276-75759939ea59" acquired by "delete_volume" :: waited 0.018s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:53:30 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[b088a14e-3270-4bc5-8524-a76b895ba8c1]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:53:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-0cd2f6e7-8877-4207-9700-5764e2cf5ca2 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c4f7644b-991a-4a53-a276-75759939ea59 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:30 devstack sudo[98494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c4f7644b-991a-4a53-a276-75759939ea59 Jul 08 01:53:30 devstack sudo[98494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:30 devstack sudo[98492]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6dac46df-a04e-4a72-9913-aefff6bf83be tempest-VolumesListTestJSON-1951517864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1d5a624a-895e-4a8d-a27c-d988b6551fb5 1073741824" returned: 0 in 1.012s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6dac46df-a04e-4a72-9913-aefff6bf83be tempest-VolumesListTestJSON-1951517864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1d5a624a-895e-4a8d-a27c-d988b6551fb5 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:31 devstack sudo[98508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1d5a624a-895e-4a8d-a27c-d988b6551fb5 Jul 08 01:53:31 devstack sudo[98508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:31 devstack sudo[98494]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-0cd2f6e7-8877-4207-9700-5764e2cf5ca2 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c4f7644b-991a-4a53-a276-75759939ea59" returned: 0 in 0.932s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-0cd2f6e7-8877-4207-9700-5764e2cf5ca2 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c4f7644b-991a-4a53-a276-75759939ea59 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:31 devstack sudo[98511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c4f7644b-991a-4a53-a276-75759939ea59 Jul 08 01:53:31 devstack sudo[98511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:31 devstack sudo[98508]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6dac46df-a04e-4a72-9913-aefff6bf83be tempest-VolumesListTestJSON-1951517864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1d5a624a-895e-4a8d-a27c-d988b6551fb5" returned: 0 in 0.754s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:31 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-6dac46df-a04e-4a72-9913-aefff6bf83be tempest-VolumesListTestJSON-1951517864 None] <== create_volume: return (1832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:53:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6dac46df-a04e-4a72-9913-aefff6bf83be tempest-VolumesListTestJSON-1951517864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.835s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:53:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-70d26182-6acb-49b5-8ad8-4cc42eff96cc req-0bd3386f-a50a-4917-ac0e-c19bf12022c8 tempest-TestServerVolumeAttachmentScenario-1700580262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.660s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:53:31 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6dac46df-a04e-4a72-9913-aefff6bf83be tempest-VolumesListTestJSON-1951517864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0f74c34-be8b-4e51-8ad9-09c1a986e683) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d5a624a-895e-4a8d-a27c-d988b6551fb5', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:53:31 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6dac46df-a04e-4a72-9913-aefff6bf83be tempest-VolumesListTestJSON-1951517864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9305366-b7a0-4abf-9e1a-8b63fe825307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:53:31 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c5ed19-9fd0-40ca-b96d-36c99239b97a]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:53:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-70d26182-6acb-49b5-8ad8-4cc42eff96cc req-0bd3386f-a50a-4917-ac0e-c19bf12022c8 tempest-TestServerVolumeAttachmentScenario-1700580262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c7b32e87-a71d-4eba-9328-87c8526de819 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:31 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-6dac46df-a04e-4a72-9913-aefff6bf83be tempest-VolumesListTestJSON-1951517864 None] Volume volume-1d5a624a-895e-4a8d-a27c-d988b6551fb5 (1d5a624a-895e-4a8d-a27c-d988b6551fb5): created successfully Jul 08 01:53:31 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6dac46df-a04e-4a72-9913-aefff6bf83be tempest-VolumesListTestJSON-1951517864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9305366-b7a0-4abf-9e1a-8b63fe825307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:53:31 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6dac46df-a04e-4a72-9913-aefff6bf83be tempest-VolumesListTestJSON-1951517864 None] Flow 'volume_create_manager' (08b0d2e6-61d8-46c7-84a5-5db9c0d6e1dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:53:31 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-6dac46df-a04e-4a72-9913-aefff6bf83be tempest-VolumesListTestJSON-1951517864 None] Created volume successfully. Jul 08 01:53:31 devstack sudo[98514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c7b32e87-a71d-4eba-9328-87c8526de819 Jul 08 01:53:31 devstack sudo[98514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:32 devstack sudo[98511]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-0cd2f6e7-8877-4207-9700-5764e2cf5ca2 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c4f7644b-991a-4a53-a276-75759939ea59" returned: 0 in 0.780s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:32 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-0cd2f6e7-8877-4207-9700-5764e2cf5ca2 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Lock "cinder-quobyte-c4f7644b-991a-4a53-a276-75759939ea59" released by "delete_volume" :: held 1.767s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:53:32 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-0cd2f6e7-8877-4207-9700-5764e2cf5ca2 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Created reservations ['aef97cd4-3e2a-4347-a4c9-8854e7a0fe79', 'd03068e7-b744-4ced-b804-e12d6c74e67b', '6f658760-7482-4780-90a3-499bd7e59f79', 'a81d892f-38b0-4cbd-93d5-6d5eb0bfe24a'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:53:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-0cd2f6e7-8877-4207-9700-5764e2cf5ca2 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:53:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-0cd2f6e7-8877-4207-9700-5764e2cf5ca2 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:53:32 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-0cd2f6e7-8877-4207-9700-5764e2cf5ca2 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:53:32 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-0cd2f6e7-8877-4207-9700-5764e2cf5ca2 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:53:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-0cd2f6e7-8877-4207-9700-5764e2cf5ca2 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:53:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-0cd2f6e7-8877-4207-9700-5764e2cf5ca2 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:32 devstack sudo[98517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:53:32 devstack sudo[98517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:32 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-3e52c46a-8cbd-47db-8e03-2cf2865401d6 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Acquiring lock "cinder-2d3f984a-9dec-485e-b5a6-de07f5439751-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:53:32 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-3e52c46a-8cbd-47db-8e03-2cf2865401d6 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Lock "cinder-2d3f984a-9dec-485e-b5a6-de07f5439751-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:53:32 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-3e52c46a-8cbd-47db-8e03-2cf2865401d6 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Acquiring lock "cinder-quobyte-2d3f984a-9dec-485e-b5a6-de07f5439751" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:53:32 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-3e52c46a-8cbd-47db-8e03-2cf2865401d6 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Lock "cinder-quobyte-2d3f984a-9dec-485e-b5a6-de07f5439751" acquired by "delete_volume" :: waited 0.052s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:53:32 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e9b0da-6cc0-48e4-a94e-8e03dbd2b509]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:53:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-3e52c46a-8cbd-47db-8e03-2cf2865401d6 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-2d3f984a-9dec-485e-b5a6-de07f5439751 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:32 devstack sudo[98523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-2d3f984a-9dec-485e-b5a6-de07f5439751 Jul 08 01:53:32 devstack sudo[98523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:32 devstack sudo[98514]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-70d26182-6acb-49b5-8ad8-4cc42eff96cc req-0bd3386f-a50a-4917-ac0e-c19bf12022c8 tempest-TestServerVolumeAttachmentScenario-1700580262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c7b32e87-a71d-4eba-9328-87c8526de819" returned: 0 in 1.155s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-70d26182-6acb-49b5-8ad8-4cc42eff96cc req-0bd3386f-a50a-4917-ac0e-c19bf12022c8 tempest-TestServerVolumeAttachmentScenario-1700580262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.195s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:53:33 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [req-70d26182-6acb-49b5-8ad8-4cc42eff96cc req-0bd3386f-a50a-4917-ac0e-c19bf12022c8 tempest-TestServerVolumeAttachmentScenario-1700580262 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17', 'name': 'volume-c7b32e87-a71d-4eba-9328-87c8526de819', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '516f6791-2745-4823-a01f-257e884052d9', 'enforce_multipath': True} {{(pid=87134) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:53:33 devstack sudo[98517]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-0cd2f6e7-8877-4207-9700-5764e2cf5ca2 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.917s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:33 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-0cd2f6e7-8877-4207-9700-5764e2cf5ca2 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:53:33 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-0cd2f6e7-8877-4207-9700-5764e2cf5ca2 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Deleted volume successfully. Jul 08 01:53:33 devstack cinder-volume[87134]: INFO cinder.volume.manager [req-70d26182-6acb-49b5-8ad8-4cc42eff96cc req-0bd3386f-a50a-4917-ac0e-c19bf12022c8 tempest-TestServerVolumeAttachmentScenario-1700580262 None] attachment_update completed successfully. Jul 08 01:53:33 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-0cd2f6e7-8877-4207-9700-5764e2cf5ca2 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Lock "cinder-c4f7644b-991a-4a53-a276-75759939ea59-delete_volume" released by "delete_volume" :: held 2.994s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:53:33 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-c99de761-acbd-40c9-b537-36a75353329d tempest-VolumesListTestJSON-1951517864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:53:33 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c99de761-acbd-40c9-b537-36a75353329d tempest-VolumesListTestJSON-1951517864 None] Flow 'volume_create_manager' (a7ded010-70af-4060-b882-214f88e260bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:53:33 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c99de761-acbd-40c9-b537-36a75353329d tempest-VolumesListTestJSON-1951517864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68be242d-9809-4b8c-9e03-36c290d0bb79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:53:33 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c99de761-acbd-40c9-b537-36a75353329d tempest-VolumesListTestJSON-1951517864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68be242d-9809-4b8c-9e03-36c290d0bb79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:53:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1441964049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ece711ed-94f7-4607-a2a1-3e8bb5648eef,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='87f64de143b5439bb7296dd9eedac47c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:53:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:53:34Z,use_quota=True,user_id='6deea91ba22749f689bb0b8a08545884',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:53:33 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c99de761-acbd-40c9-b537-36a75353329d tempest-VolumesListTestJSON-1951517864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4687743-d130-4f99-aac6-df81daabac3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:53:33 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c99de761-acbd-40c9-b537-36a75353329d tempest-VolumesListTestJSON-1951517864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4687743-d130-4f99-aac6-df81daabac3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:53:33 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c99de761-acbd-40c9-b537-36a75353329d tempest-VolumesListTestJSON-1951517864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c114ecb-34b9-4b56-910d-6ac6416a756c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:53:33 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c99de761-acbd-40c9-b537-36a75353329d tempest-VolumesListTestJSON-1951517864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c114ecb-34b9-4b56-910d-6ac6416a756c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ece711ed-94f7-4607-a2a1-3e8bb5648eef', 'volume_name': 'volume-ece711ed-94f7-4607-a2a1-3e8bb5648eef', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:53:33 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c99de761-acbd-40c9-b537-36a75353329d tempest-VolumesListTestJSON-1951517864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23d2392c-062b-459b-af66-17f3f71fc4c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:53:33 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c99de761-acbd-40c9-b537-36a75353329d tempest-VolumesListTestJSON-1951517864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23d2392c-062b-459b-af66-17f3f71fc4c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:53:33 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c99de761-acbd-40c9-b537-36a75353329d tempest-VolumesListTestJSON-1951517864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e910de98-9fc9-47d3-9f95-754e3ac7cc3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:53:33 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-c99de761-acbd-40c9-b537-36a75353329d tempest-VolumesListTestJSON-1951517864 None] Volume ece711ed-94f7-4607-a2a1-3e8bb5648eef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ece711ed-94f7-4607-a2a1-3e8bb5648eef', 'volume_size': 1} Jul 08 01:53:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c99de761-acbd-40c9-b537-36a75353329d tempest-VolumesListTestJSON-1951517864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:53:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c99de761-acbd-40c9-b537-36a75353329d tempest-VolumesListTestJSON-1951517864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:53:33 devstack sudo[98523]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:33 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-c99de761-acbd-40c9-b537-36a75353329d tempest-VolumesListTestJSON-1951517864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:53:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1441964049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ece711ed-94f7-4607-a2a1-3e8bb5648eef,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='87f64de143b5439bb7296dd9eedac47c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:53:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:53:34Z,use_quota=True,user_id='6deea91ba22749f689bb0b8a08545884',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:53:33 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-c99de761-acbd-40c9-b537-36a75353329d tempest-VolumesListTestJSON-1951517864 None] Creating volume ece711ed-94f7-4607-a2a1-3e8bb5648eef {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:53:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c99de761-acbd-40c9-b537-36a75353329d tempest-VolumesListTestJSON-1951517864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:53:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c99de761-acbd-40c9-b537-36a75353329d tempest-VolumesListTestJSON-1951517864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:53:33 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-c99de761-acbd-40c9-b537-36a75353329d tempest-VolumesListTestJSON-1951517864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:53:33 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-c99de761-acbd-40c9-b537-36a75353329d tempest-VolumesListTestJSON-1951517864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:53:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c99de761-acbd-40c9-b537-36a75353329d tempest-VolumesListTestJSON-1951517864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:53:33 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-c99de761-acbd-40c9-b537-36a75353329d tempest-VolumesListTestJSON-1951517864 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:53:33 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-c99de761-acbd-40c9-b537-36a75353329d tempest-VolumesListTestJSON-1951517864 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:53:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c99de761-acbd-40c9-b537-36a75353329d tempest-VolumesListTestJSON-1951517864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ece711ed-94f7-4607-a2a1-3e8bb5648eef 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-3e52c46a-8cbd-47db-8e03-2cf2865401d6 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-2d3f984a-9dec-485e-b5a6-de07f5439751" returned: 0 in 1.022s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-3e52c46a-8cbd-47db-8e03-2cf2865401d6 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-2d3f984a-9dec-485e-b5a6-de07f5439751 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:33 devstack sudo[98530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ece711ed-94f7-4607-a2a1-3e8bb5648eef 1073741824 Jul 08 01:53:33 devstack sudo[98530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:33 devstack sudo[98531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-2d3f984a-9dec-485e-b5a6-de07f5439751 Jul 08 01:53:33 devstack sudo[98531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:34 devstack sudo[98531]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-3e52c46a-8cbd-47db-8e03-2cf2865401d6 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-2d3f984a-9dec-485e-b5a6-de07f5439751" returned: 0 in 0.883s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:34 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-3e52c46a-8cbd-47db-8e03-2cf2865401d6 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Lock "cinder-quobyte-2d3f984a-9dec-485e-b5a6-de07f5439751" released by "delete_volume" :: held 1.985s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:53:34 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-3e52c46a-8cbd-47db-8e03-2cf2865401d6 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Created reservations ['9cc07421-4c23-452a-a83c-ff2b2f742b5b', '3d2ca4c5-1dfa-4e27-9d63-a889b394f112', '3d518fb0-c9fd-428a-b3fe-719036b85653', '631e5965-9c32-4d81-bb68-b33d2eb28304'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:53:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-3e52c46a-8cbd-47db-8e03-2cf2865401d6 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:53:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-3e52c46a-8cbd-47db-8e03-2cf2865401d6 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:53:34 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-3e52c46a-8cbd-47db-8e03-2cf2865401d6 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:53:34 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-3e52c46a-8cbd-47db-8e03-2cf2865401d6 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:53:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-3e52c46a-8cbd-47db-8e03-2cf2865401d6 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:53:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-3e52c46a-8cbd-47db-8e03-2cf2865401d6 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:34 devstack sudo[98541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:53:34 devstack sudo[98541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:34 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-6f0e3d45-5a00-4aa2-a785-5472c191320d tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Acquiring lock "cinder-46f809a1-858d-4de6-8780-6783f8fcb4fe-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:53:34 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-6f0e3d45-5a00-4aa2-a785-5472c191320d tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Lock "cinder-46f809a1-858d-4de6-8780-6783f8fcb4fe-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:53:34 devstack sudo[98530]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c99de761-acbd-40c9-b537-36a75353329d tempest-VolumesListTestJSON-1951517864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ece711ed-94f7-4607-a2a1-3e8bb5648eef 1073741824" returned: 0 in 1.279s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:35 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-6f0e3d45-5a00-4aa2-a785-5472c191320d tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Acquiring lock "cinder-quobyte-46f809a1-858d-4de6-8780-6783f8fcb4fe" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:53:35 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-6f0e3d45-5a00-4aa2-a785-5472c191320d tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Lock "cinder-quobyte-46f809a1-858d-4de6-8780-6783f8fcb4fe" acquired by "delete_volume" :: waited 0.034s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:53:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c99de761-acbd-40c9-b537-36a75353329d tempest-VolumesListTestJSON-1951517864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ece711ed-94f7-4607-a2a1-3e8bb5648eef {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:35 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[aece3682-5070-4be1-830c-03df1f93f858]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:53:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6f0e3d45-5a00-4aa2-a785-5472c191320d tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-46f809a1-858d-4de6-8780-6783f8fcb4fe {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:35 devstack sudo[98543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ece711ed-94f7-4607-a2a1-3e8bb5648eef Jul 08 01:53:35 devstack sudo[98543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:35 devstack sudo[98568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-46f809a1-858d-4de6-8780-6783f8fcb4fe Jul 08 01:53:35 devstack sudo[98568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:35 devstack sudo[98541]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-3e52c46a-8cbd-47db-8e03-2cf2865401d6 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 1.127s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:35 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-3e52c46a-8cbd-47db-8e03-2cf2865401d6 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:53:35 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-3e52c46a-8cbd-47db-8e03-2cf2865401d6 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Deleted volume successfully. Jul 08 01:53:35 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-3e52c46a-8cbd-47db-8e03-2cf2865401d6 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Lock "cinder-2d3f984a-9dec-485e-b5a6-de07f5439751-delete_volume" released by "delete_volume" :: held 3.473s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:53:36 devstack sudo[98568]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6f0e3d45-5a00-4aa2-a785-5472c191320d tempest-CreateVolumesFromSourceVolumeTest-295757694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-46f809a1-858d-4de6-8780-6783f8fcb4fe" returned: 0 in 1.124s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6f0e3d45-5a00-4aa2-a785-5472c191320d tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-46f809a1-858d-4de6-8780-6783f8fcb4fe {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:36 devstack sudo[98576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-46f809a1-858d-4de6-8780-6783f8fcb4fe Jul 08 01:53:36 devstack sudo[98576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:36 devstack sudo[98543]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c99de761-acbd-40c9-b537-36a75353329d tempest-VolumesListTestJSON-1951517864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ece711ed-94f7-4607-a2a1-3e8bb5648eef" returned: 0 in 1.242s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:36 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-c99de761-acbd-40c9-b537-36a75353329d tempest-VolumesListTestJSON-1951517864 None] <== create_volume: return (2618ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:53:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c99de761-acbd-40c9-b537-36a75353329d tempest-VolumesListTestJSON-1951517864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.621s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:53:36 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c99de761-acbd-40c9-b537-36a75353329d tempest-VolumesListTestJSON-1951517864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e910de98-9fc9-47d3-9f95-754e3ac7cc3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ece711ed-94f7-4607-a2a1-3e8bb5648eef', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:53:36 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c99de761-acbd-40c9-b537-36a75353329d tempest-VolumesListTestJSON-1951517864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cce9cfe8-4fe5-4c57-bc46-66103cb83859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:53:36 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-c99de761-acbd-40c9-b537-36a75353329d tempest-VolumesListTestJSON-1951517864 None] Volume volume-ece711ed-94f7-4607-a2a1-3e8bb5648eef (ece711ed-94f7-4607-a2a1-3e8bb5648eef): created successfully Jul 08 01:53:36 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c99de761-acbd-40c9-b537-36a75353329d tempest-VolumesListTestJSON-1951517864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cce9cfe8-4fe5-4c57-bc46-66103cb83859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:53:36 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c99de761-acbd-40c9-b537-36a75353329d tempest-VolumesListTestJSON-1951517864 None] Flow 'volume_create_manager' (a7ded010-70af-4060-b882-214f88e260bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:53:36 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-c99de761-acbd-40c9-b537-36a75353329d tempest-VolumesListTestJSON-1951517864 None] Created volume successfully. Jul 08 01:53:37 devstack sudo[98576]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6f0e3d45-5a00-4aa2-a785-5472c191320d tempest-CreateVolumesFromSourceVolumeTest-295757694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-46f809a1-858d-4de6-8780-6783f8fcb4fe" returned: 0 in 1.148s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:37 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-6f0e3d45-5a00-4aa2-a785-5472c191320d tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Lock "cinder-quobyte-46f809a1-858d-4de6-8780-6783f8fcb4fe" released by "delete_volume" :: held 2.359s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:53:37 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-6f0e3d45-5a00-4aa2-a785-5472c191320d tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Created reservations ['ff312309-aab4-45d0-8643-8df8096e56c2', '116b6c60-9782-4bbe-987b-95acdeb2c997', '82cb043c-04bb-45e5-9c26-66c4afaf8742', 'cc463311-656a-4fad-b645-d14958c4b37d'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:53:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6f0e3d45-5a00-4aa2-a785-5472c191320d tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:53:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6f0e3d45-5a00-4aa2-a785-5472c191320d tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:53:37 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-6f0e3d45-5a00-4aa2-a785-5472c191320d tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:53:37 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-6f0e3d45-5a00-4aa2-a785-5472c191320d tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:53:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6f0e3d45-5a00-4aa2-a785-5472c191320d tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:53:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6f0e3d45-5a00-4aa2-a785-5472c191320d tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:37 devstack sudo[98579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:53:37 devstack sudo[98579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:37 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bbcd657-1de6-46f8-b9d3-9929837c2abf tempest-VolumesListTestJSON-1951517864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:53:37 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8bbcd657-1de6-46f8-b9d3-9929837c2abf tempest-VolumesListTestJSON-1951517864 None] Flow 'volume_create_manager' (bb79315f-57a1-405d-ac26-9c341829a8c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:53:37 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8bbcd657-1de6-46f8-b9d3-9929837c2abf tempest-VolumesListTestJSON-1951517864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04084981-f71f-43f4-9155-2ee125e92832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:53:37 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8bbcd657-1de6-46f8-b9d3-9929837c2abf tempest-VolumesListTestJSON-1951517864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04084981-f71f-43f4-9155-2ee125e92832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:53:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-257146623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbaee242-87ab-414e-bedc-758fd1180284,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='87f64de143b5439bb7296dd9eedac47c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:53:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:53:38Z,use_quota=True,user_id='6deea91ba22749f689bb0b8a08545884',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:53:37 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8bbcd657-1de6-46f8-b9d3-9929837c2abf tempest-VolumesListTestJSON-1951517864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d5b816f-a173-4088-a42f-54d5352b5a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:53:37 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8bbcd657-1de6-46f8-b9d3-9929837c2abf tempest-VolumesListTestJSON-1951517864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d5b816f-a173-4088-a42f-54d5352b5a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:53:37 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8bbcd657-1de6-46f8-b9d3-9929837c2abf tempest-VolumesListTestJSON-1951517864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a7defdf-f89a-48cc-ba01-7c4a273f99fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:53:37 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8bbcd657-1de6-46f8-b9d3-9929837c2abf tempest-VolumesListTestJSON-1951517864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a7defdf-f89a-48cc-ba01-7c4a273f99fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbaee242-87ab-414e-bedc-758fd1180284', 'volume_name': 'volume-dbaee242-87ab-414e-bedc-758fd1180284', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:53:37 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8bbcd657-1de6-46f8-b9d3-9929837c2abf tempest-VolumesListTestJSON-1951517864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (898bf9e1-13a7-4260-8922-3a1069c53b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:53:37 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8bbcd657-1de6-46f8-b9d3-9929837c2abf tempest-VolumesListTestJSON-1951517864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (898bf9e1-13a7-4260-8922-3a1069c53b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:53:37 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8bbcd657-1de6-46f8-b9d3-9929837c2abf tempest-VolumesListTestJSON-1951517864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df32e0c8-8ffe-45b0-92dc-ed0104905542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:53:37 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-8bbcd657-1de6-46f8-b9d3-9929837c2abf tempest-VolumesListTestJSON-1951517864 None] Volume dbaee242-87ab-414e-bedc-758fd1180284: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbaee242-87ab-414e-bedc-758fd1180284', 'volume_size': 1} Jul 08 01:53:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-8bbcd657-1de6-46f8-b9d3-9929837c2abf tempest-VolumesListTestJSON-1951517864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:53:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-8bbcd657-1de6-46f8-b9d3-9929837c2abf tempest-VolumesListTestJSON-1951517864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:53:37 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-8bbcd657-1de6-46f8-b9d3-9929837c2abf tempest-VolumesListTestJSON-1951517864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:53:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-257146623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbaee242-87ab-414e-bedc-758fd1180284,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='87f64de143b5439bb7296dd9eedac47c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:53:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:53:38Z,use_quota=True,user_id='6deea91ba22749f689bb0b8a08545884',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:53:37 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-8bbcd657-1de6-46f8-b9d3-9929837c2abf tempest-VolumesListTestJSON-1951517864 None] Creating volume dbaee242-87ab-414e-bedc-758fd1180284 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:53:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-8bbcd657-1de6-46f8-b9d3-9929837c2abf tempest-VolumesListTestJSON-1951517864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:53:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-8bbcd657-1de6-46f8-b9d3-9929837c2abf tempest-VolumesListTestJSON-1951517864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:53:37 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-8bbcd657-1de6-46f8-b9d3-9929837c2abf tempest-VolumesListTestJSON-1951517864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:53:37 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-8bbcd657-1de6-46f8-b9d3-9929837c2abf tempest-VolumesListTestJSON-1951517864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:53:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-8bbcd657-1de6-46f8-b9d3-9929837c2abf tempest-VolumesListTestJSON-1951517864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:53:37 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-8bbcd657-1de6-46f8-b9d3-9929837c2abf tempest-VolumesListTestJSON-1951517864 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:53:37 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-8bbcd657-1de6-46f8-b9d3-9929837c2abf tempest-VolumesListTestJSON-1951517864 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:53:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8bbcd657-1de6-46f8-b9d3-9929837c2abf tempest-VolumesListTestJSON-1951517864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-dbaee242-87ab-414e-bedc-758fd1180284 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:37 devstack sudo[98581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-dbaee242-87ab-414e-bedc-758fd1180284 1073741824 Jul 08 01:53:37 devstack sudo[98581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:38 devstack sudo[98579]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6f0e3d45-5a00-4aa2-a785-5472c191320d tempest-CreateVolumesFromSourceVolumeTest-295757694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.732s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:38 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-6f0e3d45-5a00-4aa2-a785-5472c191320d tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:53:38 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-6f0e3d45-5a00-4aa2-a785-5472c191320d tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Deleted volume successfully. Jul 08 01:53:38 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-6f0e3d45-5a00-4aa2-a785-5472c191320d tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Lock "cinder-46f809a1-858d-4de6-8780-6783f8fcb4fe-delete_volume" released by "delete_volume" :: held 3.484s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:53:38 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-09bc51b9-2e32-4344-bd57-b2615203720a tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Acquiring lock "cinder-d63d0068-251a-4340-adea-36b537c6ac50-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:53:38 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-09bc51b9-2e32-4344-bd57-b2615203720a tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Lock "cinder-d63d0068-251a-4340-adea-36b537c6ac50-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:53:38 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-09bc51b9-2e32-4344-bd57-b2615203720a tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Acquiring lock "cinder-quobyte-d63d0068-251a-4340-adea-36b537c6ac50" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:53:38 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-09bc51b9-2e32-4344-bd57-b2615203720a tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Lock "cinder-quobyte-d63d0068-251a-4340-adea-36b537c6ac50" acquired by "delete_volume" :: waited 0.041s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:53:38 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb8a5b5-ad05-4626-80f0-5ad8853804c3]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:53:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-09bc51b9-2e32-4344-bd57-b2615203720a tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d63d0068-251a-4340-adea-36b537c6ac50 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:38 devstack sudo[98588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d63d0068-251a-4340-adea-36b537c6ac50 Jul 08 01:53:38 devstack sudo[98588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:38 devstack cinder-volume[87134]: INFO cinder.volume.manager [req-a26fcf69-d362-40e9-b363-a036018c5e5d req-936df9ef-37e7-4a92-9432-152c18f7fbdc tempest-TestServerVolumeAttachmentScenario-1700580262 None] Terminate volume connection completed successfully. Jul 08 01:53:38 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [req-a26fcf69-d362-40e9-b363-a036018c5e5d req-936df9ef-37e7-4a92-9432-152c18f7fbdc tempest-TestServerVolumeAttachmentScenario-1700580262 None] Deleting attachment 516f6791-2745-4823-a01f-257e884052d9. {{(pid=87134) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:53:39 devstack sudo[98581]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8bbcd657-1de6-46f8-b9d3-9929837c2abf tempest-VolumesListTestJSON-1951517864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-dbaee242-87ab-414e-bedc-758fd1180284 1073741824" returned: 0 in 1.105s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8bbcd657-1de6-46f8-b9d3-9929837c2abf tempest-VolumesListTestJSON-1951517864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-dbaee242-87ab-414e-bedc-758fd1180284 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:39 devstack sudo[98593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-dbaee242-87ab-414e-bedc-758fd1180284 Jul 08 01:53:39 devstack sudo[98593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:39 devstack sudo[98588]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-09bc51b9-2e32-4344-bd57-b2615203720a tempest-CreateVolumesFromSourceVolumeTest-295757694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d63d0068-251a-4340-adea-36b537c6ac50" returned: 0 in 1.011s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-09bc51b9-2e32-4344-bd57-b2615203720a tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d63d0068-251a-4340-adea-36b537c6ac50 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:39 devstack sudo[98600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d63d0068-251a-4340-adea-36b537c6ac50 Jul 08 01:53:39 devstack sudo[98600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:39 devstack sudo[98593]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8bbcd657-1de6-46f8-b9d3-9929837c2abf tempest-VolumesListTestJSON-1951517864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-dbaee242-87ab-414e-bedc-758fd1180284" returned: 0 in 0.909s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:39 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-8bbcd657-1de6-46f8-b9d3-9929837c2abf tempest-VolumesListTestJSON-1951517864 None] <== create_volume: return (2061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:53:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-8bbcd657-1de6-46f8-b9d3-9929837c2abf tempest-VolumesListTestJSON-1951517864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.065s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:53:39 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8bbcd657-1de6-46f8-b9d3-9929837c2abf tempest-VolumesListTestJSON-1951517864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df32e0c8-8ffe-45b0-92dc-ed0104905542) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbaee242-87ab-414e-bedc-758fd1180284', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:53:39 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8bbcd657-1de6-46f8-b9d3-9929837c2abf tempest-VolumesListTestJSON-1951517864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52037e0c-f5da-4d4c-ad7e-158f6a2ae474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:53:40 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-8bbcd657-1de6-46f8-b9d3-9929837c2abf tempest-VolumesListTestJSON-1951517864 None] Volume volume-dbaee242-87ab-414e-bedc-758fd1180284 (dbaee242-87ab-414e-bedc-758fd1180284): created successfully Jul 08 01:53:40 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8bbcd657-1de6-46f8-b9d3-9929837c2abf tempest-VolumesListTestJSON-1951517864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52037e0c-f5da-4d4c-ad7e-158f6a2ae474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:53:40 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8bbcd657-1de6-46f8-b9d3-9929837c2abf tempest-VolumesListTestJSON-1951517864 None] Flow 'volume_create_manager' (bb79315f-57a1-405d-ac26-9c341829a8c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:53:40 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-8bbcd657-1de6-46f8-b9d3-9929837c2abf tempest-VolumesListTestJSON-1951517864 None] Created volume successfully. Jul 08 01:53:40 devstack sudo[98600]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-09bc51b9-2e32-4344-bd57-b2615203720a tempest-CreateVolumesFromSourceVolumeTest-295757694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d63d0068-251a-4340-adea-36b537c6ac50" returned: 0 in 0.801s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:40 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-09bc51b9-2e32-4344-bd57-b2615203720a tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Lock "cinder-quobyte-d63d0068-251a-4340-adea-36b537c6ac50" released by "delete_volume" :: held 1.868s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:53:40 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-09bc51b9-2e32-4344-bd57-b2615203720a tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Created reservations ['025ff4fb-9f44-4c88-b2a1-96a6d3b29685', '5b44ce61-cea6-45f4-bafe-c02c64a2d22b', 'e4beee12-d286-4de1-8e61-4d610073037f', '3652dab3-f293-48e2-8e33-3a2f5c30dcb6'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:53:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-09bc51b9-2e32-4344-bd57-b2615203720a tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:53:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-09bc51b9-2e32-4344-bd57-b2615203720a tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:53:40 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-09bc51b9-2e32-4344-bd57-b2615203720a tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:53:40 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-09bc51b9-2e32-4344-bd57-b2615203720a tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:53:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-09bc51b9-2e32-4344-bd57-b2615203720a tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:53:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-09bc51b9-2e32-4344-bd57-b2615203720a tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:40 devstack sudo[98604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:53:40 devstack sudo[98604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:40 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-d452449f-fdf4-46c7-a42f-1555fb356cbc tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Acquiring lock "cinder-1f733f1a-1d38-481f-89ca-7f40a040c5ff-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:53:40 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-d452449f-fdf4-46c7-a42f-1555fb356cbc tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Lock "cinder-1f733f1a-1d38-481f-89ca-7f40a040c5ff-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:53:40 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-d452449f-fdf4-46c7-a42f-1555fb356cbc tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Acquiring lock "cinder-quobyte-1f733f1a-1d38-481f-89ca-7f40a040c5ff" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:53:41 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-d452449f-fdf4-46c7-a42f-1555fb356cbc tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Lock "cinder-quobyte-1f733f1a-1d38-481f-89ca-7f40a040c5ff" acquired by "delete_volume" :: waited 0.025s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:53:41 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f8b79c4-76a0-4740-83eb-9124dd754ba1]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:53:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d452449f-fdf4-46c7-a42f-1555fb356cbc tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1f733f1a-1d38-481f-89ca-7f40a040c5ff {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:41 devstack sudo[98606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1f733f1a-1d38-481f-89ca-7f40a040c5ff Jul 08 01:53:41 devstack sudo[98606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:41 devstack sudo[98604]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-09bc51b9-2e32-4344-bd57-b2615203720a tempest-CreateVolumesFromSourceVolumeTest-295757694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.995s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:41 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-09bc51b9-2e32-4344-bd57-b2615203720a tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:53:41 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-09bc51b9-2e32-4344-bd57-b2615203720a tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Deleted volume successfully. Jul 08 01:53:41 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-09bc51b9-2e32-4344-bd57-b2615203720a tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Lock "cinder-d63d0068-251a-4340-adea-36b537c6ac50-delete_volume" released by "delete_volume" :: held 3.183s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:53:42 devstack sudo[98606]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d452449f-fdf4-46c7-a42f-1555fb356cbc tempest-CreateVolumesFromSourceVolumeTest-295757694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1f733f1a-1d38-481f-89ca-7f40a040c5ff" returned: 0 in 1.142s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d452449f-fdf4-46c7-a42f-1555fb356cbc tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1f733f1a-1d38-481f-89ca-7f40a040c5ff {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:42 devstack sudo[98613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1f733f1a-1d38-481f-89ca-7f40a040c5ff Jul 08 01:53:42 devstack sudo[98613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:43 devstack cinder-volume[87134]: INFO cinder.volume.manager [req-5e3ea819-e048-482e-8d3c-65f28f8865b6 req-fe003dfc-e59b-4605-9663-2db2b11c33a6 tempest-TestServerVolumeAttachmentScenario-1700580262 None] Terminate volume connection completed successfully. Jul 08 01:53:43 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [req-5e3ea819-e048-482e-8d3c-65f28f8865b6 req-fe003dfc-e59b-4605-9663-2db2b11c33a6 tempest-TestServerVolumeAttachmentScenario-1700580262 None] Deleting attachment 6beb60e0-f5e0-4db7-b4ca-9062efdc329e. {{(pid=87134) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:53:43 devstack sudo[98613]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d452449f-fdf4-46c7-a42f-1555fb356cbc tempest-CreateVolumesFromSourceVolumeTest-295757694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1f733f1a-1d38-481f-89ca-7f40a040c5ff" returned: 0 in 0.881s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:43 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-d452449f-fdf4-46c7-a42f-1555fb356cbc tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Lock "cinder-quobyte-1f733f1a-1d38-481f-89ca-7f40a040c5ff" released by "delete_volume" :: held 2.119s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:53:43 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-d452449f-fdf4-46c7-a42f-1555fb356cbc tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Created reservations ['85c9cad4-0fad-453f-bb0e-35def9fec11b', '471598f1-8e86-4d55-945f-beaa6b8407d1', '8f629f95-d3bb-4ac0-a93e-a2cd28131964', 'c99560d3-d20d-456e-97e4-980b5dc0d923'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:53:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-d452449f-fdf4-46c7-a42f-1555fb356cbc tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:53:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-d452449f-fdf4-46c7-a42f-1555fb356cbc tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:53:43 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-d452449f-fdf4-46c7-a42f-1555fb356cbc tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:53:43 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-d452449f-fdf4-46c7-a42f-1555fb356cbc tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:53:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-d452449f-fdf4-46c7-a42f-1555fb356cbc tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:53:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d452449f-fdf4-46c7-a42f-1555fb356cbc tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:43 devstack sudo[98620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:53:43 devstack sudo[98620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:43 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-115660d9-fe3b-4c39-90a5-8eb3428c249a tempest-VolumesListTestJSON-1951517864 None] Acquiring lock "cinder-dbaee242-87ab-414e-bedc-758fd1180284-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:53:43 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-115660d9-fe3b-4c39-90a5-8eb3428c249a tempest-VolumesListTestJSON-1951517864 None] Lock "cinder-dbaee242-87ab-414e-bedc-758fd1180284-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:53:43 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-115660d9-fe3b-4c39-90a5-8eb3428c249a tempest-VolumesListTestJSON-1951517864 None] Acquiring lock "cinder-quobyte-dbaee242-87ab-414e-bedc-758fd1180284" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:53:43 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-115660d9-fe3b-4c39-90a5-8eb3428c249a tempest-VolumesListTestJSON-1951517864 None] Lock "cinder-quobyte-dbaee242-87ab-414e-bedc-758fd1180284" acquired by "delete_volume" :: waited 0.018s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:53:43 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7ba997-0ff0-4a4c-8954-e77988f14fd5]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:53:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-115660d9-fe3b-4c39-90a5-8eb3428c249a tempest-VolumesListTestJSON-1951517864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-dbaee242-87ab-414e-bedc-758fd1180284 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:44 devstack sudo[98620]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d452449f-fdf4-46c7-a42f-1555fb356cbc tempest-CreateVolumesFromSourceVolumeTest-295757694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.748s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:44 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-d452449f-fdf4-46c7-a42f-1555fb356cbc tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:53:44 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-d452449f-fdf4-46c7-a42f-1555fb356cbc tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Deleted volume successfully. Jul 08 01:53:44 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-d452449f-fdf4-46c7-a42f-1555fb356cbc tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Lock "cinder-1f733f1a-1d38-481f-89ca-7f40a040c5ff-delete_volume" released by "delete_volume" :: held 3.186s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:53:44 devstack sudo[98623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-dbaee242-87ab-414e-bedc-758fd1180284 Jul 08 01:53:44 devstack sudo[98623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:44 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-325fc59a-4f36-49a4-9788-f43b4392dea2 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Acquiring lock "cinder-65d89ff0-b6ce-43c2-b976-0362f46db5f4-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:53:44 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-325fc59a-4f36-49a4-9788-f43b4392dea2 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Lock "cinder-65d89ff0-b6ce-43c2-b976-0362f46db5f4-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:53:44 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-325fc59a-4f36-49a4-9788-f43b4392dea2 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Acquiring lock "cinder-quobyte-65d89ff0-b6ce-43c2-b976-0362f46db5f4" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:53:44 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-325fc59a-4f36-49a4-9788-f43b4392dea2 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Lock "cinder-quobyte-65d89ff0-b6ce-43c2-b976-0362f46db5f4" acquired by "delete_volume" :: waited 0.018s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:53:44 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[c71d0315-5a21-48a8-a183-6f7c1241879d]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:53:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-325fc59a-4f36-49a4-9788-f43b4392dea2 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-65d89ff0-b6ce-43c2-b976-0362f46db5f4 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:44 devstack sudo[98625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-65d89ff0-b6ce-43c2-b976-0362f46db5f4 Jul 08 01:53:44 devstack sudo[98625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:44 devstack sudo[98623]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-115660d9-fe3b-4c39-90a5-8eb3428c249a tempest-VolumesListTestJSON-1951517864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-dbaee242-87ab-414e-bedc-758fd1180284" returned: 0 in 0.851s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-115660d9-fe3b-4c39-90a5-8eb3428c249a tempest-VolumesListTestJSON-1951517864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-dbaee242-87ab-414e-bedc-758fd1180284 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:44 devstack sudo[98631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-dbaee242-87ab-414e-bedc-758fd1180284 Jul 08 01:53:44 devstack sudo[98631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:45 devstack sudo[98625]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-325fc59a-4f36-49a4-9788-f43b4392dea2 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-65d89ff0-b6ce-43c2-b976-0362f46db5f4" returned: 0 in 1.007s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-325fc59a-4f36-49a4-9788-f43b4392dea2 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-65d89ff0-b6ce-43c2-b976-0362f46db5f4 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:45 devstack sudo[98636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-65d89ff0-b6ce-43c2-b976-0362f46db5f4 Jul 08 01:53:45 devstack sudo[98636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-115660d9-fe3b-4c39-90a5-8eb3428c249a tempest-VolumesListTestJSON-1951517864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-dbaee242-87ab-414e-bedc-758fd1180284" returned: 0 in 0.946s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:45 devstack sudo[98631]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:45 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-115660d9-fe3b-4c39-90a5-8eb3428c249a tempest-VolumesListTestJSON-1951517864 None] Lock "cinder-quobyte-dbaee242-87ab-414e-bedc-758fd1180284" released by "delete_volume" :: held 1.877s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:53:45 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-115660d9-fe3b-4c39-90a5-8eb3428c249a tempest-VolumesListTestJSON-1951517864 None] Created reservations ['16e6e05c-c75e-430e-be25-4296e4db6485', '6a7268ff-1cb5-4fab-8816-f9d34fdf29e6', '54adebdf-36fa-4c40-a1d3-688040eebb0f', 'e30c9d98-323f-4b81-8e99-6db22a02131c'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:53:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-115660d9-fe3b-4c39-90a5-8eb3428c249a tempest-VolumesListTestJSON-1951517864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:53:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-115660d9-fe3b-4c39-90a5-8eb3428c249a tempest-VolumesListTestJSON-1951517864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:53:45 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-115660d9-fe3b-4c39-90a5-8eb3428c249a tempest-VolumesListTestJSON-1951517864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:53:45 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-115660d9-fe3b-4c39-90a5-8eb3428c249a tempest-VolumesListTestJSON-1951517864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:53:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-115660d9-fe3b-4c39-90a5-8eb3428c249a tempest-VolumesListTestJSON-1951517864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:53:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-115660d9-fe3b-4c39-90a5-8eb3428c249a tempest-VolumesListTestJSON-1951517864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:46 devstack sudo[98639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:53:46 devstack sudo[98639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:46 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-ce2b8c71-9c78-4505-a55b-af6191eef114 tempest-VolumesListTestJSON-1951517864 None] Acquiring lock "cinder-ece711ed-94f7-4607-a2a1-3e8bb5648eef-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:53:46 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-ce2b8c71-9c78-4505-a55b-af6191eef114 tempest-VolumesListTestJSON-1951517864 None] Lock "cinder-ece711ed-94f7-4607-a2a1-3e8bb5648eef-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:53:46 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-ce2b8c71-9c78-4505-a55b-af6191eef114 tempest-VolumesListTestJSON-1951517864 None] Acquiring lock "cinder-quobyte-ece711ed-94f7-4607-a2a1-3e8bb5648eef" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:53:46 devstack sudo[98636]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-325fc59a-4f36-49a4-9788-f43b4392dea2 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-65d89ff0-b6ce-43c2-b976-0362f46db5f4" returned: 0 in 0.836s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:46 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-ce2b8c71-9c78-4505-a55b-af6191eef114 tempest-VolumesListTestJSON-1951517864 None] Lock "cinder-quobyte-ece711ed-94f7-4607-a2a1-3e8bb5648eef" acquired by "delete_volume" :: waited 0.030s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:53:46 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-325fc59a-4f36-49a4-9788-f43b4392dea2 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Lock "cinder-quobyte-65d89ff0-b6ce-43c2-b976-0362f46db5f4" released by "delete_volume" :: held 1.926s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:53:46 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38ffe86-e369-4c58-8b38-4b71397cee05]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:53:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ce2b8c71-9c78-4505-a55b-af6191eef114 tempest-VolumesListTestJSON-1951517864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ece711ed-94f7-4607-a2a1-3e8bb5648eef {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:46 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-325fc59a-4f36-49a4-9788-f43b4392dea2 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Created reservations ['6bd868f0-cd79-4af2-a7cc-86d6ba1d46c5', 'b8059ef8-665c-402d-ba0d-9d279f20e4cc', '2862385a-ed7f-4a2f-9d2e-a2564fe28cc0', '8a671c96-453e-4809-a252-96d08d8c3d76'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:53:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-325fc59a-4f36-49a4-9788-f43b4392dea2 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:53:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-325fc59a-4f36-49a4-9788-f43b4392dea2 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:53:46 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-325fc59a-4f36-49a4-9788-f43b4392dea2 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:53:46 devstack sudo[98643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ece711ed-94f7-4607-a2a1-3e8bb5648eef Jul 08 01:53:46 devstack sudo[98643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:46 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-325fc59a-4f36-49a4-9788-f43b4392dea2 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:53:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-325fc59a-4f36-49a4-9788-f43b4392dea2 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:53:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-325fc59a-4f36-49a4-9788-f43b4392dea2 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:46 devstack sudo[98649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:53:46 devstack sudo[98649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:46 devstack sudo[98639]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-115660d9-fe3b-4c39-90a5-8eb3428c249a tempest-VolumesListTestJSON-1951517864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.972s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:46 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-115660d9-fe3b-4c39-90a5-8eb3428c249a tempest-VolumesListTestJSON-1951517864 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:53:46 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-115660d9-fe3b-4c39-90a5-8eb3428c249a tempest-VolumesListTestJSON-1951517864 None] Deleted volume successfully. Jul 08 01:53:47 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-115660d9-fe3b-4c39-90a5-8eb3428c249a tempest-VolumesListTestJSON-1951517864 None] Lock "cinder-dbaee242-87ab-414e-bedc-758fd1180284-delete_volume" released by "delete_volume" :: held 3.189s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:53:47 devstack sudo[98649]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:47 devstack sudo[98643]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-325fc59a-4f36-49a4-9788-f43b4392dea2 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 1.257s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:47 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-325fc59a-4f36-49a4-9788-f43b4392dea2 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:53:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ce2b8c71-9c78-4505-a55b-af6191eef114 tempest-VolumesListTestJSON-1951517864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ece711ed-94f7-4607-a2a1-3e8bb5648eef" returned: 0 in 1.430s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ce2b8c71-9c78-4505-a55b-af6191eef114 tempest-VolumesListTestJSON-1951517864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ece711ed-94f7-4607-a2a1-3e8bb5648eef {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:47 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-325fc59a-4f36-49a4-9788-f43b4392dea2 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Deleted volume successfully. Jul 08 01:53:47 devstack sudo[98671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ece711ed-94f7-4607-a2a1-3e8bb5648eef Jul 08 01:53:47 devstack sudo[98671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:47 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-325fc59a-4f36-49a4-9788-f43b4392dea2 tempest-CreateVolumesFromSourceVolumeTest-295757694 None] Lock "cinder-65d89ff0-b6ce-43c2-b976-0362f46db5f4-delete_volume" released by "delete_volume" :: held 3.494s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:53:48 devstack sudo[98671]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ce2b8c71-9c78-4505-a55b-af6191eef114 tempest-VolumesListTestJSON-1951517864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ece711ed-94f7-4607-a2a1-3e8bb5648eef" returned: 0 in 0.872s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:48 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-ce2b8c71-9c78-4505-a55b-af6191eef114 tempest-VolumesListTestJSON-1951517864 None] Lock "cinder-quobyte-ece711ed-94f7-4607-a2a1-3e8bb5648eef" released by "delete_volume" :: held 2.355s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:53:48 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-ce2b8c71-9c78-4505-a55b-af6191eef114 tempest-VolumesListTestJSON-1951517864 None] Created reservations ['c91ac129-33cc-4143-a951-33a6c38ed326', 'adecdca5-eb5f-4baf-b972-4ed6d5f2df23', 'c68bf2dc-1257-487f-9a56-009788db8690', '53172d2d-9dfe-495f-a8cd-a74f5c9c7e26'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:53:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-ce2b8c71-9c78-4505-a55b-af6191eef114 tempest-VolumesListTestJSON-1951517864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:53:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-ce2b8c71-9c78-4505-a55b-af6191eef114 tempest-VolumesListTestJSON-1951517864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:53:48 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-ce2b8c71-9c78-4505-a55b-af6191eef114 tempest-VolumesListTestJSON-1951517864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:53:48 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-ce2b8c71-9c78-4505-a55b-af6191eef114 tempest-VolumesListTestJSON-1951517864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:53:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-ce2b8c71-9c78-4505-a55b-af6191eef114 tempest-VolumesListTestJSON-1951517864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:53:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ce2b8c71-9c78-4505-a55b-af6191eef114 tempest-VolumesListTestJSON-1951517864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:48 devstack sudo[98675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:53:48 devstack sudo[98675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:49 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-4b807c4b-f0da-4673-9666-ac0c607d9b76 tempest-VolumesListTestJSON-1951517864 None] Acquiring lock "cinder-1d5a624a-895e-4a8d-a27c-d988b6551fb5-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:53:49 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-4b807c4b-f0da-4673-9666-ac0c607d9b76 tempest-VolumesListTestJSON-1951517864 None] Lock "cinder-1d5a624a-895e-4a8d-a27c-d988b6551fb5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:53:49 devstack sudo[98675]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:49 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ce2b8c71-9c78-4505-a55b-af6191eef114 tempest-VolumesListTestJSON-1951517864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.939s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:49 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-ce2b8c71-9c78-4505-a55b-af6191eef114 tempest-VolumesListTestJSON-1951517864 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:53:49 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-ce2b8c71-9c78-4505-a55b-af6191eef114 tempest-VolumesListTestJSON-1951517864 None] Deleted volume successfully. Jul 08 01:53:49 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-4b807c4b-f0da-4673-9666-ac0c607d9b76 tempest-VolumesListTestJSON-1951517864 None] Acquiring lock "cinder-quobyte-1d5a624a-895e-4a8d-a27c-d988b6551fb5" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:53:49 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-ce2b8c71-9c78-4505-a55b-af6191eef114 tempest-VolumesListTestJSON-1951517864 None] Lock "cinder-ece711ed-94f7-4607-a2a1-3e8bb5648eef-delete_volume" released by "delete_volume" :: held 3.643s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:53:49 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-4b807c4b-f0da-4673-9666-ac0c607d9b76 tempest-VolumesListTestJSON-1951517864 None] Lock "cinder-quobyte-1d5a624a-895e-4a8d-a27c-d988b6551fb5" acquired by "delete_volume" :: waited 0.025s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:53:49 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[15efbc16-b79c-491d-8674-55542966d1e8]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:53:49 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4b807c4b-f0da-4673-9666-ac0c607d9b76 tempest-VolumesListTestJSON-1951517864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1d5a624a-895e-4a8d-a27c-d988b6551fb5 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:50 devstack sudo[98678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1d5a624a-895e-4a8d-a27c-d988b6551fb5 Jul 08 01:53:50 devstack sudo[98678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:50 devstack sudo[98678]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:50 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4b807c4b-f0da-4673-9666-ac0c607d9b76 tempest-VolumesListTestJSON-1951517864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1d5a624a-895e-4a8d-a27c-d988b6551fb5" returned: 0 in 0.934s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:50 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4b807c4b-f0da-4673-9666-ac0c607d9b76 tempest-VolumesListTestJSON-1951517864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1d5a624a-895e-4a8d-a27c-d988b6551fb5 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:50 devstack sudo[98684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1d5a624a-895e-4a8d-a27c-d988b6551fb5 Jul 08 01:53:50 devstack sudo[98684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:51 devstack sudo[98684]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4b807c4b-f0da-4673-9666-ac0c607d9b76 tempest-VolumesListTestJSON-1951517864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1d5a624a-895e-4a8d-a27c-d988b6551fb5" returned: 0 in 0.829s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:51 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-4b807c4b-f0da-4673-9666-ac0c607d9b76 tempest-VolumesListTestJSON-1951517864 None] Lock "cinder-quobyte-1d5a624a-895e-4a8d-a27c-d988b6551fb5" released by "delete_volume" :: held 1.807s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:53:51 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-4b807c4b-f0da-4673-9666-ac0c607d9b76 tempest-VolumesListTestJSON-1951517864 None] Created reservations ['b149794f-873a-4bc1-9e8f-1189338c17bc', 'aacfea89-ea29-4018-9f58-561bd97b373a', '080221ce-3cce-40b1-987b-bf7d8d866eaf', '15d30d1e-40af-423e-95c4-a0973ce15814'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:53:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-4b807c4b-f0da-4673-9666-ac0c607d9b76 tempest-VolumesListTestJSON-1951517864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:53:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-4b807c4b-f0da-4673-9666-ac0c607d9b76 tempest-VolumesListTestJSON-1951517864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:53:51 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-4b807c4b-f0da-4673-9666-ac0c607d9b76 tempest-VolumesListTestJSON-1951517864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:53:51 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-4b807c4b-f0da-4673-9666-ac0c607d9b76 tempest-VolumesListTestJSON-1951517864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:53:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-4b807c4b-f0da-4673-9666-ac0c607d9b76 tempest-VolumesListTestJSON-1951517864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:53:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4b807c4b-f0da-4673-9666-ac0c607d9b76 tempest-VolumesListTestJSON-1951517864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:51 devstack sudo[98688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:53:51 devstack sudo[98688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:52 devstack sudo[98688]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:52 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4b807c4b-f0da-4673-9666-ac0c607d9b76 tempest-VolumesListTestJSON-1951517864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 1.005s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:52 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-4b807c4b-f0da-4673-9666-ac0c607d9b76 tempest-VolumesListTestJSON-1951517864 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:53:52 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-4b807c4b-f0da-4673-9666-ac0c607d9b76 tempest-VolumesListTestJSON-1951517864 None] Deleted volume successfully. Jul 08 01:53:52 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-4b807c4b-f0da-4673-9666-ac0c607d9b76 tempest-VolumesListTestJSON-1951517864 None] Lock "cinder-1d5a624a-895e-4a8d-a27c-d988b6551fb5-delete_volume" released by "delete_volume" :: held 3.093s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:53:57 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7f52d5f5-5015-4bb2-ad89-861656281572 tempest-TestServerVolumeAttachmentScenario-1700580262 None] Acquiring lock "cinder-c7b32e87-a71d-4eba-9328-87c8526de819-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:53:57 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7f52d5f5-5015-4bb2-ad89-861656281572 tempest-TestServerVolumeAttachmentScenario-1700580262 None] Lock "cinder-c7b32e87-a71d-4eba-9328-87c8526de819-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:53:57 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7f52d5f5-5015-4bb2-ad89-861656281572 tempest-TestServerVolumeAttachmentScenario-1700580262 None] Acquiring lock "cinder-quobyte-c7b32e87-a71d-4eba-9328-87c8526de819" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:53:57 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7f52d5f5-5015-4bb2-ad89-861656281572 tempest-TestServerVolumeAttachmentScenario-1700580262 None] Lock "cinder-quobyte-c7b32e87-a71d-4eba-9328-87c8526de819" acquired by "delete_volume" :: waited 0.015s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:53:57 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[73774c60-5279-4978-9439-ad46db613768]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:53:57 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7f52d5f5-5015-4bb2-ad89-861656281572 tempest-TestServerVolumeAttachmentScenario-1700580262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c7b32e87-a71d-4eba-9328-87c8526de819 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:57 devstack sudo[98697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c7b32e87-a71d-4eba-9328-87c8526de819 Jul 08 01:53:57 devstack sudo[98697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:58 devstack sudo[98697]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:58 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7f52d5f5-5015-4bb2-ad89-861656281572 tempest-TestServerVolumeAttachmentScenario-1700580262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c7b32e87-a71d-4eba-9328-87c8526de819" returned: 0 in 0.866s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:58 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7f52d5f5-5015-4bb2-ad89-861656281572 tempest-TestServerVolumeAttachmentScenario-1700580262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c7b32e87-a71d-4eba-9328-87c8526de819 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:58 devstack sudo[98702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c7b32e87-a71d-4eba-9328-87c8526de819 Jul 08 01:53:58 devstack sudo[98702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:59 devstack sudo[98702]: pam_unix(sudo:session): session closed for user root Jul 08 01:53:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7f52d5f5-5015-4bb2-ad89-861656281572 tempest-TestServerVolumeAttachmentScenario-1700580262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c7b32e87-a71d-4eba-9328-87c8526de819" returned: 0 in 0.760s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:53:59 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7f52d5f5-5015-4bb2-ad89-861656281572 tempest-TestServerVolumeAttachmentScenario-1700580262 None] Lock "cinder-quobyte-c7b32e87-a71d-4eba-9328-87c8526de819" released by "delete_volume" :: held 1.688s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:53:59 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-7f52d5f5-5015-4bb2-ad89-861656281572 tempest-TestServerVolumeAttachmentScenario-1700580262 None] Created reservations ['4512e195-465c-473c-adc5-08c2250a30a7', '23d70cf5-da58-4cfb-b736-45df97cfa28c', 'bba4be89-fbe8-428c-bdd5-9d43e9108cf8', 'd4b9a8f2-8dc2-4033-bb17-cf40582a2093'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:53:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7f52d5f5-5015-4bb2-ad89-861656281572 tempest-TestServerVolumeAttachmentScenario-1700580262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:53:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7f52d5f5-5015-4bb2-ad89-861656281572 tempest-TestServerVolumeAttachmentScenario-1700580262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:53:59 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-7f52d5f5-5015-4bb2-ad89-861656281572 tempest-TestServerVolumeAttachmentScenario-1700580262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:53:59 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-7f52d5f5-5015-4bb2-ad89-861656281572 tempest-TestServerVolumeAttachmentScenario-1700580262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:53:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7f52d5f5-5015-4bb2-ad89-861656281572 tempest-TestServerVolumeAttachmentScenario-1700580262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:53:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7f52d5f5-5015-4bb2-ad89-861656281572 tempest-TestServerVolumeAttachmentScenario-1700580262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:53:59 devstack sudo[98705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:53:59 devstack sudo[98705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:53:59 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-49c3adc5-0122-46e7-b529-e05fd9cd8e72 tempest-TestServerVolumeAttachmentScenario-1700580262 None] Acquiring lock "cinder-7155157f-98b1-49c5-8e5f-577012d0e574-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:53:59 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-49c3adc5-0122-46e7-b529-e05fd9cd8e72 tempest-TestServerVolumeAttachmentScenario-1700580262 None] Lock "cinder-7155157f-98b1-49c5-8e5f-577012d0e574-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:53:59 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-49c3adc5-0122-46e7-b529-e05fd9cd8e72 tempest-TestServerVolumeAttachmentScenario-1700580262 None] Acquiring lock "cinder-quobyte-7155157f-98b1-49c5-8e5f-577012d0e574" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:53:59 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-49c3adc5-0122-46e7-b529-e05fd9cd8e72 tempest-TestServerVolumeAttachmentScenario-1700580262 None] Lock "cinder-quobyte-7155157f-98b1-49c5-8e5f-577012d0e574" acquired by "delete_volume" :: waited 0.026s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:53:59 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[328eaa1e-5422-4a66-83f0-47c79de18363]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:53:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-49c3adc5-0122-46e7-b529-e05fd9cd8e72 tempest-TestServerVolumeAttachmentScenario-1700580262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7155157f-98b1-49c5-8e5f-577012d0e574 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:54:00 devstack sudo[98707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7155157f-98b1-49c5-8e5f-577012d0e574 Jul 08 01:54:00 devstack sudo[98707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:54:00 devstack sudo[98705]: pam_unix(sudo:session): session closed for user root Jul 08 01:54:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7f52d5f5-5015-4bb2-ad89-861656281572 tempest-TestServerVolumeAttachmentScenario-1700580262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.891s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:54:00 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-7f52d5f5-5015-4bb2-ad89-861656281572 tempest-TestServerVolumeAttachmentScenario-1700580262 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:54:00 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-7f52d5f5-5015-4bb2-ad89-861656281572 tempest-TestServerVolumeAttachmentScenario-1700580262 None] Deleted volume successfully. Jul 08 01:54:00 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7f52d5f5-5015-4bb2-ad89-861656281572 tempest-TestServerVolumeAttachmentScenario-1700580262 None] Lock "cinder-c7b32e87-a71d-4eba-9328-87c8526de819-delete_volume" released by "delete_volume" :: held 2.856s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:54:00 devstack sudo[98707]: pam_unix(sudo:session): session closed for user root Jul 08 01:54:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-49c3adc5-0122-46e7-b529-e05fd9cd8e72 tempest-TestServerVolumeAttachmentScenario-1700580262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7155157f-98b1-49c5-8e5f-577012d0e574" returned: 0 in 1.070s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:54:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-49c3adc5-0122-46e7-b529-e05fd9cd8e72 tempest-TestServerVolumeAttachmentScenario-1700580262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7155157f-98b1-49c5-8e5f-577012d0e574 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:54:00 devstack sudo[98714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7155157f-98b1-49c5-8e5f-577012d0e574 Jul 08 01:54:00 devstack sudo[98714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:54:01 devstack sudo[98714]: pam_unix(sudo:session): session closed for user root Jul 08 01:54:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-49c3adc5-0122-46e7-b529-e05fd9cd8e72 tempest-TestServerVolumeAttachmentScenario-1700580262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7155157f-98b1-49c5-8e5f-577012d0e574" returned: 0 in 1.010s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:54:01 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-49c3adc5-0122-46e7-b529-e05fd9cd8e72 tempest-TestServerVolumeAttachmentScenario-1700580262 None] Lock "cinder-quobyte-7155157f-98b1-49c5-8e5f-577012d0e574" released by "delete_volume" :: held 2.169s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:54:01 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-49c3adc5-0122-46e7-b529-e05fd9cd8e72 tempest-TestServerVolumeAttachmentScenario-1700580262 None] Created reservations ['addf1c3d-a3f9-4f0a-9aeb-62362b91040e', '3678bb6b-d2c4-49df-adc8-5110de852bdb', '00a3a47c-8879-4a10-bc8c-ec17c0d8b79d', '94515cf1-cec1-4e9c-a1ba-518e25af7317'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:54:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-49c3adc5-0122-46e7-b529-e05fd9cd8e72 tempest-TestServerVolumeAttachmentScenario-1700580262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:54:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-49c3adc5-0122-46e7-b529-e05fd9cd8e72 tempest-TestServerVolumeAttachmentScenario-1700580262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:54:02 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-49c3adc5-0122-46e7-b529-e05fd9cd8e72 tempest-TestServerVolumeAttachmentScenario-1700580262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:54:02 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-49c3adc5-0122-46e7-b529-e05fd9cd8e72 tempest-TestServerVolumeAttachmentScenario-1700580262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:54:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-49c3adc5-0122-46e7-b529-e05fd9cd8e72 tempest-TestServerVolumeAttachmentScenario-1700580262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:54:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-49c3adc5-0122-46e7-b529-e05fd9cd8e72 tempest-TestServerVolumeAttachmentScenario-1700580262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:54:02 devstack sudo[98733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:54:02 devstack sudo[98733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:54:02 devstack sudo[98733]: pam_unix(sudo:session): session closed for user root Jul 08 01:54:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-49c3adc5-0122-46e7-b529-e05fd9cd8e72 tempest-TestServerVolumeAttachmentScenario-1700580262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.857s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:54:02 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-49c3adc5-0122-46e7-b529-e05fd9cd8e72 tempest-TestServerVolumeAttachmentScenario-1700580262 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:54:02 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-49c3adc5-0122-46e7-b529-e05fd9cd8e72 tempest-TestServerVolumeAttachmentScenario-1700580262 None] Deleted volume successfully. Jul 08 01:54:02 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-49c3adc5-0122-46e7-b529-e05fd9cd8e72 tempest-TestServerVolumeAttachmentScenario-1700580262 None] Lock "cinder-7155157f-98b1-49c5-8e5f-577012d0e574-delete_volume" released by "delete_volume" :: held 3.331s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:54:12 devstack cinder-volume[87134]: DEBUG dbcounter [-] [87134] Writing DB stats cinder:UPDATE=107,cinder:DELETE=8,cinder:SELECT=64,cinder:INSERT=23 {{(pid=87134) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:54:13 devstack cinder-volume[87134]: DEBUG dbcounter [-] [87134] Writing DB stats cinder:SELECT=72,cinder:INSERT=25,cinder:UPDATE=96,cinder:DELETE=8 {{(pid=87134) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:54:20 devstack cinder-volume[87134]: DEBUG oslo_service.periodic_task [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87134) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:54:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:54:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:54:20 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:54:20 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:54:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:54:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:54:20 devstack sudo[98816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:54:20 devstack sudo[98816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:54:22 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-a44799ad-0123-480a-bb7f-714d0979c6db tempest-VolumesActionsTest-858798371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:54:22 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-a44799ad-0123-480a-bb7f-714d0979c6db tempest-VolumesActionsTest-858798371 None] Flow 'volume_create_manager' (950a7feb-a2d1-452c-8dd3-cbb7f41cdb20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:54:22 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-a44799ad-0123-480a-bb7f-714d0979c6db tempest-VolumesActionsTest-858798371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (644f1f8f-9478-410f-af5c-d8a06402a621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:54:22 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-a44799ad-0123-480a-bb7f-714d0979c6db tempest-VolumesActionsTest-858798371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (644f1f8f-9478-410f-af5c-d8a06402a621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:54:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2016944044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b2550cd-79fc-4188-9a40-0c1284554a81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2e418254e5b4204ac6e2d6dafbf6acc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:54:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:54:22Z,use_quota=True,user_id='8bf983e2216d48eea401f66f8848a17b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:54:22 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-a44799ad-0123-480a-bb7f-714d0979c6db tempest-VolumesActionsTest-858798371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de57c8db-67d9-4e30-b53a-f34e8e6c4b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:54:22 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-a44799ad-0123-480a-bb7f-714d0979c6db tempest-VolumesActionsTest-858798371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de57c8db-67d9-4e30-b53a-f34e8e6c4b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:54:22 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-a44799ad-0123-480a-bb7f-714d0979c6db tempest-VolumesActionsTest-858798371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (961c5acf-cd60-4701-98bd-c21d8ba4817b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:54:22 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-a44799ad-0123-480a-bb7f-714d0979c6db tempest-VolumesActionsTest-858798371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (961c5acf-cd60-4701-98bd-c21d8ba4817b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b2550cd-79fc-4188-9a40-0c1284554a81', 'volume_name': 'volume-6b2550cd-79fc-4188-9a40-0c1284554a81', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:54:22 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-a44799ad-0123-480a-bb7f-714d0979c6db tempest-VolumesActionsTest-858798371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (326a3172-ded9-44d2-926c-e854a90ce5b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:54:22 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-a44799ad-0123-480a-bb7f-714d0979c6db tempest-VolumesActionsTest-858798371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (326a3172-ded9-44d2-926c-e854a90ce5b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:54:22 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-a44799ad-0123-480a-bb7f-714d0979c6db tempest-VolumesActionsTest-858798371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4007396-1e3f-4034-86c6-66c06f19bbce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:54:22 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-a44799ad-0123-480a-bb7f-714d0979c6db tempest-VolumesActionsTest-858798371 None] Volume 6b2550cd-79fc-4188-9a40-0c1284554a81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b2550cd-79fc-4188-9a40-0c1284554a81', 'volume_size': 1} Jul 08 01:54:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-a44799ad-0123-480a-bb7f-714d0979c6db tempest-VolumesActionsTest-858798371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:54:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-a44799ad-0123-480a-bb7f-714d0979c6db tempest-VolumesActionsTest-858798371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:54:22 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-a44799ad-0123-480a-bb7f-714d0979c6db tempest-VolumesActionsTest-858798371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:54:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2016944044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b2550cd-79fc-4188-9a40-0c1284554a81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2e418254e5b4204ac6e2d6dafbf6acc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:54:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:54:22Z,use_quota=True,user_id='8bf983e2216d48eea401f66f8848a17b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:54:22 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-a44799ad-0123-480a-bb7f-714d0979c6db tempest-VolumesActionsTest-858798371 None] Creating volume 6b2550cd-79fc-4188-9a40-0c1284554a81 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:54:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-a44799ad-0123-480a-bb7f-714d0979c6db tempest-VolumesActionsTest-858798371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:54:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-a44799ad-0123-480a-bb7f-714d0979c6db tempest-VolumesActionsTest-858798371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:54:22 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-a44799ad-0123-480a-bb7f-714d0979c6db tempest-VolumesActionsTest-858798371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:54:22 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-a44799ad-0123-480a-bb7f-714d0979c6db tempest-VolumesActionsTest-858798371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:54:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-a44799ad-0123-480a-bb7f-714d0979c6db tempest-VolumesActionsTest-858798371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:54:22 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-a44799ad-0123-480a-bb7f-714d0979c6db tempest-VolumesActionsTest-858798371 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:54:22 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-a44799ad-0123-480a-bb7f-714d0979c6db tempest-VolumesActionsTest-858798371 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:54:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a44799ad-0123-480a-bb7f-714d0979c6db tempest-VolumesActionsTest-858798371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-6b2550cd-79fc-4188-9a40-0c1284554a81 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:54:22 devstack sudo[98820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-6b2550cd-79fc-4188-9a40-0c1284554a81 1073741824 Jul 08 01:54:22 devstack sudo[98820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:54:22 devstack sudo[98816]: pam_unix(sudo:session): session closed for user root Jul 08 01:54:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 1.293s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:54:22 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:54:22 devstack cinder-volume[87134]: DEBUG oslo_service.periodic_task [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running periodic task VolumeManager._thread_info {{(pid=87134) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:54:22 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] thread count: 28 {{(pid=87134) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:54:22 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] thread info: [<_MainThread(MainThread, started 129378964615296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87134) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:54:23 devstack sudo[98820]: pam_unix(sudo:session): session closed for user root Jul 08 01:54:23 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a44799ad-0123-480a-bb7f-714d0979c6db tempest-VolumesActionsTest-858798371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-6b2550cd-79fc-4188-9a40-0c1284554a81 1073741824" returned: 0 in 1.315s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:54:23 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a44799ad-0123-480a-bb7f-714d0979c6db tempest-VolumesActionsTest-858798371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-6b2550cd-79fc-4188-9a40-0c1284554a81 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:54:23 devstack sudo[98827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-6b2550cd-79fc-4188-9a40-0c1284554a81 Jul 08 01:54:23 devstack sudo[98827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:54:24 devstack sudo[98827]: pam_unix(sudo:session): session closed for user root Jul 08 01:54:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a44799ad-0123-480a-bb7f-714d0979c6db tempest-VolumesActionsTest-858798371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-6b2550cd-79fc-4188-9a40-0c1284554a81" returned: 0 in 0.836s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:54:24 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-a44799ad-0123-480a-bb7f-714d0979c6db tempest-VolumesActionsTest-858798371 None] <== create_volume: return (2233ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:54:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-a44799ad-0123-480a-bb7f-714d0979c6db tempest-VolumesActionsTest-858798371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.237s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:54:24 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-a44799ad-0123-480a-bb7f-714d0979c6db tempest-VolumesActionsTest-858798371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4007396-1e3f-4034-86c6-66c06f19bbce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b2550cd-79fc-4188-9a40-0c1284554a81', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:54:24 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-a44799ad-0123-480a-bb7f-714d0979c6db tempest-VolumesActionsTest-858798371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab7b1257-b07b-4eb3-844a-a578f604f403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:54:24 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-a44799ad-0123-480a-bb7f-714d0979c6db tempest-VolumesActionsTest-858798371 None] Volume volume-6b2550cd-79fc-4188-9a40-0c1284554a81 (6b2550cd-79fc-4188-9a40-0c1284554a81): created successfully Jul 08 01:54:24 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-a44799ad-0123-480a-bb7f-714d0979c6db tempest-VolumesActionsTest-858798371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab7b1257-b07b-4eb3-844a-a578f604f403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:54:24 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-a44799ad-0123-480a-bb7f-714d0979c6db tempest-VolumesActionsTest-858798371 None] Flow 'volume_create_manager' (950a7feb-a2d1-452c-8dd3-cbb7f41cdb20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:54:24 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-a44799ad-0123-480a-bb7f-714d0979c6db tempest-VolumesActionsTest-858798371 None] Created volume successfully. Jul 08 01:54:25 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-0de25cfc-77cc-46a6-a01d-ee83b1f7b574 tempest-VolumesActionsTest-858798371 None] Acquiring lock "cinder-6b2550cd-79fc-4188-9a40-0c1284554a81" by "attach_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:54:25 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-0de25cfc-77cc-46a6-a01d-ee83b1f7b574 tempest-VolumesActionsTest-858798371 None] Lock "cinder-6b2550cd-79fc-4188-9a40-0c1284554a81" acquired by "attach_volume" :: waited 0.023s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:54:25 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-0de25cfc-77cc-46a6-a01d-ee83b1f7b574 tempest-VolumesActionsTest-858798371 None] Attaching volume 6b2550cd-79fc-4188-9a40-0c1284554a81 to instance ce6d91e9-5419-4bef-ae9f-1355eef6769d at mountpoint /dev/vdb on host None. Jul 08 01:54:25 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-0de25cfc-77cc-46a6-a01d-ee83b1f7b574 tempest-VolumesActionsTest-858798371 None] Attach volume completed successfully. Jul 08 01:54:25 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-0de25cfc-77cc-46a6-a01d-ee83b1f7b574 tempest-VolumesActionsTest-858798371 None] Lock "cinder-6b2550cd-79fc-4188-9a40-0c1284554a81" released by "attach_volume" :: held 0.110s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:54:26 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-478ac94a-4795-4ac7-91d9-072e0c7aaec4 tempest-VolumesActionsTest-75141281 None] Terminate volume connection completed successfully. Jul 08 01:54:26 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-01b51768-35f7-40b0-9f24-fd2d5f79f800 tempest-TestInstancesWithCinderVolumes-108683866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:54:26 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-01b51768-35f7-40b0-9f24-fd2d5f79f800 tempest-TestInstancesWithCinderVolumes-108683866 None] Flow 'volume_create_manager' (79c41de5-b9cd-4688-aed2-4afdf8b7c836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:54:26 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-01b51768-35f7-40b0-9f24-fd2d5f79f800 tempest-TestInstancesWithCinderVolumes-108683866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc5f3b38-897d-4f6a-a874-79eb8b07ec02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:54:26 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-01b51768-35f7-40b0-9f24-fd2d5f79f800 tempest-TestInstancesWithCinderVolumes-108683866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc5f3b38-897d-4f6a-a874-79eb8b07ec02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:54:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1481549214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e953a563-a0b3-4b57-9c77-fc3f6e9d0409,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aecf5f067d894ec5abc5c4cc36f3f901',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:54:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:54:27Z,use_quota=True,user_id='ba59983a36c8423687687f711423e875',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f1febab7-2d21-4f37-b347-b36ab0ccbdbd),volume_type_id=f1febab7-2d21-4f37-b347-b36ab0ccbdbd)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:54:26 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-01b51768-35f7-40b0-9f24-fd2d5f79f800 tempest-TestInstancesWithCinderVolumes-108683866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd25a9ab-5b47-467e-86e4-ccac2379b5a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:54:26 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-01b51768-35f7-40b0-9f24-fd2d5f79f800 tempest-TestInstancesWithCinderVolumes-108683866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd25a9ab-5b47-467e-86e4-ccac2379b5a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:54:26 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-01b51768-35f7-40b0-9f24-fd2d5f79f800 tempest-TestInstancesWithCinderVolumes-108683866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c08232ad-f187-4437-8173-8a8dd4a59d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:54:26 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-01b51768-35f7-40b0-9f24-fd2d5f79f800 tempest-TestInstancesWithCinderVolumes-108683866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c08232ad-f187-4437-8173-8a8dd4a59d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e953a563-a0b3-4b57-9c77-fc3f6e9d0409', 'volume_name': 'volume-e953a563-a0b3-4b57-9c77-fc3f6e9d0409', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:54:26 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-01b51768-35f7-40b0-9f24-fd2d5f79f800 tempest-TestInstancesWithCinderVolumes-108683866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7295c82-9b6c-4d02-84ff-d19137331b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:54:26 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-01b51768-35f7-40b0-9f24-fd2d5f79f800 tempest-TestInstancesWithCinderVolumes-108683866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7295c82-9b6c-4d02-84ff-d19137331b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:54:26 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-01b51768-35f7-40b0-9f24-fd2d5f79f800 tempest-TestInstancesWithCinderVolumes-108683866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0012d7f9-67f4-49ee-9d58-558c2b117eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:54:26 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-01b51768-35f7-40b0-9f24-fd2d5f79f800 tempest-TestInstancesWithCinderVolumes-108683866 None] Volume e953a563-a0b3-4b57-9c77-fc3f6e9d0409: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e953a563-a0b3-4b57-9c77-fc3f6e9d0409', 'volume_size': 1} Jul 08 01:54:26 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-01b51768-35f7-40b0-9f24-fd2d5f79f800 tempest-TestInstancesWithCinderVolumes-108683866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:54:26 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-01b51768-35f7-40b0-9f24-fd2d5f79f800 tempest-TestInstancesWithCinderVolumes-108683866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:54:26 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-01b51768-35f7-40b0-9f24-fd2d5f79f800 tempest-TestInstancesWithCinderVolumes-108683866 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:54:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1481549214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e953a563-a0b3-4b57-9c77-fc3f6e9d0409,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aecf5f067d894ec5abc5c4cc36f3f901',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:54:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:54:27Z,use_quota=True,user_id='ba59983a36c8423687687f711423e875',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f1febab7-2d21-4f37-b347-b36ab0ccbdbd),volume_type_id=f1febab7-2d21-4f37-b347-b36ab0ccbdbd)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:54:26 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-01b51768-35f7-40b0-9f24-fd2d5f79f800 tempest-TestInstancesWithCinderVolumes-108683866 None] Creating volume e953a563-a0b3-4b57-9c77-fc3f6e9d0409 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:54:26 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-01b51768-35f7-40b0-9f24-fd2d5f79f800 tempest-TestInstancesWithCinderVolumes-108683866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:54:26 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-01b51768-35f7-40b0-9f24-fd2d5f79f800 tempest-TestInstancesWithCinderVolumes-108683866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:54:26 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-01b51768-35f7-40b0-9f24-fd2d5f79f800 tempest-TestInstancesWithCinderVolumes-108683866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:54:26 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-01b51768-35f7-40b0-9f24-fd2d5f79f800 tempest-TestInstancesWithCinderVolumes-108683866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:54:26 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-01b51768-35f7-40b0-9f24-fd2d5f79f800 tempest-TestInstancesWithCinderVolumes-108683866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:54:26 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-01b51768-35f7-40b0-9f24-fd2d5f79f800 tempest-TestInstancesWithCinderVolumes-108683866 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:54:26 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-01b51768-35f7-40b0-9f24-fd2d5f79f800 tempest-TestInstancesWithCinderVolumes-108683866 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:54:26 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-01b51768-35f7-40b0-9f24-fd2d5f79f800 tempest-TestInstancesWithCinderVolumes-108683866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e953a563-a0b3-4b57-9c77-fc3f6e9d0409 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:54:27 devstack sudo[98831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e953a563-a0b3-4b57-9c77-fc3f6e9d0409 1073741824 Jul 08 01:54:27 devstack sudo[98831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:54:27 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-478ac94a-4795-4ac7-91d9-072e0c7aaec4 tempest-VolumesActionsTest-75141281 None] Acquiring lock "cinder-6b2550cd-79fc-4188-9a40-0c1284554a81-detach_volume" by "detach_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:54:27 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-478ac94a-4795-4ac7-91d9-072e0c7aaec4 tempest-VolumesActionsTest-75141281 None] Lock "cinder-6b2550cd-79fc-4188-9a40-0c1284554a81-detach_volume" acquired by "detach_volume" :: waited 0.036s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:54:27 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-478ac94a-4795-4ac7-91d9-072e0c7aaec4 tempest-VolumesActionsTest-75141281 None] Detaching volume 6b2550cd-79fc-4188-9a40-0c1284554a81 from instance ce6d91e9-5419-4bef-ae9f-1355eef6769d. Jul 08 01:54:27 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-478ac94a-4795-4ac7-91d9-072e0c7aaec4 tempest-VolumesActionsTest-75141281 None] Detach volume completed successfully. Jul 08 01:54:27 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-478ac94a-4795-4ac7-91d9-072e0c7aaec4 tempest-VolumesActionsTest-75141281 None] Lock "cinder-6b2550cd-79fc-4188-9a40-0c1284554a81-detach_volume" released by "detach_volume" :: held 0.172s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:54:27 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcec9129-afe1-4d03-8e39-87b45cc5f6e5 tempest-TestInstancesWithCinderVolumes-108683866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:54:27 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-dcec9129-afe1-4d03-8e39-87b45cc5f6e5 tempest-TestInstancesWithCinderVolumes-108683866 None] Flow 'volume_create_manager' (e54941d9-a44b-4447-9bab-3d9a5f3f3a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:54:27 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-dcec9129-afe1-4d03-8e39-87b45cc5f6e5 tempest-TestInstancesWithCinderVolumes-108683866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e476317d-34c1-4550-9fa0-3333e9dd085e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:54:27 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-dcec9129-afe1-4d03-8e39-87b45cc5f6e5 tempest-TestInstancesWithCinderVolumes-108683866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e476317d-34c1-4550-9fa0-3333e9dd085e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:54:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1106393295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc1d83f7-0539-4c7c-ab36-b9902bb10a9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aecf5f067d894ec5abc5c4cc36f3f901',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:54:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:54:28Z,use_quota=True,user_id='ba59983a36c8423687687f711423e875',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fe7ff20-2dea-4e69-823e-4b8f6fc9621f),volume_type_id=3fe7ff20-2dea-4e69-823e-4b8f6fc9621f)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:54:27 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-dcec9129-afe1-4d03-8e39-87b45cc5f6e5 tempest-TestInstancesWithCinderVolumes-108683866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (408fc326-596d-429f-a13f-e86b3181b62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:54:27 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-dcec9129-afe1-4d03-8e39-87b45cc5f6e5 tempest-TestInstancesWithCinderVolumes-108683866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (408fc326-596d-429f-a13f-e86b3181b62d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:54:27 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-dcec9129-afe1-4d03-8e39-87b45cc5f6e5 tempest-TestInstancesWithCinderVolumes-108683866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e425284-8c9d-4662-9ce1-97660e8033ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:54:27 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-dcec9129-afe1-4d03-8e39-87b45cc5f6e5 tempest-TestInstancesWithCinderVolumes-108683866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e425284-8c9d-4662-9ce1-97660e8033ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc1d83f7-0539-4c7c-ab36-b9902bb10a9b', 'volume_name': 'volume-cc1d83f7-0539-4c7c-ab36-b9902bb10a9b', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:54:27 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-dcec9129-afe1-4d03-8e39-87b45cc5f6e5 tempest-TestInstancesWithCinderVolumes-108683866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7cd701b-c99a-414c-8e28-e885139ef9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:54:27 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-dcec9129-afe1-4d03-8e39-87b45cc5f6e5 tempest-TestInstancesWithCinderVolumes-108683866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7cd701b-c99a-414c-8e28-e885139ef9fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:54:27 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-dcec9129-afe1-4d03-8e39-87b45cc5f6e5 tempest-TestInstancesWithCinderVolumes-108683866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e644111c-187f-4b8d-87d2-0d8e6e662bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:54:27 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-dcec9129-afe1-4d03-8e39-87b45cc5f6e5 tempest-TestInstancesWithCinderVolumes-108683866 None] Volume cc1d83f7-0539-4c7c-ab36-b9902bb10a9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc1d83f7-0539-4c7c-ab36-b9902bb10a9b', 'volume_size': 1} Jul 08 01:54:27 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-dcec9129-afe1-4d03-8e39-87b45cc5f6e5 tempest-TestInstancesWithCinderVolumes-108683866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:54:28 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-e60cae9e-f211-47e2-9772-631dddfeb5d5 tempest-VolumesActionsTest-858798371 None] Acquiring lock "cinder-6b2550cd-79fc-4188-9a40-0c1284554a81-detach_volume" by "detach_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:54:28 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-e60cae9e-f211-47e2-9772-631dddfeb5d5 tempest-VolumesActionsTest-858798371 None] Lock "cinder-6b2550cd-79fc-4188-9a40-0c1284554a81-detach_volume" acquired by "detach_volume" :: waited 0.031s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:54:28 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-e60cae9e-f211-47e2-9772-631dddfeb5d5 tempest-VolumesActionsTest-858798371 None] Volume detach called, but volume not attached. Jul 08 01:54:28 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-e60cae9e-f211-47e2-9772-631dddfeb5d5 tempest-VolumesActionsTest-858798371 None] Lock "cinder-6b2550cd-79fc-4188-9a40-0c1284554a81-detach_volume" released by "detach_volume" :: held 0.050s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:54:28 devstack sudo[98831]: pam_unix(sudo:session): session closed for user root Jul 08 01:54:28 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-01b51768-35f7-40b0-9f24-fd2d5f79f800 tempest-TestInstancesWithCinderVolumes-108683866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e953a563-a0b3-4b57-9c77-fc3f6e9d0409 1073741824" returned: 0 in 1.940s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:54:28 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-01b51768-35f7-40b0-9f24-fd2d5f79f800 tempest-TestInstancesWithCinderVolumes-108683866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e953a563-a0b3-4b57-9c77-fc3f6e9d0409 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:54:28 devstack sudo[98894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e953a563-a0b3-4b57-9c77-fc3f6e9d0409 Jul 08 01:54:28 devstack sudo[98894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:54:29 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-98f640a9-f38f-43b5-a84e-eefc87614d94 tempest-TestInstancesWithCinderVolumes-108683866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:54:29 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-98f640a9-f38f-43b5-a84e-eefc87614d94 tempest-TestInstancesWithCinderVolumes-108683866 None] Flow 'volume_create_manager' (47636984-5f00-4d39-a1ea-9dc2a0819e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:54:29 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-98f640a9-f38f-43b5-a84e-eefc87614d94 tempest-TestInstancesWithCinderVolumes-108683866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0fadcb9-7c50-42be-9e8d-eb2822ff2f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:54:29 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-5d79aef3-7f85-4b36-a5f0-434b8ef6549e tempest-VolumesActionsTest-858798371 None] Acquiring lock "cinder-6b2550cd-79fc-4188-9a40-0c1284554a81-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:54:29 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-98f640a9-f38f-43b5-a84e-eefc87614d94 tempest-TestInstancesWithCinderVolumes-108683866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0fadcb9-7c50-42be-9e8d-eb2822ff2f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:54:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1861142280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3d4cc6b-a71d-491c-bd63-5198a70aac1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aecf5f067d894ec5abc5c4cc36f3f901',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:54:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:54:29Z,use_quota=True,user_id='ba59983a36c8423687687f711423e875',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac1cd698-abb0-49a7-a0a6-3bab2d3dad9c),volume_type_id=ac1cd698-abb0-49a7-a0a6-3bab2d3dad9c)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:54:29 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-98f640a9-f38f-43b5-a84e-eefc87614d94 tempest-TestInstancesWithCinderVolumes-108683866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78cc809b-0389-4dc2-b4c8-5d5e22b5b236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:54:29 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-98f640a9-f38f-43b5-a84e-eefc87614d94 tempest-TestInstancesWithCinderVolumes-108683866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78cc809b-0389-4dc2-b4c8-5d5e22b5b236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:54:29 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-98f640a9-f38f-43b5-a84e-eefc87614d94 tempest-TestInstancesWithCinderVolumes-108683866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee0e244c-7190-4541-a50f-5f80ba0bd945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:54:29 devstack cinder-volume[87134]: DEBUG cinder.image.glance [None req-98f640a9-f38f-43b5-a84e-eefc87614d94 tempest-TestInstancesWithCinderVolumes-108683866 None] Creating Keystone auth plugin from conf {{(pid=87134) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 01:54:29 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-5d79aef3-7f85-4b36-a5f0-434b8ef6549e tempest-VolumesActionsTest-858798371 None] Lock "cinder-6b2550cd-79fc-4188-9a40-0c1284554a81-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:54:29 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-5d79aef3-7f85-4b36-a5f0-434b8ef6549e tempest-VolumesActionsTest-858798371 None] Acquiring lock "cinder-quobyte-6b2550cd-79fc-4188-9a40-0c1284554a81" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:54:29 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-5d79aef3-7f85-4b36-a5f0-434b8ef6549e tempest-VolumesActionsTest-858798371 None] Lock "cinder-quobyte-6b2550cd-79fc-4188-9a40-0c1284554a81" acquired by "delete_volume" :: waited 0.024s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:54:29 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[b20380b4-e22d-4bfa-b51e-f0fd5245c642]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:54:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5d79aef3-7f85-4b36-a5f0-434b8ef6549e tempest-VolumesActionsTest-858798371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-6b2550cd-79fc-4188-9a40-0c1284554a81 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:54:29 devstack sudo[98896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-6b2550cd-79fc-4188-9a40-0c1284554a81 Jul 08 01:54:29 devstack sudo[98896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:54:29 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-98f640a9-f38f-43b5-a84e-eefc87614d94 tempest-TestInstancesWithCinderVolumes-108683866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee0e244c-7190-4541-a50f-5f80ba0bd945) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd3d4cc6b-a71d-491c-bd63-5198a70aac1a', 'volume_name': 'volume-d3d4cc6b-a71d-491c-bd63-5198a70aac1a', 'volume_size': 1, 'image_id': '03b3e5ea-714a-41cb-a053-c3580bfc3ceb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/03b3e5ea-714a-41cb-a053-c3580bfc3ceb', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1255768464', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'aecf5f067d894ec5abc5c4cc36f3f901', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '03b3e5ea-714a-41cb-a053-c3580bfc3ceb', 'created_at': datetime.datetime(2026, 7, 7, 23, 54, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 54, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/03b3e5ea-714a-41cb-a053-c3580bfc3ceb/file', 'properties': {}}, 'image_service': }' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:54:29 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-98f640a9-f38f-43b5-a84e-eefc87614d94 tempest-TestInstancesWithCinderVolumes-108683866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47db2652-9d2b-4e91-be65-a0e7313f1540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:54:29 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-98f640a9-f38f-43b5-a84e-eefc87614d94 tempest-TestInstancesWithCinderVolumes-108683866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47db2652-9d2b-4e91-be65-a0e7313f1540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:54:29 devstack sudo[98894]: pam_unix(sudo:session): session closed for user root Jul 08 01:54:29 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-98f640a9-f38f-43b5-a84e-eefc87614d94 tempest-TestInstancesWithCinderVolumes-108683866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7411f80b-7513-47d5-ba33-dc01b0a53dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:54:29 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-98f640a9-f38f-43b5-a84e-eefc87614d94 tempest-TestInstancesWithCinderVolumes-108683866 None] Volume d3d4cc6b-a71d-491c-bd63-5198a70aac1a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d3d4cc6b-a71d-491c-bd63-5198a70aac1a', 'volume_size': 1, 'image_id': '03b3e5ea-714a-41cb-a053-c3580bfc3ceb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/03b3e5ea-714a-41cb-a053-c3580bfc3ceb', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1255768464', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'aecf5f067d894ec5abc5c4cc36f3f901', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '03b3e5ea-714a-41cb-a053-c3580bfc3ceb', 'created_at': datetime.datetime(2026, 7, 7, 23, 54, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 54, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/03b3e5ea-714a-41cb-a053-c3580bfc3ceb/file', 'properties': {}}, 'image_service': } Jul 08 01:54:29 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-98f640a9-f38f-43b5-a84e-eefc87614d94 tempest-TestInstancesWithCinderVolumes-108683866 None] Trying to clone d3d4cc6b-a71d-491c-bd63-5198a70aac1a from image 03b3e5ea-714a-41cb-a053-c3580bfc3ceb at location (None, [{'url': 'file:///opt/stack/data/glance/images/03b3e5ea-714a-41cb-a053-c3580bfc3ceb', 'metadata': {}}]). {{(pid=87134) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 01:54:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-01b51768-35f7-40b0-9f24-fd2d5f79f800 tempest-TestInstancesWithCinderVolumes-108683866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e953a563-a0b3-4b57-9c77-fc3f6e9d0409" returned: 0 in 0.839s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:54:29 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-01b51768-35f7-40b0-9f24-fd2d5f79f800 tempest-TestInstancesWithCinderVolumes-108683866 None] <== create_volume: return (2829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:54:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-01b51768-35f7-40b0-9f24-fd2d5f79f800 tempest-TestInstancesWithCinderVolumes-108683866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.835s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:54:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-dcec9129-afe1-4d03-8e39-87b45cc5f6e5 tempest-TestInstancesWithCinderVolumes-108683866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.012s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:54:29 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-dcec9129-afe1-4d03-8e39-87b45cc5f6e5 tempest-TestInstancesWithCinderVolumes-108683866 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:54:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1106393295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc1d83f7-0539-4c7c-ab36-b9902bb10a9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aecf5f067d894ec5abc5c4cc36f3f901',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:54:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:54:28Z,use_quota=True,user_id='ba59983a36c8423687687f711423e875',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fe7ff20-2dea-4e69-823e-4b8f6fc9621f),volume_type_id=3fe7ff20-2dea-4e69-823e-4b8f6fc9621f)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:54:29 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-dcec9129-afe1-4d03-8e39-87b45cc5f6e5 tempest-TestInstancesWithCinderVolumes-108683866 None] Creating volume cc1d83f7-0539-4c7c-ab36-b9902bb10a9b {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:54:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-dcec9129-afe1-4d03-8e39-87b45cc5f6e5 tempest-TestInstancesWithCinderVolumes-108683866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:54:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-dcec9129-afe1-4d03-8e39-87b45cc5f6e5 tempest-TestInstancesWithCinderVolumes-108683866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:54:29 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-dcec9129-afe1-4d03-8e39-87b45cc5f6e5 tempest-TestInstancesWithCinderVolumes-108683866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:54:29 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-dcec9129-afe1-4d03-8e39-87b45cc5f6e5 tempest-TestInstancesWithCinderVolumes-108683866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:54:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-dcec9129-afe1-4d03-8e39-87b45cc5f6e5 tempest-TestInstancesWithCinderVolumes-108683866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:54:29 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-dcec9129-afe1-4d03-8e39-87b45cc5f6e5 tempest-TestInstancesWithCinderVolumes-108683866 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:54:29 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-dcec9129-afe1-4d03-8e39-87b45cc5f6e5 tempest-TestInstancesWithCinderVolumes-108683866 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:54:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-dcec9129-afe1-4d03-8e39-87b45cc5f6e5 tempest-TestInstancesWithCinderVolumes-108683866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-cc1d83f7-0539-4c7c-ab36-b9902bb10a9b 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:54:29 devstack sudo[98899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-cc1d83f7-0539-4c7c-ab36-b9902bb10a9b 1073741824 Jul 08 01:54:29 devstack sudo[98899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:54:29 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-01b51768-35f7-40b0-9f24-fd2d5f79f800 tempest-TestInstancesWithCinderVolumes-108683866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0012d7f9-67f4-49ee-9d58-558c2b117eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e953a563-a0b3-4b57-9c77-fc3f6e9d0409', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:54:29 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-01b51768-35f7-40b0-9f24-fd2d5f79f800 tempest-TestInstancesWithCinderVolumes-108683866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47fb1b42-307d-49ff-97c2-aeb28313bf64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:54:29 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-01b51768-35f7-40b0-9f24-fd2d5f79f800 tempest-TestInstancesWithCinderVolumes-108683866 None] Volume volume-e953a563-a0b3-4b57-9c77-fc3f6e9d0409 (e953a563-a0b3-4b57-9c77-fc3f6e9d0409): created successfully Jul 08 01:54:29 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-01b51768-35f7-40b0-9f24-fd2d5f79f800 tempest-TestInstancesWithCinderVolumes-108683866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47fb1b42-307d-49ff-97c2-aeb28313bf64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:54:29 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-01b51768-35f7-40b0-9f24-fd2d5f79f800 tempest-TestInstancesWithCinderVolumes-108683866 None] Flow 'volume_create_manager' (79c41de5-b9cd-4688-aed2-4afdf8b7c836) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:54:30 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-01b51768-35f7-40b0-9f24-fd2d5f79f800 tempest-TestInstancesWithCinderVolumes-108683866 None] Created volume successfully. Jul 08 01:54:30 devstack sudo[98896]: pam_unix(sudo:session): session closed for user root Jul 08 01:54:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5d79aef3-7f85-4b36-a5f0-434b8ef6549e tempest-VolumesActionsTest-858798371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-6b2550cd-79fc-4188-9a40-0c1284554a81" returned: 0 in 1.073s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:54:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5d79aef3-7f85-4b36-a5f0-434b8ef6549e tempest-VolumesActionsTest-858798371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-6b2550cd-79fc-4188-9a40-0c1284554a81 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:54:30 devstack sudo[98905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-6b2550cd-79fc-4188-9a40-0c1284554a81 Jul 08 01:54:30 devstack sudo[98905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:54:31 devstack sudo[98899]: pam_unix(sudo:session): session closed for user root Jul 08 01:54:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-dcec9129-afe1-4d03-8e39-87b45cc5f6e5 tempest-TestInstancesWithCinderVolumes-108683866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-cc1d83f7-0539-4c7c-ab36-b9902bb10a9b 1073741824" returned: 0 in 1.201s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:54:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-dcec9129-afe1-4d03-8e39-87b45cc5f6e5 tempest-TestInstancesWithCinderVolumes-108683866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-cc1d83f7-0539-4c7c-ab36-b9902bb10a9b {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:54:31 devstack sudo[98917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-cc1d83f7-0539-4c7c-ab36-b9902bb10a9b Jul 08 01:54:31 devstack sudo[98917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:54:31 devstack sudo[98905]: pam_unix(sudo:session): session closed for user root Jul 08 01:54:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5d79aef3-7f85-4b36-a5f0-434b8ef6549e tempest-VolumesActionsTest-858798371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-6b2550cd-79fc-4188-9a40-0c1284554a81" returned: 0 in 0.885s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:54:31 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-5d79aef3-7f85-4b36-a5f0-434b8ef6549e tempest-VolumesActionsTest-858798371 None] Lock "cinder-quobyte-6b2550cd-79fc-4188-9a40-0c1284554a81" released by "delete_volume" :: held 2.008s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:54:31 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-5d79aef3-7f85-4b36-a5f0-434b8ef6549e tempest-VolumesActionsTest-858798371 None] Created reservations ['46321038-30cd-45a5-a74e-73e5e38d338c', '64074173-0b8b-4754-ad93-aae97ed592bf', '5f96a4cb-a559-45ee-af92-ecd2378e6e40', 'f4ceb2af-d7b5-491d-9300-2fa23deaccb5'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:54:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5d79aef3-7f85-4b36-a5f0-434b8ef6549e tempest-VolumesActionsTest-858798371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:54:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5d79aef3-7f85-4b36-a5f0-434b8ef6549e tempest-VolumesActionsTest-858798371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:54:31 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-5d79aef3-7f85-4b36-a5f0-434b8ef6549e tempest-VolumesActionsTest-858798371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:54:31 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-5d79aef3-7f85-4b36-a5f0-434b8ef6549e tempest-VolumesActionsTest-858798371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:54:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5d79aef3-7f85-4b36-a5f0-434b8ef6549e tempest-VolumesActionsTest-858798371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:54:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5d79aef3-7f85-4b36-a5f0-434b8ef6549e tempest-VolumesActionsTest-858798371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:54:31 devstack sudo[98920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:54:31 devstack sudo[98920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:54:32 devstack sudo[98917]: pam_unix(sudo:session): session closed for user root Jul 08 01:54:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-dcec9129-afe1-4d03-8e39-87b45cc5f6e5 tempest-TestInstancesWithCinderVolumes-108683866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-cc1d83f7-0539-4c7c-ab36-b9902bb10a9b" returned: 0 in 1.073s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:54:32 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-dcec9129-afe1-4d03-8e39-87b45cc5f6e5 tempest-TestInstancesWithCinderVolumes-108683866 None] <== create_volume: return (2340ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:54:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-dcec9129-afe1-4d03-8e39-87b45cc5f6e5 tempest-TestInstancesWithCinderVolumes-108683866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.343s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:54:32 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-dcec9129-afe1-4d03-8e39-87b45cc5f6e5 tempest-TestInstancesWithCinderVolumes-108683866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e644111c-187f-4b8d-87d2-0d8e6e662bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc1d83f7-0539-4c7c-ab36-b9902bb10a9b', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:54:32 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-dcec9129-afe1-4d03-8e39-87b45cc5f6e5 tempest-TestInstancesWithCinderVolumes-108683866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8e19d2c-c2b3-4969-a654-55f3cffa54d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:54:32 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-dcec9129-afe1-4d03-8e39-87b45cc5f6e5 tempest-TestInstancesWithCinderVolumes-108683866 None] Volume volume-cc1d83f7-0539-4c7c-ab36-b9902bb10a9b (cc1d83f7-0539-4c7c-ab36-b9902bb10a9b): created successfully Jul 08 01:54:32 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-dcec9129-afe1-4d03-8e39-87b45cc5f6e5 tempest-TestInstancesWithCinderVolumes-108683866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8e19d2c-c2b3-4969-a654-55f3cffa54d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:54:32 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-dcec9129-afe1-4d03-8e39-87b45cc5f6e5 tempest-TestInstancesWithCinderVolumes-108683866 None] Flow 'volume_create_manager' (e54941d9-a44b-4447-9bab-3d9a5f3f3a76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:54:32 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-dcec9129-afe1-4d03-8e39-87b45cc5f6e5 tempest-TestInstancesWithCinderVolumes-108683866 None] Created volume successfully. Jul 08 01:54:32 devstack sudo[98920]: pam_unix(sudo:session): session closed for user root Jul 08 01:54:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5d79aef3-7f85-4b36-a5f0-434b8ef6549e tempest-VolumesActionsTest-858798371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.782s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:54:32 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-5d79aef3-7f85-4b36-a5f0-434b8ef6549e tempest-VolumesActionsTest-858798371 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:54:32 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-5d79aef3-7f85-4b36-a5f0-434b8ef6549e tempest-VolumesActionsTest-858798371 None] Deleted volume successfully. Jul 08 01:54:32 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-5d79aef3-7f85-4b36-a5f0-434b8ef6549e tempest-VolumesActionsTest-858798371 None] Lock "cinder-6b2550cd-79fc-4188-9a40-0c1284554a81-delete_volume" released by "delete_volume" :: held 3.100s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:54:34 devstack cinder-volume[87134]: DEBUG cinder.image.image_utils [None req-98f640a9-f38f-43b5-a84e-eefc87614d94 tempest-TestInstancesWithCinderVolumes-108683866 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_03b3e5ea-714a-41cb-a053-c3580bfc3ceb_jjx93qpadevstack@QuobyteHD, size 20.69 MB, duration 4.32 sec {{(pid=87134) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 01:54:34 devstack cinder-volume[87134]: INFO cinder.image.image_utils [None req-98f640a9-f38f-43b5-a84e-eefc87614d94 tempest-TestInstancesWithCinderVolumes-108683866 None] Image download 20.69 MB at 4.79 MB/s Jul 08 01:54:34 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de663b9-ee2e-4acf-a863-8c144f10b8a8]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:54:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-98f640a9-f38f-43b5-a84e-eefc87614d94 tempest-TestInstancesWithCinderVolumes-108683866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_03b3e5ea-714a-41cb-a053-c3580bfc3ceb_jjx93qpadevstack@QuobyteHD {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:54:34 devstack sudo[98931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_03b3e5ea-714a-41cb-a053-c3580bfc3ceb_jjx93qpadevstack@QuobyteHD Jul 08 01:54:34 devstack sudo[98931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:54:35 devstack sudo[98931]: pam_unix(sudo:session): session closed for user root Jul 08 01:54:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-98f640a9-f38f-43b5-a84e-eefc87614d94 tempest-TestInstancesWithCinderVolumes-108683866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_03b3e5ea-714a-41cb-a053-c3580bfc3ceb_jjx93qpadevstack@QuobyteHD" returned: 0 in 0.993s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:54:35 devstack cinder-volume[87134]: DEBUG cinder.image.image_utils [None req-98f640a9-f38f-43b5-a84e-eefc87614d94 tempest-TestInstancesWithCinderVolumes-108683866 None] Temporary image 03b3e5ea-714a-41cb-a053-c3580bfc3ceb is fetched for user ba59983a36c8423687687f711423e875. {{(pid=87134) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 01:54:35 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d31da4e-c138-408f-be5a-167dd6a847f1]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:54:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-98f640a9-f38f-43b5-a84e-eefc87614d94 tempest-TestInstancesWithCinderVolumes-108683866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_03b3e5ea-714a-41cb-a053-c3580bfc3ceb_jjx93qpadevstack@QuobyteHD {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:54:35 devstack sudo[98952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_03b3e5ea-714a-41cb-a053-c3580bfc3ceb_jjx93qpadevstack@QuobyteHD Jul 08 01:54:35 devstack sudo[98952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:54:36 devstack sudo[98952]: pam_unix(sudo:session): session closed for user root Jul 08 01:54:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-98f640a9-f38f-43b5-a84e-eefc87614d94 tempest-TestInstancesWithCinderVolumes-108683866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_03b3e5ea-714a-41cb-a053-c3580bfc3ceb_jjx93qpadevstack@QuobyteHD" returned: 0 in 0.916s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:54:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-98f640a9-f38f-43b5-a84e-eefc87614d94 tempest-TestInstancesWithCinderVolumes-108683866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:54:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-98f640a9-f38f-43b5-a84e-eefc87614d94 tempest-TestInstancesWithCinderVolumes-108683866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:54:36 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-98f640a9-f38f-43b5-a84e-eefc87614d94 tempest-TestInstancesWithCinderVolumes-108683866 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:54:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1861142280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3d4cc6b-a71d-491c-bd63-5198a70aac1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aecf5f067d894ec5abc5c4cc36f3f901',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:54:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:54:29Z,use_quota=True,user_id='ba59983a36c8423687687f711423e875',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac1cd698-abb0-49a7-a0a6-3bab2d3dad9c),volume_type_id=ac1cd698-abb0-49a7-a0a6-3bab2d3dad9c)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:54:36 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-98f640a9-f38f-43b5-a84e-eefc87614d94 tempest-TestInstancesWithCinderVolumes-108683866 None] Creating volume d3d4cc6b-a71d-491c-bd63-5198a70aac1a {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:54:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-98f640a9-f38f-43b5-a84e-eefc87614d94 tempest-TestInstancesWithCinderVolumes-108683866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:54:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-98f640a9-f38f-43b5-a84e-eefc87614d94 tempest-TestInstancesWithCinderVolumes-108683866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:54:36 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-98f640a9-f38f-43b5-a84e-eefc87614d94 tempest-TestInstancesWithCinderVolumes-108683866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:54:36 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-98f640a9-f38f-43b5-a84e-eefc87614d94 tempest-TestInstancesWithCinderVolumes-108683866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:54:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-98f640a9-f38f-43b5-a84e-eefc87614d94 tempest-TestInstancesWithCinderVolumes-108683866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:54:36 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-98f640a9-f38f-43b5-a84e-eefc87614d94 tempest-TestInstancesWithCinderVolumes-108683866 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:54:36 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-98f640a9-f38f-43b5-a84e-eefc87614d94 tempest-TestInstancesWithCinderVolumes-108683866 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:54:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-98f640a9-f38f-43b5-a84e-eefc87614d94 tempest-TestInstancesWithCinderVolumes-108683866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d3d4cc6b-a71d-491c-bd63-5198a70aac1a 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:54:36 devstack sudo[98957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d3d4cc6b-a71d-491c-bd63-5198a70aac1a 1073741824 Jul 08 01:54:36 devstack sudo[98957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:54:37 devstack sudo[98957]: pam_unix(sudo:session): session closed for user root Jul 08 01:54:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-98f640a9-f38f-43b5-a84e-eefc87614d94 tempest-TestInstancesWithCinderVolumes-108683866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d3d4cc6b-a71d-491c-bd63-5198a70aac1a 1073741824" returned: 0 in 1.157s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:54:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-98f640a9-f38f-43b5-a84e-eefc87614d94 tempest-TestInstancesWithCinderVolumes-108683866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d3d4cc6b-a71d-491c-bd63-5198a70aac1a {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:54:37 devstack sudo[98965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d3d4cc6b-a71d-491c-bd63-5198a70aac1a Jul 08 01:54:37 devstack sudo[98965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:54:38 devstack sudo[98965]: pam_unix(sudo:session): session closed for user root Jul 08 01:54:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-98f640a9-f38f-43b5-a84e-eefc87614d94 tempest-TestInstancesWithCinderVolumes-108683866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d3d4cc6b-a71d-491c-bd63-5198a70aac1a" returned: 0 in 0.877s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:54:38 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-98f640a9-f38f-43b5-a84e-eefc87614d94 tempest-TestInstancesWithCinderVolumes-108683866 None] <== create_volume: return (2098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:54:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-98f640a9-f38f-43b5-a84e-eefc87614d94 tempest-TestInstancesWithCinderVolumes-108683866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.103s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:54:38 devstack cinder-volume[87134]: DEBUG cinder.volume.volume_utils [None req-98f640a9-f38f-43b5-a84e-eefc87614d94 tempest-TestInstancesWithCinderVolumes-108683866 None] Attempting download of 03b3e5ea-714a-41cb-a053-c3580bfc3ceb ((None, [{'url': 'file:///opt/stack/data/glance/images/03b3e5ea-714a-41cb-a053-c3580bfc3ceb', 'metadata': {}}])) to volume d3d4cc6b-a71d-491c-bd63-5198a70aac1a. {{(pid=87134) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 01:54:38 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[438c91dc-9ae4-46b4-a466-c6b441ef96e8]: (4, 'raw') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:54:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-98f640a9-f38f-43b5-a84e-eefc87614d94 tempest-TestInstancesWithCinderVolumes-108683866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_03b3e5ea-714a-41cb-a053-c3580bfc3ceb_vpt8nlfx {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:54:38 devstack sudo[98968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_03b3e5ea-714a-41cb-a053-c3580bfc3ceb_vpt8nlfx Jul 08 01:54:38 devstack sudo[98968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:54:39 devstack sudo[98968]: pam_unix(sudo:session): session closed for user root Jul 08 01:54:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-98f640a9-f38f-43b5-a84e-eefc87614d94 tempest-TestInstancesWithCinderVolumes-108683866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_03b3e5ea-714a-41cb-a053-c3580bfc3ceb_vpt8nlfx" returned: 0 in 0.837s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:54:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-98f640a9-f38f-43b5-a84e-eefc87614d94 tempest-TestInstancesWithCinderVolumes-108683866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_03b3e5ea-714a-41cb-a053-c3580bfc3ceb_vpt8nlfx {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:54:39 devstack sudo[98972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_03b3e5ea-714a-41cb-a053-c3580bfc3ceb_vpt8nlfx Jul 08 01:54:39 devstack sudo[98972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:54:40 devstack sudo[98972]: pam_unix(sudo:session): session closed for user root Jul 08 01:54:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-98f640a9-f38f-43b5-a84e-eefc87614d94 tempest-TestInstancesWithCinderVolumes-108683866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_03b3e5ea-714a-41cb-a053-c3580bfc3ceb_vpt8nlfx" returned: 1 in 0.870s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:54:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-98f640a9-f38f-43b5-a84e-eefc87614d94 tempest-TestInstancesWithCinderVolumes-108683866 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_03b3e5ea-714a-41cb-a053-c3580bfc3ceb_vpt8nlfx' failed. Not Retrying. {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:54:40 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[858a23c4-b307-402b-b51b-2fcb606f2463]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:54:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-98f640a9-f38f-43b5-a84e-eefc87614d94 tempest-TestInstancesWithCinderVolumes-108683866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_03b3e5ea-714a-41cb-a053-c3580bfc3ceb_jjx93qpadevstack@QuobyteHD {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:54:40 devstack sudo[98976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_03b3e5ea-714a-41cb-a053-c3580bfc3ceb_jjx93qpadevstack@QuobyteHD Jul 08 01:54:40 devstack sudo[98976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:54:40 devstack sudo[98976]: pam_unix(sudo:session): session closed for user root Jul 08 01:54:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-98f640a9-f38f-43b5-a84e-eefc87614d94 tempest-TestInstancesWithCinderVolumes-108683866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_03b3e5ea-714a-41cb-a053-c3580bfc3ceb_jjx93qpadevstack@QuobyteHD" returned: 0 in 0.880s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:54:40 devstack cinder-volume[87134]: DEBUG cinder.image.image_utils [None req-98f640a9-f38f-43b5-a84e-eefc87614d94 tempest-TestInstancesWithCinderVolumes-108683866 None] 03b3e5ea-714a-41cb-a053-c3580bfc3ceb was qcow2, converting to raw {{(pid=87134) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 01:54:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-98f640a9-f38f-43b5-a84e-eefc87614d94 tempest-TestInstancesWithCinderVolumes-108683866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_03b3e5ea-714a-41cb-a053-c3580bfc3ceb_jjx93qpadevstack@QuobyteHD /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d3d4cc6b-a71d-491c-bd63-5198a70aac1a {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:54:41 devstack sudo[98981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_03b3e5ea-714a-41cb-a053-c3580bfc3ceb_jjx93qpadevstack@QuobyteHD /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d3d4cc6b-a71d-491c-bd63-5198a70aac1a Jul 08 01:54:41 devstack sudo[98981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:54:41 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-9590a047-d08d-4e56-8746-b6306b6f1c73 tempest-VolumesActionsTest-858798371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:54:41 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-9590a047-d08d-4e56-8746-b6306b6f1c73 tempest-VolumesActionsTest-858798371 None] Flow 'volume_create_manager' (2ecba25e-1d3f-4fce-aeff-4c102baebe28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:54:41 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-9590a047-d08d-4e56-8746-b6306b6f1c73 tempest-VolumesActionsTest-858798371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9757fabe-c376-4f7e-9bc1-7be7567e5e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:54:41 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-9590a047-d08d-4e56-8746-b6306b6f1c73 tempest-VolumesActionsTest-858798371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9757fabe-c376-4f7e-9bc1-7be7567e5e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:54:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-557441005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50d75a3f-465a-4011-92fe-fe68b397f6f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2e418254e5b4204ac6e2d6dafbf6acc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:54:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:54:41Z,use_quota=True,user_id='8bf983e2216d48eea401f66f8848a17b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:54:41 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-9590a047-d08d-4e56-8746-b6306b6f1c73 tempest-VolumesActionsTest-858798371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d720bc2-02b0-4552-90a8-68a9f2ce54e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:54:41 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-9590a047-d08d-4e56-8746-b6306b6f1c73 tempest-VolumesActionsTest-858798371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d720bc2-02b0-4552-90a8-68a9f2ce54e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:54:41 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-9590a047-d08d-4e56-8746-b6306b6f1c73 tempest-VolumesActionsTest-858798371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1964671-0c06-4202-bc16-86d552cb9f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:54:41 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-9590a047-d08d-4e56-8746-b6306b6f1c73 tempest-VolumesActionsTest-858798371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1964671-0c06-4202-bc16-86d552cb9f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50d75a3f-465a-4011-92fe-fe68b397f6f8', 'volume_name': 'volume-50d75a3f-465a-4011-92fe-fe68b397f6f8', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:54:41 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-9590a047-d08d-4e56-8746-b6306b6f1c73 tempest-VolumesActionsTest-858798371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9e6835b-f98e-46e9-b378-625c334e877a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:54:41 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-9590a047-d08d-4e56-8746-b6306b6f1c73 tempest-VolumesActionsTest-858798371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9e6835b-f98e-46e9-b378-625c334e877a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:54:41 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-9590a047-d08d-4e56-8746-b6306b6f1c73 tempest-VolumesActionsTest-858798371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa9ec975-9454-4bea-97d3-a04e3900e68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:54:41 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-9590a047-d08d-4e56-8746-b6306b6f1c73 tempest-VolumesActionsTest-858798371 None] Volume 50d75a3f-465a-4011-92fe-fe68b397f6f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50d75a3f-465a-4011-92fe-fe68b397f6f8', 'volume_size': 1} Jul 08 01:54:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-9590a047-d08d-4e56-8746-b6306b6f1c73 tempest-VolumesActionsTest-858798371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:54:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-9590a047-d08d-4e56-8746-b6306b6f1c73 tempest-VolumesActionsTest-858798371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:54:41 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-9590a047-d08d-4e56-8746-b6306b6f1c73 tempest-VolumesActionsTest-858798371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:54:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-557441005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50d75a3f-465a-4011-92fe-fe68b397f6f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2e418254e5b4204ac6e2d6dafbf6acc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:54:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:54:41Z,use_quota=True,user_id='8bf983e2216d48eea401f66f8848a17b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:54:41 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-9590a047-d08d-4e56-8746-b6306b6f1c73 tempest-VolumesActionsTest-858798371 None] Creating volume 50d75a3f-465a-4011-92fe-fe68b397f6f8 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:54:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-9590a047-d08d-4e56-8746-b6306b6f1c73 tempest-VolumesActionsTest-858798371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:54:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-9590a047-d08d-4e56-8746-b6306b6f1c73 tempest-VolumesActionsTest-858798371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:54:41 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-9590a047-d08d-4e56-8746-b6306b6f1c73 tempest-VolumesActionsTest-858798371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:54:41 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-9590a047-d08d-4e56-8746-b6306b6f1c73 tempest-VolumesActionsTest-858798371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:54:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-9590a047-d08d-4e56-8746-b6306b6f1c73 tempest-VolumesActionsTest-858798371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:54:41 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-9590a047-d08d-4e56-8746-b6306b6f1c73 tempest-VolumesActionsTest-858798371 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:54:41 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-9590a047-d08d-4e56-8746-b6306b6f1c73 tempest-VolumesActionsTest-858798371 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:54:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9590a047-d08d-4e56-8746-b6306b6f1c73 tempest-VolumesActionsTest-858798371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-50d75a3f-465a-4011-92fe-fe68b397f6f8 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:54:41 devstack sudo[98983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-50d75a3f-465a-4011-92fe-fe68b397f6f8 1073741824 Jul 08 01:54:41 devstack sudo[98983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:54:42 devstack sudo[98983]: pam_unix(sudo:session): session closed for user root Jul 08 01:54:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9590a047-d08d-4e56-8746-b6306b6f1c73 tempest-VolumesActionsTest-858798371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-50d75a3f-465a-4011-92fe-fe68b397f6f8 1073741824" returned: 0 in 1.097s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:54:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9590a047-d08d-4e56-8746-b6306b6f1c73 tempest-VolumesActionsTest-858798371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-50d75a3f-465a-4011-92fe-fe68b397f6f8 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:54:42 devstack sudo[98998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-50d75a3f-465a-4011-92fe-fe68b397f6f8 Jul 08 01:54:42 devstack sudo[98998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:54:43 devstack sudo[98998]: pam_unix(sudo:session): session closed for user root Jul 08 01:54:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9590a047-d08d-4e56-8746-b6306b6f1c73 tempest-VolumesActionsTest-858798371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-50d75a3f-465a-4011-92fe-fe68b397f6f8" returned: 0 in 0.956s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:54:43 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-9590a047-d08d-4e56-8746-b6306b6f1c73 tempest-VolumesActionsTest-858798371 None] <== create_volume: return (2105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:54:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-9590a047-d08d-4e56-8746-b6306b6f1c73 tempest-VolumesActionsTest-858798371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.109s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:54:43 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-9590a047-d08d-4e56-8746-b6306b6f1c73 tempest-VolumesActionsTest-858798371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa9ec975-9454-4bea-97d3-a04e3900e68f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50d75a3f-465a-4011-92fe-fe68b397f6f8', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:54:43 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-9590a047-d08d-4e56-8746-b6306b6f1c73 tempest-VolumesActionsTest-858798371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc812b7f-f12f-4970-b0ba-193dd093c98d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:54:43 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-9590a047-d08d-4e56-8746-b6306b6f1c73 tempest-VolumesActionsTest-858798371 None] Volume volume-50d75a3f-465a-4011-92fe-fe68b397f6f8 (50d75a3f-465a-4011-92fe-fe68b397f6f8): created successfully Jul 08 01:54:43 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-9590a047-d08d-4e56-8746-b6306b6f1c73 tempest-VolumesActionsTest-858798371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc812b7f-f12f-4970-b0ba-193dd093c98d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:54:43 devstack sudo[98981]: pam_unix(sudo:session): session closed for user root Jul 08 01:54:43 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-9590a047-d08d-4e56-8746-b6306b6f1c73 tempest-VolumesActionsTest-858798371 None] Flow 'volume_create_manager' (2ecba25e-1d3f-4fce-aeff-4c102baebe28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:54:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-98f640a9-f38f-43b5-a84e-eefc87614d94 tempest-TestInstancesWithCinderVolumes-108683866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_03b3e5ea-714a-41cb-a053-c3580bfc3ceb_jjx93qpadevstack@QuobyteHD /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d3d4cc6b-a71d-491c-bd63-5198a70aac1a" returned: 0 in 2.418s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:54:43 devstack cinder-volume[87134]: DEBUG cinder.image.image_utils [None req-98f640a9-f38f-43b5-a84e-eefc87614d94 tempest-TestInstancesWithCinderVolumes-108683866 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_03b3e5ea-714a-41cb-a053-c3580bfc3ceb_jjx93qpadevstack@QuobyteHD, size 112.00 MB, duration 2.42 sec, destination /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d3d4cc6b-a71d-491c-bd63-5198a70aac1a {{(pid=87134) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:54:43 devstack cinder-volume[87134]: INFO cinder.image.image_utils [None req-98f640a9-f38f-43b5-a84e-eefc87614d94 tempest-TestInstancesWithCinderVolumes-108683866 None] Converted 112.00 MB image at 46.28 MB/s Jul 08 01:54:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-98f640a9-f38f-43b5-a84e-eefc87614d94 tempest-TestInstancesWithCinderVolumes-108683866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d3d4cc6b-a71d-491c-bd63-5198a70aac1a 1G {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:54:43 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-9590a047-d08d-4e56-8746-b6306b6f1c73 tempest-VolumesActionsTest-858798371 None] Created volume successfully. Jul 08 01:54:43 devstack sudo[99002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d3d4cc6b-a71d-491c-bd63-5198a70aac1a 1G Jul 08 01:54:43 devstack sudo[99002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:54:44 devstack sudo[99002]: pam_unix(sudo:session): session closed for user root Jul 08 01:54:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-98f640a9-f38f-43b5-a84e-eefc87614d94 tempest-TestInstancesWithCinderVolumes-108683866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d3d4cc6b-a71d-491c-bd63-5198a70aac1a 1G" returned: 0 in 0.917s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:54:44 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[e30c302b-b351-46cb-8b35-0adcc4de7f4d]: (4, 'raw') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:54:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-98f640a9-f38f-43b5-a84e-eefc87614d94 tempest-TestInstancesWithCinderVolumes-108683866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d3d4cc6b-a71d-491c-bd63-5198a70aac1a {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:54:44 devstack sudo[99007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d3d4cc6b-a71d-491c-bd63-5198a70aac1a Jul 08 01:54:44 devstack sudo[99007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:54:44 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-1bb6a7d9-ffa9-48f6-9323-cad62b8342dd tempest-VolumesActionsTest-75141281 None] Acquiring lock "cinder-50d75a3f-465a-4011-92fe-fe68b397f6f8-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:54:44 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-1bb6a7d9-ffa9-48f6-9323-cad62b8342dd tempest-VolumesActionsTest-75141281 None] Lock "cinder-50d75a3f-465a-4011-92fe-fe68b397f6f8-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:54:44 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-1bb6a7d9-ffa9-48f6-9323-cad62b8342dd tempest-VolumesActionsTest-75141281 None] Acquiring lock "cinder-quobyte-50d75a3f-465a-4011-92fe-fe68b397f6f8" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:54:44 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-1bb6a7d9-ffa9-48f6-9323-cad62b8342dd tempest-VolumesActionsTest-75141281 None] Lock "cinder-quobyte-50d75a3f-465a-4011-92fe-fe68b397f6f8" acquired by "delete_volume" :: waited 0.017s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:54:44 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1b1305-332b-41ae-889d-33c586c74b50]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:54:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1bb6a7d9-ffa9-48f6-9323-cad62b8342dd tempest-VolumesActionsTest-75141281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-50d75a3f-465a-4011-92fe-fe68b397f6f8 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:54:44 devstack sudo[99009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-50d75a3f-465a-4011-92fe-fe68b397f6f8 Jul 08 01:54:44 devstack sudo[99009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:54:45 devstack sudo[99007]: pam_unix(sudo:session): session closed for user root Jul 08 01:54:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-98f640a9-f38f-43b5-a84e-eefc87614d94 tempest-TestInstancesWithCinderVolumes-108683866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d3d4cc6b-a71d-491c-bd63-5198a70aac1a" returned: 0 in 1.141s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:54:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-98f640a9-f38f-43b5-a84e-eefc87614d94 tempest-TestInstancesWithCinderVolumes-108683866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d3d4cc6b-a71d-491c-bd63-5198a70aac1a {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:54:45 devstack sudo[99013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d3d4cc6b-a71d-491c-bd63-5198a70aac1a Jul 08 01:54:45 devstack sudo[99013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:54:45 devstack sudo[99009]: pam_unix(sudo:session): session closed for user root Jul 08 01:54:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1bb6a7d9-ffa9-48f6-9323-cad62b8342dd tempest-VolumesActionsTest-75141281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-50d75a3f-465a-4011-92fe-fe68b397f6f8" returned: 0 in 1.152s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:54:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1bb6a7d9-ffa9-48f6-9323-cad62b8342dd tempest-VolumesActionsTest-75141281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-50d75a3f-465a-4011-92fe-fe68b397f6f8 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:54:45 devstack sudo[99018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-50d75a3f-465a-4011-92fe-fe68b397f6f8 Jul 08 01:54:45 devstack sudo[99018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:54:46 devstack sudo[99013]: pam_unix(sudo:session): session closed for user root Jul 08 01:54:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-98f640a9-f38f-43b5-a84e-eefc87614d94 tempest-TestInstancesWithCinderVolumes-108683866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d3d4cc6b-a71d-491c-bd63-5198a70aac1a" returned: 1 in 0.943s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:54:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-98f640a9-f38f-43b5-a84e-eefc87614d94 tempest-TestInstancesWithCinderVolumes-108683866 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d3d4cc6b-a71d-491c-bd63-5198a70aac1a' failed. Not Retrying. {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:54:46 devstack cinder-volume[87134]: DEBUG cinder.volume.volume_utils [None req-98f640a9-f38f-43b5-a84e-eefc87614d94 tempest-TestInstancesWithCinderVolumes-108683866 None] Downloaded image 03b3e5ea-714a-41cb-a053-c3580bfc3ceb ((None, [{'url': 'file:///opt/stack/data/glance/images/03b3e5ea-714a-41cb-a053-c3580bfc3ceb', 'metadata': {}}])) to volume d3d4cc6b-a71d-491c-bd63-5198a70aac1a successfully. {{(pid=87134) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 01:54:46 devstack cinder-volume[87134]: DEBUG cinder.image.image_utils [None req-98f640a9-f38f-43b5-a84e-eefc87614d94 tempest-TestInstancesWithCinderVolumes-108683866 None] Temporary image 03b3e5ea-714a-41cb-a053-c3580bfc3ceb for user ba59983a36c8423687687f711423e875 is deleted. {{(pid=87134) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 01:54:46 devstack cinder-volume[87134]: DEBUG cinder.volume.volume_utils [None req-98f640a9-f38f-43b5-a84e-eefc87614d94 tempest-TestInstancesWithCinderVolumes-108683866 None] Marking volume d3d4cc6b-a71d-491c-bd63-5198a70aac1a as bootable. {{(pid=87134) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 01:54:46 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-98f640a9-f38f-43b5-a84e-eefc87614d94 tempest-TestInstancesWithCinderVolumes-108683866 None] Copying metadata from image 03b3e5ea-714a-41cb-a053-c3580bfc3ceb to d3d4cc6b-a71d-491c-bd63-5198a70aac1a. {{(pid=87134) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 01:54:46 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-98f640a9-f38f-43b5-a84e-eefc87614d94 tempest-TestInstancesWithCinderVolumes-108683866 None] Creating volume glance metadata for volume d3d4cc6b-a71d-491c-bd63-5198a70aac1a backed by image 03b3e5ea-714a-41cb-a053-c3580bfc3ceb with: {'image_id': '03b3e5ea-714a-41cb-a053-c3580bfc3ceb', 'image_name': 'tempest-scenario-img--1255768464', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87134) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 01:54:46 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-98f640a9-f38f-43b5-a84e-eefc87614d94 tempest-TestInstancesWithCinderVolumes-108683866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7411f80b-7513-47d5-ba33-dc01b0a53dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3d4cc6b-a71d-491c-bd63-5198a70aac1a', 'volume_size': 1, 'image_id': '03b3e5ea-714a-41cb-a053-c3580bfc3ceb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/03b3e5ea-714a-41cb-a053-c3580bfc3ceb', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1255768464', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'aecf5f067d894ec5abc5c4cc36f3f901', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '03b3e5ea-714a-41cb-a053-c3580bfc3ceb', 'created_at': datetime.datetime(2026, 7, 7, 23, 54, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 54, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/03b3e5ea-714a-41cb-a053-c3580bfc3ceb/file', 'properties': {}}, 'image_service': }' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:54:46 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-98f640a9-f38f-43b5-a84e-eefc87614d94 tempest-TestInstancesWithCinderVolumes-108683866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b961572-d91e-4b64-b27d-956de1445cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:54:46 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-98f640a9-f38f-43b5-a84e-eefc87614d94 tempest-TestInstancesWithCinderVolumes-108683866 None] Volume volume-d3d4cc6b-a71d-491c-bd63-5198a70aac1a (d3d4cc6b-a71d-491c-bd63-5198a70aac1a): created successfully Jul 08 01:54:46 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-98f640a9-f38f-43b5-a84e-eefc87614d94 tempest-TestInstancesWithCinderVolumes-108683866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b961572-d91e-4b64-b27d-956de1445cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:54:46 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-98f640a9-f38f-43b5-a84e-eefc87614d94 tempest-TestInstancesWithCinderVolumes-108683866 None] Flow 'volume_create_manager' (47636984-5f00-4d39-a1ea-9dc2a0819e22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:54:46 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-98f640a9-f38f-43b5-a84e-eefc87614d94 tempest-TestInstancesWithCinderVolumes-108683866 None] Created volume successfully. Jul 08 01:54:46 devstack sudo[99018]: pam_unix(sudo:session): session closed for user root Jul 08 01:54:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1bb6a7d9-ffa9-48f6-9323-cad62b8342dd tempest-VolumesActionsTest-75141281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-50d75a3f-465a-4011-92fe-fe68b397f6f8" returned: 0 in 0.862s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:54:46 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-1bb6a7d9-ffa9-48f6-9323-cad62b8342dd tempest-VolumesActionsTest-75141281 None] Lock "cinder-quobyte-50d75a3f-465a-4011-92fe-fe68b397f6f8" released by "delete_volume" :: held 2.060s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:54:46 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-1bb6a7d9-ffa9-48f6-9323-cad62b8342dd tempest-VolumesActionsTest-75141281 None] Created reservations ['1653f041-addc-43df-96b7-e95ba2383aa0', 'e56cf55d-278b-409e-8b71-b62557575d25', 'cde08b3d-906e-419e-9e0f-a750d6cd0a38', '005940ec-662d-44ee-b9a4-e195f92e2125'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:54:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-1bb6a7d9-ffa9-48f6-9323-cad62b8342dd tempest-VolumesActionsTest-75141281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:54:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-1bb6a7d9-ffa9-48f6-9323-cad62b8342dd tempest-VolumesActionsTest-75141281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:54:46 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-1bb6a7d9-ffa9-48f6-9323-cad62b8342dd tempest-VolumesActionsTest-75141281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:54:46 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-1bb6a7d9-ffa9-48f6-9323-cad62b8342dd tempest-VolumesActionsTest-75141281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:54:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-1bb6a7d9-ffa9-48f6-9323-cad62b8342dd tempest-VolumesActionsTest-75141281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:54:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1bb6a7d9-ffa9-48f6-9323-cad62b8342dd tempest-VolumesActionsTest-75141281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:54:47 devstack sudo[99024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:54:47 devstack sudo[99024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:54:47 devstack sudo[99024]: pam_unix(sudo:session): session closed for user root Jul 08 01:54:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1bb6a7d9-ffa9-48f6-9323-cad62b8342dd tempest-VolumesActionsTest-75141281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.831s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:54:47 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-1bb6a7d9-ffa9-48f6-9323-cad62b8342dd tempest-VolumesActionsTest-75141281 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:54:47 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-1bb6a7d9-ffa9-48f6-9323-cad62b8342dd tempest-VolumesActionsTest-75141281 None] Deleted volume successfully. Jul 08 01:54:47 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-1bb6a7d9-ffa9-48f6-9323-cad62b8342dd tempest-VolumesActionsTest-75141281 None] Lock "cinder-50d75a3f-465a-4011-92fe-fe68b397f6f8-delete_volume" released by "delete_volume" :: held 3.179s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:54:48 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-9245582d-8bf4-4423-9766-db8607ba4cf0 tempest-VolumesActionsTest-858798371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:54:48 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-9245582d-8bf4-4423-9766-db8607ba4cf0 tempest-VolumesActionsTest-858798371 None] Flow 'volume_create_manager' (aa7fa8f6-ad69-45d8-a78b-9c8bbc88b06a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:54:48 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-9245582d-8bf4-4423-9766-db8607ba4cf0 tempest-VolumesActionsTest-858798371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79ee3674-bd2f-44f4-b598-921c18141381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:54:48 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-9245582d-8bf4-4423-9766-db8607ba4cf0 tempest-VolumesActionsTest-858798371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79ee3674-bd2f-44f4-b598-921c18141381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:54:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-393512694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54a9cbea-a843-47da-b301-c392b68c0417,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2e418254e5b4204ac6e2d6dafbf6acc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:54:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:54:49Z,use_quota=True,user_id='8bf983e2216d48eea401f66f8848a17b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:54:48 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-9245582d-8bf4-4423-9766-db8607ba4cf0 tempest-VolumesActionsTest-858798371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf9fe345-c56a-4951-8743-269e0aab68d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:54:48 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-9245582d-8bf4-4423-9766-db8607ba4cf0 tempest-VolumesActionsTest-858798371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf9fe345-c56a-4951-8743-269e0aab68d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:54:48 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-9245582d-8bf4-4423-9766-db8607ba4cf0 tempest-VolumesActionsTest-858798371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c20b9190-bd9c-4965-806f-184fbe8e874f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:54:48 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-9245582d-8bf4-4423-9766-db8607ba4cf0 tempest-VolumesActionsTest-858798371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c20b9190-bd9c-4965-806f-184fbe8e874f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54a9cbea-a843-47da-b301-c392b68c0417', 'volume_name': 'volume-54a9cbea-a843-47da-b301-c392b68c0417', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:54:48 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-9245582d-8bf4-4423-9766-db8607ba4cf0 tempest-VolumesActionsTest-858798371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94bda4f5-c303-4e17-a302-b818f257858a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:54:48 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-9245582d-8bf4-4423-9766-db8607ba4cf0 tempest-VolumesActionsTest-858798371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94bda4f5-c303-4e17-a302-b818f257858a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:54:48 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-9245582d-8bf4-4423-9766-db8607ba4cf0 tempest-VolumesActionsTest-858798371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b85f3a1-b252-405f-8f92-a6b669855019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:54:48 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-9245582d-8bf4-4423-9766-db8607ba4cf0 tempest-VolumesActionsTest-858798371 None] Volume 54a9cbea-a843-47da-b301-c392b68c0417: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54a9cbea-a843-47da-b301-c392b68c0417', 'volume_size': 1} Jul 08 01:54:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-9245582d-8bf4-4423-9766-db8607ba4cf0 tempest-VolumesActionsTest-858798371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:54:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-9245582d-8bf4-4423-9766-db8607ba4cf0 tempest-VolumesActionsTest-858798371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:54:48 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-9245582d-8bf4-4423-9766-db8607ba4cf0 tempest-VolumesActionsTest-858798371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:54:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-393512694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54a9cbea-a843-47da-b301-c392b68c0417,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2e418254e5b4204ac6e2d6dafbf6acc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:54:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:54:49Z,use_quota=True,user_id='8bf983e2216d48eea401f66f8848a17b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:54:48 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-9245582d-8bf4-4423-9766-db8607ba4cf0 tempest-VolumesActionsTest-858798371 None] Creating volume 54a9cbea-a843-47da-b301-c392b68c0417 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:54:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-9245582d-8bf4-4423-9766-db8607ba4cf0 tempest-VolumesActionsTest-858798371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:54:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-9245582d-8bf4-4423-9766-db8607ba4cf0 tempest-VolumesActionsTest-858798371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:54:48 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-9245582d-8bf4-4423-9766-db8607ba4cf0 tempest-VolumesActionsTest-858798371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:54:48 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-9245582d-8bf4-4423-9766-db8607ba4cf0 tempest-VolumesActionsTest-858798371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:54:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-9245582d-8bf4-4423-9766-db8607ba4cf0 tempest-VolumesActionsTest-858798371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:54:48 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-9245582d-8bf4-4423-9766-db8607ba4cf0 tempest-VolumesActionsTest-858798371 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:54:48 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-9245582d-8bf4-4423-9766-db8607ba4cf0 tempest-VolumesActionsTest-858798371 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:54:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9245582d-8bf4-4423-9766-db8607ba4cf0 tempest-VolumesActionsTest-858798371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-54a9cbea-a843-47da-b301-c392b68c0417 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:54:48 devstack sudo[99027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-54a9cbea-a843-47da-b301-c392b68c0417 1073741824 Jul 08 01:54:48 devstack sudo[99027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:54:49 devstack sudo[99027]: pam_unix(sudo:session): session closed for user root Jul 08 01:54:49 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9245582d-8bf4-4423-9766-db8607ba4cf0 tempest-VolumesActionsTest-858798371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-54a9cbea-a843-47da-b301-c392b68c0417 1073741824" returned: 0 in 1.135s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:54:49 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9245582d-8bf4-4423-9766-db8607ba4cf0 tempest-VolumesActionsTest-858798371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-54a9cbea-a843-47da-b301-c392b68c0417 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:54:49 devstack sudo[99036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-54a9cbea-a843-47da-b301-c392b68c0417 Jul 08 01:54:49 devstack sudo[99036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:54:50 devstack sudo[99036]: pam_unix(sudo:session): session closed for user root Jul 08 01:54:50 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9245582d-8bf4-4423-9766-db8607ba4cf0 tempest-VolumesActionsTest-858798371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-54a9cbea-a843-47da-b301-c392b68c0417" returned: 0 in 0.815s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:54:50 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-9245582d-8bf4-4423-9766-db8607ba4cf0 tempest-VolumesActionsTest-858798371 None] <== create_volume: return (2007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:54:50 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-9245582d-8bf4-4423-9766-db8607ba4cf0 tempest-VolumesActionsTest-858798371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.010s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:54:50 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-9245582d-8bf4-4423-9766-db8607ba4cf0 tempest-VolumesActionsTest-858798371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b85f3a1-b252-405f-8f92-a6b669855019) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54a9cbea-a843-47da-b301-c392b68c0417', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:54:50 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-9245582d-8bf4-4423-9766-db8607ba4cf0 tempest-VolumesActionsTest-858798371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b06997b9-8ab3-4cb5-8308-e2c8265ca884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:54:50 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-9245582d-8bf4-4423-9766-db8607ba4cf0 tempest-VolumesActionsTest-858798371 None] Volume volume-54a9cbea-a843-47da-b301-c392b68c0417 (54a9cbea-a843-47da-b301-c392b68c0417): created successfully Jul 08 01:54:50 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-9245582d-8bf4-4423-9766-db8607ba4cf0 tempest-VolumesActionsTest-858798371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b06997b9-8ab3-4cb5-8308-e2c8265ca884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:54:50 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-9245582d-8bf4-4423-9766-db8607ba4cf0 tempest-VolumesActionsTest-858798371 None] Flow 'volume_create_manager' (aa7fa8f6-ad69-45d8-a78b-9c8bbc88b06a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:54:50 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-9245582d-8bf4-4423-9766-db8607ba4cf0 tempest-VolumesActionsTest-858798371 None] Created volume successfully. Jul 08 01:54:52 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a4037071-43f0-4c82-8a83-599098247352 tempest-VolumesActionsTest-75141281 None] Acquiring lock "cinder-54a9cbea-a843-47da-b301-c392b68c0417-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:54:52 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a4037071-43f0-4c82-8a83-599098247352 tempest-VolumesActionsTest-75141281 None] Lock "cinder-54a9cbea-a843-47da-b301-c392b68c0417-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:54:52 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a4037071-43f0-4c82-8a83-599098247352 tempest-VolumesActionsTest-75141281 None] Acquiring lock "cinder-quobyte-54a9cbea-a843-47da-b301-c392b68c0417" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:54:52 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a4037071-43f0-4c82-8a83-599098247352 tempest-VolumesActionsTest-75141281 None] Lock "cinder-quobyte-54a9cbea-a843-47da-b301-c392b68c0417" acquired by "delete_volume" :: waited 0.017s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:54:52 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6d19de-9182-480f-abc8-c47aaae1b466]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:54:52 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a4037071-43f0-4c82-8a83-599098247352 tempest-VolumesActionsTest-75141281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-54a9cbea-a843-47da-b301-c392b68c0417 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:54:52 devstack sudo[99039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-54a9cbea-a843-47da-b301-c392b68c0417 Jul 08 01:54:52 devstack sudo[99039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:54:53 devstack sudo[99039]: pam_unix(sudo:session): session closed for user root Jul 08 01:54:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a4037071-43f0-4c82-8a83-599098247352 tempest-VolumesActionsTest-75141281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-54a9cbea-a843-47da-b301-c392b68c0417" returned: 0 in 0.920s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:54:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a4037071-43f0-4c82-8a83-599098247352 tempest-VolumesActionsTest-75141281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-54a9cbea-a843-47da-b301-c392b68c0417 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:54:53 devstack sudo[99046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-54a9cbea-a843-47da-b301-c392b68c0417 Jul 08 01:54:53 devstack sudo[99046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:54:53 devstack sudo[99046]: pam_unix(sudo:session): session closed for user root Jul 08 01:54:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a4037071-43f0-4c82-8a83-599098247352 tempest-VolumesActionsTest-75141281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-54a9cbea-a843-47da-b301-c392b68c0417" returned: 0 in 0.850s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:54:53 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a4037071-43f0-4c82-8a83-599098247352 tempest-VolumesActionsTest-75141281 None] Lock "cinder-quobyte-54a9cbea-a843-47da-b301-c392b68c0417" released by "delete_volume" :: held 1.839s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:54:54 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-a4037071-43f0-4c82-8a83-599098247352 tempest-VolumesActionsTest-75141281 None] Created reservations ['45845466-9bee-4810-ac23-71f7950386c8', '45b2177b-054a-419e-a10f-5a0ceab2d4d7', 'd779f0a6-c318-4a94-ad14-e9d7b5761158', '6467816a-6995-4bea-a826-26a363a89611'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:54:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-a4037071-43f0-4c82-8a83-599098247352 tempest-VolumesActionsTest-75141281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:54:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-a4037071-43f0-4c82-8a83-599098247352 tempest-VolumesActionsTest-75141281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:54:54 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-a4037071-43f0-4c82-8a83-599098247352 tempest-VolumesActionsTest-75141281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:54:54 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-a4037071-43f0-4c82-8a83-599098247352 tempest-VolumesActionsTest-75141281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:54:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-a4037071-43f0-4c82-8a83-599098247352 tempest-VolumesActionsTest-75141281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:54:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a4037071-43f0-4c82-8a83-599098247352 tempest-VolumesActionsTest-75141281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:54:54 devstack sudo[99049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:54:54 devstack sudo[99049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:54:55 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f28e09b-d173-45db-bf57-d73d53151e7f tempest-TestStampPattern-656958745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:54:55 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-4f28e09b-d173-45db-bf57-d73d53151e7f tempest-TestStampPattern-656958745 None] Flow 'volume_create_manager' (b6bf1f4b-edbf-497d-8c94-11143cddc08c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:54:55 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-4f28e09b-d173-45db-bf57-d73d53151e7f tempest-TestStampPattern-656958745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f06e83e8-b5f9-4b9d-9609-ed39244c7740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:54:55 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-4f28e09b-d173-45db-bf57-d73d53151e7f tempest-TestStampPattern-656958745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f06e83e8-b5f9-4b9d-9609-ed39244c7740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:54:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-748076675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=773e60c8-acd6-407d-afee-1c1a06403187,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f133791143d54463b40a9a562f66f287',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:54:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:54:55Z,use_quota=True,user_id='ecb69198235a4f3db8d70918e137e57a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:54:55 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-4f28e09b-d173-45db-bf57-d73d53151e7f tempest-TestStampPattern-656958745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (398c07c2-ed72-452c-9810-76edbb456214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:54:55 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-4f28e09b-d173-45db-bf57-d73d53151e7f tempest-TestStampPattern-656958745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (398c07c2-ed72-452c-9810-76edbb456214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:54:55 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-4f28e09b-d173-45db-bf57-d73d53151e7f tempest-TestStampPattern-656958745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e737965d-fa6d-42f4-8ab7-9f36caf7c690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:54:55 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-4f28e09b-d173-45db-bf57-d73d53151e7f tempest-TestStampPattern-656958745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e737965d-fa6d-42f4-8ab7-9f36caf7c690) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '773e60c8-acd6-407d-afee-1c1a06403187', 'volume_name': 'volume-773e60c8-acd6-407d-afee-1c1a06403187', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:54:55 devstack sudo[99049]: pam_unix(sudo:session): session closed for user root Jul 08 01:54:55 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-4f28e09b-d173-45db-bf57-d73d53151e7f tempest-TestStampPattern-656958745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3cd4b87-6908-47f2-a680-1ee24a02fdc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:54:55 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-4f28e09b-d173-45db-bf57-d73d53151e7f tempest-TestStampPattern-656958745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3cd4b87-6908-47f2-a680-1ee24a02fdc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:54:55 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-4f28e09b-d173-45db-bf57-d73d53151e7f tempest-TestStampPattern-656958745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8481c7a3-0722-4dcd-938e-ebca12d76107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:54:55 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-4f28e09b-d173-45db-bf57-d73d53151e7f tempest-TestStampPattern-656958745 None] Volume 773e60c8-acd6-407d-afee-1c1a06403187: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-773e60c8-acd6-407d-afee-1c1a06403187', 'volume_size': 1} Jul 08 01:54:55 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-4f28e09b-d173-45db-bf57-d73d53151e7f tempest-TestStampPattern-656958745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:54:55 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-4f28e09b-d173-45db-bf57-d73d53151e7f tempest-TestStampPattern-656958745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:54:55 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-4f28e09b-d173-45db-bf57-d73d53151e7f tempest-TestStampPattern-656958745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:54:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-748076675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=773e60c8-acd6-407d-afee-1c1a06403187,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f133791143d54463b40a9a562f66f287',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:54:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:54:55Z,use_quota=True,user_id='ecb69198235a4f3db8d70918e137e57a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:54:55 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-4f28e09b-d173-45db-bf57-d73d53151e7f tempest-TestStampPattern-656958745 None] Creating volume 773e60c8-acd6-407d-afee-1c1a06403187 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:54:55 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-4f28e09b-d173-45db-bf57-d73d53151e7f tempest-TestStampPattern-656958745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:54:55 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-4f28e09b-d173-45db-bf57-d73d53151e7f tempest-TestStampPattern-656958745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:54:55 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-4f28e09b-d173-45db-bf57-d73d53151e7f tempest-TestStampPattern-656958745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:54:55 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-4f28e09b-d173-45db-bf57-d73d53151e7f tempest-TestStampPattern-656958745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:54:55 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-4f28e09b-d173-45db-bf57-d73d53151e7f tempest-TestStampPattern-656958745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:54:55 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-4f28e09b-d173-45db-bf57-d73d53151e7f tempest-TestStampPattern-656958745 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:54:55 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-4f28e09b-d173-45db-bf57-d73d53151e7f tempest-TestStampPattern-656958745 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:54:55 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4f28e09b-d173-45db-bf57-d73d53151e7f tempest-TestStampPattern-656958745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-773e60c8-acd6-407d-afee-1c1a06403187 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:54:55 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a4037071-43f0-4c82-8a83-599098247352 tempest-VolumesActionsTest-75141281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 1.209s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:54:55 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-a4037071-43f0-4c82-8a83-599098247352 tempest-VolumesActionsTest-75141281 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:54:55 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-a4037071-43f0-4c82-8a83-599098247352 tempest-VolumesActionsTest-75141281 None] Deleted volume successfully. Jul 08 01:54:55 devstack sudo[99052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-773e60c8-acd6-407d-afee-1c1a06403187 1073741824 Jul 08 01:54:55 devstack sudo[99052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:54:55 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-319f16c2-6037-45ce-9b8e-7562a6ef97bc tempest-VolumesActionsTest-858798371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:54:55 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-319f16c2-6037-45ce-9b8e-7562a6ef97bc tempest-VolumesActionsTest-858798371 None] Flow 'volume_create_manager' (e12b2eb0-260d-40b4-96c0-bf7e3ee0c58a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:54:55 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-319f16c2-6037-45ce-9b8e-7562a6ef97bc tempest-VolumesActionsTest-858798371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c24c361-fe79-42f2-9d12-c3cc5fb5678d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:54:55 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a4037071-43f0-4c82-8a83-599098247352 tempest-VolumesActionsTest-75141281 None] Lock "cinder-54a9cbea-a843-47da-b301-c392b68c0417-delete_volume" released by "delete_volume" :: held 3.457s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:54:55 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-319f16c2-6037-45ce-9b8e-7562a6ef97bc tempest-VolumesActionsTest-858798371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c24c361-fe79-42f2-9d12-c3cc5fb5678d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:54:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-208692049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b13edc0-23f5-4b1b-965c-af004660d535,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2e418254e5b4204ac6e2d6dafbf6acc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:54:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:54:55Z,use_quota=True,user_id='8bf983e2216d48eea401f66f8848a17b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:54:55 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-319f16c2-6037-45ce-9b8e-7562a6ef97bc tempest-VolumesActionsTest-858798371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e8dad08-e106-4e4d-aef6-947ee47da5fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:54:55 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-319f16c2-6037-45ce-9b8e-7562a6ef97bc tempest-VolumesActionsTest-858798371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e8dad08-e106-4e4d-aef6-947ee47da5fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:54:55 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-319f16c2-6037-45ce-9b8e-7562a6ef97bc tempest-VolumesActionsTest-858798371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (273c2b34-bb14-4459-b0d5-284a1cc4bda2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:54:55 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-319f16c2-6037-45ce-9b8e-7562a6ef97bc tempest-VolumesActionsTest-858798371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (273c2b34-bb14-4459-b0d5-284a1cc4bda2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b13edc0-23f5-4b1b-965c-af004660d535', 'volume_name': 'volume-6b13edc0-23f5-4b1b-965c-af004660d535', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:54:55 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-319f16c2-6037-45ce-9b8e-7562a6ef97bc tempest-VolumesActionsTest-858798371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2b4c0e0-0cf8-462b-b50e-99e837548d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:54:55 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-319f16c2-6037-45ce-9b8e-7562a6ef97bc tempest-VolumesActionsTest-858798371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2b4c0e0-0cf8-462b-b50e-99e837548d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:54:55 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-319f16c2-6037-45ce-9b8e-7562a6ef97bc tempest-VolumesActionsTest-858798371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b684fcee-aa09-414e-a4a0-eeb770c70d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:54:55 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-319f16c2-6037-45ce-9b8e-7562a6ef97bc tempest-VolumesActionsTest-858798371 None] Volume 6b13edc0-23f5-4b1b-965c-af004660d535: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b13edc0-23f5-4b1b-965c-af004660d535', 'volume_size': 1} Jul 08 01:54:55 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-319f16c2-6037-45ce-9b8e-7562a6ef97bc tempest-VolumesActionsTest-858798371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:54:56 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-22862a49-8e1e-44a9-9f30-f9c1492a3958 req-0124b971-b6b4-483e-b961-094f1f5c0cd1 tempest-TestInstancesWithCinderVolumes-108683866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:54:56 devstack sudo[99052]: pam_unix(sudo:session): session closed for user root Jul 08 01:54:56 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4f28e09b-d173-45db-bf57-d73d53151e7f tempest-TestStampPattern-656958745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-773e60c8-acd6-407d-afee-1c1a06403187 1073741824" returned: 0 in 1.254s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:54:56 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4f28e09b-d173-45db-bf57-d73d53151e7f tempest-TestStampPattern-656958745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-773e60c8-acd6-407d-afee-1c1a06403187 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:54:56 devstack sudo[99069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-773e60c8-acd6-407d-afee-1c1a06403187 Jul 08 01:54:56 devstack sudo[99069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:54:57 devstack sudo[99069]: pam_unix(sudo:session): session closed for user root Jul 08 01:54:57 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4f28e09b-d173-45db-bf57-d73d53151e7f tempest-TestStampPattern-656958745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-773e60c8-acd6-407d-afee-1c1a06403187" returned: 0 in 0.752s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:54:57 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-4f28e09b-d173-45db-bf57-d73d53151e7f tempest-TestStampPattern-656958745 None] <== create_volume: return (2064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:54:57 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-4f28e09b-d173-45db-bf57-d73d53151e7f tempest-TestStampPattern-656958745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.067s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:54:57 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-319f16c2-6037-45ce-9b8e-7562a6ef97bc tempest-VolumesActionsTest-858798371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.846s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:54:57 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-319f16c2-6037-45ce-9b8e-7562a6ef97bc tempest-VolumesActionsTest-858798371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:54:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-208692049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b13edc0-23f5-4b1b-965c-af004660d535,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2e418254e5b4204ac6e2d6dafbf6acc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:54:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:54:55Z,use_quota=True,user_id='8bf983e2216d48eea401f66f8848a17b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:54:57 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-319f16c2-6037-45ce-9b8e-7562a6ef97bc tempest-VolumesActionsTest-858798371 None] Creating volume 6b13edc0-23f5-4b1b-965c-af004660d535 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:54:57 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-319f16c2-6037-45ce-9b8e-7562a6ef97bc tempest-VolumesActionsTest-858798371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:54:57 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-319f16c2-6037-45ce-9b8e-7562a6ef97bc tempest-VolumesActionsTest-858798371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:54:57 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-319f16c2-6037-45ce-9b8e-7562a6ef97bc tempest-VolumesActionsTest-858798371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:54:57 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-319f16c2-6037-45ce-9b8e-7562a6ef97bc tempest-VolumesActionsTest-858798371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:54:57 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-319f16c2-6037-45ce-9b8e-7562a6ef97bc tempest-VolumesActionsTest-858798371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:54:57 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-319f16c2-6037-45ce-9b8e-7562a6ef97bc tempest-VolumesActionsTest-858798371 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:54:57 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-319f16c2-6037-45ce-9b8e-7562a6ef97bc tempest-VolumesActionsTest-858798371 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:54:57 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-319f16c2-6037-45ce-9b8e-7562a6ef97bc tempest-VolumesActionsTest-858798371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-6b13edc0-23f5-4b1b-965c-af004660d535 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:54:57 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-4f28e09b-d173-45db-bf57-d73d53151e7f tempest-TestStampPattern-656958745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8481c7a3-0722-4dcd-938e-ebca12d76107) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-773e60c8-acd6-407d-afee-1c1a06403187', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:54:57 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-4f28e09b-d173-45db-bf57-d73d53151e7f tempest-TestStampPattern-656958745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d298f973-5110-457b-a934-b2e88596fe24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:54:57 devstack sudo[99073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-6b13edc0-23f5-4b1b-965c-af004660d535 1073741824 Jul 08 01:54:57 devstack sudo[99073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:54:57 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-4f28e09b-d173-45db-bf57-d73d53151e7f tempest-TestStampPattern-656958745 None] Volume volume-773e60c8-acd6-407d-afee-1c1a06403187 (773e60c8-acd6-407d-afee-1c1a06403187): created successfully Jul 08 01:54:57 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-4f28e09b-d173-45db-bf57-d73d53151e7f tempest-TestStampPattern-656958745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d298f973-5110-457b-a934-b2e88596fe24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:54:57 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-4f28e09b-d173-45db-bf57-d73d53151e7f tempest-TestStampPattern-656958745 None] Flow 'volume_create_manager' (b6bf1f4b-edbf-497d-8c94-11143cddc08c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:54:57 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-4f28e09b-d173-45db-bf57-d73d53151e7f tempest-TestStampPattern-656958745 None] Created volume successfully. Jul 08 01:54:58 devstack sudo[99073]: pam_unix(sudo:session): session closed for user root Jul 08 01:54:58 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-319f16c2-6037-45ce-9b8e-7562a6ef97bc tempest-VolumesActionsTest-858798371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-6b13edc0-23f5-4b1b-965c-af004660d535 1073741824" returned: 0 in 0.881s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:54:58 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-319f16c2-6037-45ce-9b8e-7562a6ef97bc tempest-VolumesActionsTest-858798371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-6b13edc0-23f5-4b1b-965c-af004660d535 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:54:58 devstack sudo[99080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-6b13edc0-23f5-4b1b-965c-af004660d535 Jul 08 01:54:58 devstack sudo[99080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:54:59 devstack sudo[99080]: pam_unix(sudo:session): session closed for user root Jul 08 01:54:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-319f16c2-6037-45ce-9b8e-7562a6ef97bc tempest-VolumesActionsTest-858798371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-6b13edc0-23f5-4b1b-965c-af004660d535" returned: 0 in 0.691s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:54:59 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-319f16c2-6037-45ce-9b8e-7562a6ef97bc tempest-VolumesActionsTest-858798371 None] <== create_volume: return (1612ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:54:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-319f16c2-6037-45ce-9b8e-7562a6ef97bc tempest-VolumesActionsTest-858798371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.615s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:54:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-22862a49-8e1e-44a9-9f30-f9c1492a3958 req-0124b971-b6b4-483e-b961-094f1f5c0cd1 tempest-TestInstancesWithCinderVolumes-108683866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.006s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:54:59 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-319f16c2-6037-45ce-9b8e-7562a6ef97bc tempest-VolumesActionsTest-858798371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b684fcee-aa09-414e-a4a0-eeb770c70d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b13edc0-23f5-4b1b-965c-af004660d535', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:54:59 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-319f16c2-6037-45ce-9b8e-7562a6ef97bc tempest-VolumesActionsTest-858798371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46925073-4eaf-4f88-96b5-45b1f9b467ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:54:59 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-319f16c2-6037-45ce-9b8e-7562a6ef97bc tempest-VolumesActionsTest-858798371 None] Volume volume-6b13edc0-23f5-4b1b-965c-af004660d535 (6b13edc0-23f5-4b1b-965c-af004660d535): created successfully Jul 08 01:54:59 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-319f16c2-6037-45ce-9b8e-7562a6ef97bc tempest-VolumesActionsTest-858798371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46925073-4eaf-4f88-96b5-45b1f9b467ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:54:59 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-319f16c2-6037-45ce-9b8e-7562a6ef97bc tempest-VolumesActionsTest-858798371 None] Flow 'volume_create_manager' (e12b2eb0-260d-40b4-96c0-bf7e3ee0c58a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:54:59 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd60bbf-a485-44bb-b626-aaf6d54bc6f9]: (4, 'raw') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:54:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-22862a49-8e1e-44a9-9f30-f9c1492a3958 req-0124b971-b6b4-483e-b961-094f1f5c0cd1 tempest-TestInstancesWithCinderVolumes-108683866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d3d4cc6b-a71d-491c-bd63-5198a70aac1a {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:54:59 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-319f16c2-6037-45ce-9b8e-7562a6ef97bc tempest-VolumesActionsTest-858798371 None] Created volume successfully. Jul 08 01:54:59 devstack sudo[99083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d3d4cc6b-a71d-491c-bd63-5198a70aac1a Jul 08 01:54:59 devstack sudo[99083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:54:59 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-ab83395c-2eaf-4ef5-915d-5167fad36c52 tempest-VolumesActionsTest-75141281 None] Acquiring lock "cinder-6b13edc0-23f5-4b1b-965c-af004660d535-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:54:59 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-ab83395c-2eaf-4ef5-915d-5167fad36c52 tempest-VolumesActionsTest-75141281 None] Lock "cinder-6b13edc0-23f5-4b1b-965c-af004660d535-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:54:59 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-ab83395c-2eaf-4ef5-915d-5167fad36c52 tempest-VolumesActionsTest-75141281 None] Acquiring lock "cinder-quobyte-6b13edc0-23f5-4b1b-965c-af004660d535" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:54:59 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-ab83395c-2eaf-4ef5-915d-5167fad36c52 tempest-VolumesActionsTest-75141281 None] Lock "cinder-quobyte-6b13edc0-23f5-4b1b-965c-af004660d535" acquired by "delete_volume" :: waited 0.021s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:54:59 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e82fac-a756-45ac-ba27-68922f312725]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:54:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ab83395c-2eaf-4ef5-915d-5167fad36c52 tempest-VolumesActionsTest-75141281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-6b13edc0-23f5-4b1b-965c-af004660d535 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:54:59 devstack sudo[99085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-6b13edc0-23f5-4b1b-965c-af004660d535 Jul 08 01:54:59 devstack sudo[99085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:54:59 devstack sudo[99083]: pam_unix(sudo:session): session closed for user root Jul 08 01:54:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-22862a49-8e1e-44a9-9f30-f9c1492a3958 req-0124b971-b6b4-483e-b961-094f1f5c0cd1 tempest-TestInstancesWithCinderVolumes-108683866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d3d4cc6b-a71d-491c-bd63-5198a70aac1a" returned: 0 in 0.809s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:54:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-22862a49-8e1e-44a9-9f30-f9c1492a3958 req-0124b971-b6b4-483e-b961-094f1f5c0cd1 tempest-TestInstancesWithCinderVolumes-108683866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d3d4cc6b-a71d-491c-bd63-5198a70aac1a {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:00 devstack sudo[99089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d3d4cc6b-a71d-491c-bd63-5198a70aac1a Jul 08 01:55:00 devstack sudo[99089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:00 devstack sudo[99085]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ab83395c-2eaf-4ef5-915d-5167fad36c52 tempest-VolumesActionsTest-75141281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-6b13edc0-23f5-4b1b-965c-af004660d535" returned: 0 in 0.878s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ab83395c-2eaf-4ef5-915d-5167fad36c52 tempest-VolumesActionsTest-75141281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-6b13edc0-23f5-4b1b-965c-af004660d535 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:00 devstack sudo[99094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-6b13edc0-23f5-4b1b-965c-af004660d535 Jul 08 01:55:00 devstack sudo[99094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:00 devstack sudo[99089]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-22862a49-8e1e-44a9-9f30-f9c1492a3958 req-0124b971-b6b4-483e-b961-094f1f5c0cd1 tempest-TestInstancesWithCinderVolumes-108683866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d3d4cc6b-a71d-491c-bd63-5198a70aac1a" returned: 1 in 0.823s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-22862a49-8e1e-44a9-9f30-f9c1492a3958 req-0124b971-b6b4-483e-b961-094f1f5c0cd1 tempest-TestInstancesWithCinderVolumes-108683866 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d3d4cc6b-a71d-491c-bd63-5198a70aac1a' failed. Not Retrying. {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:55:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-22862a49-8e1e-44a9-9f30-f9c1492a3958 req-0124b971-b6b4-483e-b961-094f1f5c0cd1 tempest-TestInstancesWithCinderVolumes-108683866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.699s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:55:00 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [req-22862a49-8e1e-44a9-9f30-f9c1492a3958 req-0124b971-b6b4-483e-b961-094f1f5c0cd1 tempest-TestInstancesWithCinderVolumes-108683866 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17', 'name': 'volume-d3d4cc6b-a71d-491c-bd63-5198a70aac1a', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '350776cc-a31e-4b5f-b7b9-048c090e5a08', 'enforce_multipath': True} {{(pid=87134) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:55:00 devstack cinder-volume[87134]: INFO cinder.volume.manager [req-22862a49-8e1e-44a9-9f30-f9c1492a3958 req-0124b971-b6b4-483e-b961-094f1f5c0cd1 tempest-TestInstancesWithCinderVolumes-108683866 None] attachment_update completed successfully. Jul 08 01:55:01 devstack sudo[99094]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ab83395c-2eaf-4ef5-915d-5167fad36c52 tempest-VolumesActionsTest-75141281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-6b13edc0-23f5-4b1b-965c-af004660d535" returned: 0 in 0.778s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:01 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-ab83395c-2eaf-4ef5-915d-5167fad36c52 tempest-VolumesActionsTest-75141281 None] Lock "cinder-quobyte-6b13edc0-23f5-4b1b-965c-af004660d535" released by "delete_volume" :: held 1.727s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:55:01 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-ab83395c-2eaf-4ef5-915d-5167fad36c52 tempest-VolumesActionsTest-75141281 None] Created reservations ['d77d7323-fe97-498e-80ab-b02f0182f1ac', 'ef67d450-450e-4022-bf02-f0c340286d02', '03583b72-149b-4b7b-bfdc-74676bb9cab0', 'a2209b3d-344f-4f27-bb2c-d6990d7d889b'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:55:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-ab83395c-2eaf-4ef5-915d-5167fad36c52 tempest-VolumesActionsTest-75141281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:55:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-ab83395c-2eaf-4ef5-915d-5167fad36c52 tempest-VolumesActionsTest-75141281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:55:01 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-ab83395c-2eaf-4ef5-915d-5167fad36c52 tempest-VolumesActionsTest-75141281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:55:01 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-ab83395c-2eaf-4ef5-915d-5167fad36c52 tempest-VolumesActionsTest-75141281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:55:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-ab83395c-2eaf-4ef5-915d-5167fad36c52 tempest-VolumesActionsTest-75141281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:55:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ab83395c-2eaf-4ef5-915d-5167fad36c52 tempest-VolumesActionsTest-75141281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:01 devstack sudo[99103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:55:01 devstack sudo[99103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:02 devstack sudo[99103]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ab83395c-2eaf-4ef5-915d-5167fad36c52 tempest-VolumesActionsTest-75141281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.907s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:02 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-ab83395c-2eaf-4ef5-915d-5167fad36c52 tempest-VolumesActionsTest-75141281 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:55:02 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-ab83395c-2eaf-4ef5-915d-5167fad36c52 tempest-VolumesActionsTest-75141281 None] Deleted volume successfully. Jul 08 01:55:02 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-ab83395c-2eaf-4ef5-915d-5167fad36c52 tempest-VolumesActionsTest-75141281 None] Lock "cinder-6b13edc0-23f5-4b1b-965c-af004660d535-delete_volume" released by "delete_volume" :: held 2.913s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:55:02 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-441274d4-fa00-4d08-b9a3-2820fce4d2d6 tempest-VolumesActionsTest-858798371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:55:02 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-441274d4-fa00-4d08-b9a3-2820fce4d2d6 tempest-VolumesActionsTest-858798371 None] Flow 'volume_create_manager' (cd6ed0fa-8d16-4a30-b4a4-cb22fa2cb5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:55:02 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-441274d4-fa00-4d08-b9a3-2820fce4d2d6 tempest-VolumesActionsTest-858798371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b94d7a53-c4a2-49d4-904a-9c42902224dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:02 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-441274d4-fa00-4d08-b9a3-2820fce4d2d6 tempest-VolumesActionsTest-858798371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b94d7a53-c4a2-49d4-904a-9c42902224dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:55:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-525366744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aea2b0ea-f8fd-4704-93ab-7630f539b667,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2e418254e5b4204ac6e2d6dafbf6acc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:55:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:55:03Z,use_quota=True,user_id='8bf983e2216d48eea401f66f8848a17b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:02 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-441274d4-fa00-4d08-b9a3-2820fce4d2d6 tempest-VolumesActionsTest-858798371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6bcdaf9-8e84-40d8-803c-4d11b3b5a8a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:02 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-441274d4-fa00-4d08-b9a3-2820fce4d2d6 tempest-VolumesActionsTest-858798371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6bcdaf9-8e84-40d8-803c-4d11b3b5a8a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:02 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-441274d4-fa00-4d08-b9a3-2820fce4d2d6 tempest-VolumesActionsTest-858798371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c682a28-7180-4c6e-b9d4-be4574089447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:02 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-441274d4-fa00-4d08-b9a3-2820fce4d2d6 tempest-VolumesActionsTest-858798371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c682a28-7180-4c6e-b9d4-be4574089447) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aea2b0ea-f8fd-4704-93ab-7630f539b667', 'volume_name': 'volume-aea2b0ea-f8fd-4704-93ab-7630f539b667', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:02 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-441274d4-fa00-4d08-b9a3-2820fce4d2d6 tempest-VolumesActionsTest-858798371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23a0431c-ea20-4c6c-9470-ff48e75d656f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:02 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-441274d4-fa00-4d08-b9a3-2820fce4d2d6 tempest-VolumesActionsTest-858798371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23a0431c-ea20-4c6c-9470-ff48e75d656f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:02 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-441274d4-fa00-4d08-b9a3-2820fce4d2d6 tempest-VolumesActionsTest-858798371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (971c9f48-c88f-4b53-a12b-81473f852b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:02 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-441274d4-fa00-4d08-b9a3-2820fce4d2d6 tempest-VolumesActionsTest-858798371 None] Volume aea2b0ea-f8fd-4704-93ab-7630f539b667: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aea2b0ea-f8fd-4704-93ab-7630f539b667', 'volume_size': 1} Jul 08 01:55:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-441274d4-fa00-4d08-b9a3-2820fce4d2d6 tempest-VolumesActionsTest-858798371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:55:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-441274d4-fa00-4d08-b9a3-2820fce4d2d6 tempest-VolumesActionsTest-858798371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:55:02 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-441274d4-fa00-4d08-b9a3-2820fce4d2d6 tempest-VolumesActionsTest-858798371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:55:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-525366744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aea2b0ea-f8fd-4704-93ab-7630f539b667,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2e418254e5b4204ac6e2d6dafbf6acc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:55:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:55:03Z,use_quota=True,user_id='8bf983e2216d48eea401f66f8848a17b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:55:02 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-441274d4-fa00-4d08-b9a3-2820fce4d2d6 tempest-VolumesActionsTest-858798371 None] Creating volume aea2b0ea-f8fd-4704-93ab-7630f539b667 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:55:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-441274d4-fa00-4d08-b9a3-2820fce4d2d6 tempest-VolumesActionsTest-858798371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:55:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-441274d4-fa00-4d08-b9a3-2820fce4d2d6 tempest-VolumesActionsTest-858798371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:55:02 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-441274d4-fa00-4d08-b9a3-2820fce4d2d6 tempest-VolumesActionsTest-858798371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:55:02 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-441274d4-fa00-4d08-b9a3-2820fce4d2d6 tempest-VolumesActionsTest-858798371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:55:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-441274d4-fa00-4d08-b9a3-2820fce4d2d6 tempest-VolumesActionsTest-858798371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:55:02 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-441274d4-fa00-4d08-b9a3-2820fce4d2d6 tempest-VolumesActionsTest-858798371 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:55:02 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-441274d4-fa00-4d08-b9a3-2820fce4d2d6 tempest-VolumesActionsTest-858798371 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:55:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-441274d4-fa00-4d08-b9a3-2820fce4d2d6 tempest-VolumesActionsTest-858798371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-aea2b0ea-f8fd-4704-93ab-7630f539b667 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:02 devstack sudo[99108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-aea2b0ea-f8fd-4704-93ab-7630f539b667 1073741824 Jul 08 01:55:02 devstack sudo[99108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:04 devstack sudo[99108]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:04 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-441274d4-fa00-4d08-b9a3-2820fce4d2d6 tempest-VolumesActionsTest-858798371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-aea2b0ea-f8fd-4704-93ab-7630f539b667 1073741824" returned: 0 in 1.349s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:04 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-441274d4-fa00-4d08-b9a3-2820fce4d2d6 tempest-VolumesActionsTest-858798371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-aea2b0ea-f8fd-4704-93ab-7630f539b667 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:04 devstack sudo[99527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-aea2b0ea-f8fd-4704-93ab-7630f539b667 Jul 08 01:55:04 devstack sudo[99527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:05 devstack sudo[99527]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:05 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-441274d4-fa00-4d08-b9a3-2820fce4d2d6 tempest-VolumesActionsTest-858798371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-aea2b0ea-f8fd-4704-93ab-7630f539b667" returned: 0 in 0.954s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:05 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-441274d4-fa00-4d08-b9a3-2820fce4d2d6 tempest-VolumesActionsTest-858798371 None] <== create_volume: return (2356ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:55:05 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-441274d4-fa00-4d08-b9a3-2820fce4d2d6 tempest-VolumesActionsTest-858798371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.368s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:55:05 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-441274d4-fa00-4d08-b9a3-2820fce4d2d6 tempest-VolumesActionsTest-858798371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (971c9f48-c88f-4b53-a12b-81473f852b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aea2b0ea-f8fd-4704-93ab-7630f539b667', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:05 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-441274d4-fa00-4d08-b9a3-2820fce4d2d6 tempest-VolumesActionsTest-858798371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aaa38a2-2f9a-4469-bb72-21b60c6bbc05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:05 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-441274d4-fa00-4d08-b9a3-2820fce4d2d6 tempest-VolumesActionsTest-858798371 None] Volume volume-aea2b0ea-f8fd-4704-93ab-7630f539b667 (aea2b0ea-f8fd-4704-93ab-7630f539b667): created successfully Jul 08 01:55:05 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-441274d4-fa00-4d08-b9a3-2820fce4d2d6 tempest-VolumesActionsTest-858798371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aaa38a2-2f9a-4469-bb72-21b60c6bbc05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:05 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-441274d4-fa00-4d08-b9a3-2820fce4d2d6 tempest-VolumesActionsTest-858798371 None] Flow 'volume_create_manager' (cd6ed0fa-8d16-4a30-b4a4-cb22fa2cb5c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:55:05 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-441274d4-fa00-4d08-b9a3-2820fce4d2d6 tempest-VolumesActionsTest-858798371 None] Created volume successfully. Jul 08 01:55:05 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-4df33c0d-5d2c-4e19-947f-cabeac269f96 tempest-VolumesActionsTest-75141281 None] Acquiring lock "cinder-aea2b0ea-f8fd-4704-93ab-7630f539b667-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:55:06 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-4df33c0d-5d2c-4e19-947f-cabeac269f96 tempest-VolumesActionsTest-75141281 None] Lock "cinder-aea2b0ea-f8fd-4704-93ab-7630f539b667-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:55:06 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-4df33c0d-5d2c-4e19-947f-cabeac269f96 tempest-VolumesActionsTest-75141281 None] Acquiring lock "cinder-quobyte-aea2b0ea-f8fd-4704-93ab-7630f539b667" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:55:06 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-4df33c0d-5d2c-4e19-947f-cabeac269f96 tempest-VolumesActionsTest-75141281 None] Lock "cinder-quobyte-aea2b0ea-f8fd-4704-93ab-7630f539b667" acquired by "delete_volume" :: waited 0.018s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:55:06 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[2514a621-b9a9-46bf-a923-c13e28d494fa]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:55:06 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4df33c0d-5d2c-4e19-947f-cabeac269f96 tempest-VolumesActionsTest-75141281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-aea2b0ea-f8fd-4704-93ab-7630f539b667 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:06 devstack sudo[99633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-aea2b0ea-f8fd-4704-93ab-7630f539b667 Jul 08 01:55:06 devstack sudo[99633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:06 devstack sudo[99633]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:06 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4df33c0d-5d2c-4e19-947f-cabeac269f96 tempest-VolumesActionsTest-75141281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-aea2b0ea-f8fd-4704-93ab-7630f539b667" returned: 0 in 0.827s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:06 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4df33c0d-5d2c-4e19-947f-cabeac269f96 tempest-VolumesActionsTest-75141281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-aea2b0ea-f8fd-4704-93ab-7630f539b667 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:06 devstack sudo[99912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-aea2b0ea-f8fd-4704-93ab-7630f539b667 Jul 08 01:55:06 devstack sudo[99912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:08 devstack sudo[99912]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:08 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4df33c0d-5d2c-4e19-947f-cabeac269f96 tempest-VolumesActionsTest-75141281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-aea2b0ea-f8fd-4704-93ab-7630f539b667" returned: 0 in 1.091s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:08 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-4df33c0d-5d2c-4e19-947f-cabeac269f96 tempest-VolumesActionsTest-75141281 None] Lock "cinder-quobyte-aea2b0ea-f8fd-4704-93ab-7630f539b667" released by "delete_volume" :: held 2.007s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:55:08 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-4df33c0d-5d2c-4e19-947f-cabeac269f96 tempest-VolumesActionsTest-75141281 None] Created reservations ['77a31330-bd4f-4c8c-a8f3-064a3cb7a4ee', '220890ab-13dc-494e-811d-fde045b692e2', '9367c994-c88a-473f-8848-e49392609060', '9bcd8a65-f2e0-4b4b-b4ca-7c2d74d1fb7c'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:55:08 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-4df33c0d-5d2c-4e19-947f-cabeac269f96 tempest-VolumesActionsTest-75141281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:55:08 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-4df33c0d-5d2c-4e19-947f-cabeac269f96 tempest-VolumesActionsTest-75141281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:55:08 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-4df33c0d-5d2c-4e19-947f-cabeac269f96 tempest-VolumesActionsTest-75141281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:55:08 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-4df33c0d-5d2c-4e19-947f-cabeac269f96 tempest-VolumesActionsTest-75141281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:55:08 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-4df33c0d-5d2c-4e19-947f-cabeac269f96 tempest-VolumesActionsTest-75141281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:55:08 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4df33c0d-5d2c-4e19-947f-cabeac269f96 tempest-VolumesActionsTest-75141281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:08 devstack sudo[99951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:55:08 devstack sudo[99951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:09 devstack sudo[99951]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:09 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4df33c0d-5d2c-4e19-947f-cabeac269f96 tempest-VolumesActionsTest-75141281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 1.003s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:09 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-4df33c0d-5d2c-4e19-947f-cabeac269f96 tempest-VolumesActionsTest-75141281 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:55:09 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-4df33c0d-5d2c-4e19-947f-cabeac269f96 tempest-VolumesActionsTest-75141281 None] Deleted volume successfully. Jul 08 01:55:09 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-4df33c0d-5d2c-4e19-947f-cabeac269f96 tempest-VolumesActionsTest-75141281 None] Lock "cinder-aea2b0ea-f8fd-4704-93ab-7630f539b667-delete_volume" released by "delete_volume" :: held 3.560s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:55:10 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-40a9a411-c72e-4ebe-a61a-91775e030c70 tempest-VolumesActionsTest-858798371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:55:10 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-40a9a411-c72e-4ebe-a61a-91775e030c70 tempest-VolumesActionsTest-858798371 None] Flow 'volume_create_manager' (331cda1a-b767-4c6f-82be-15ed9ee4364e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:55:10 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-40a9a411-c72e-4ebe-a61a-91775e030c70 tempest-VolumesActionsTest-858798371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a2577d0-dc7e-4577-85b2-9c9fbe296205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:10 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-40a9a411-c72e-4ebe-a61a-91775e030c70 tempest-VolumesActionsTest-858798371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a2577d0-dc7e-4577-85b2-9c9fbe296205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:55:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-506327048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd0a249e-8860-4ebf-a57e-b41dd8290ef9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2e418254e5b4204ac6e2d6dafbf6acc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:55:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:55:10Z,use_quota=True,user_id='8bf983e2216d48eea401f66f8848a17b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:10 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-40a9a411-c72e-4ebe-a61a-91775e030c70 tempest-VolumesActionsTest-858798371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b2e2506-9c93-471a-b3f3-21034fa067c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:10 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-40a9a411-c72e-4ebe-a61a-91775e030c70 tempest-VolumesActionsTest-858798371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b2e2506-9c93-471a-b3f3-21034fa067c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:10 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-40a9a411-c72e-4ebe-a61a-91775e030c70 tempest-VolumesActionsTest-858798371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3297b03-11ae-421d-b6ad-ae80e230b20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:10 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-40a9a411-c72e-4ebe-a61a-91775e030c70 tempest-VolumesActionsTest-858798371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3297b03-11ae-421d-b6ad-ae80e230b20b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd0a249e-8860-4ebf-a57e-b41dd8290ef9', 'volume_name': 'volume-bd0a249e-8860-4ebf-a57e-b41dd8290ef9', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:10 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-40a9a411-c72e-4ebe-a61a-91775e030c70 tempest-VolumesActionsTest-858798371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60e246b5-c6e2-4b52-8ca2-dd72ada84996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:10 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-40a9a411-c72e-4ebe-a61a-91775e030c70 tempest-VolumesActionsTest-858798371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60e246b5-c6e2-4b52-8ca2-dd72ada84996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:10 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-40a9a411-c72e-4ebe-a61a-91775e030c70 tempest-VolumesActionsTest-858798371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74a2b378-1954-4993-849b-eb126b4097b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:10 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-40a9a411-c72e-4ebe-a61a-91775e030c70 tempest-VolumesActionsTest-858798371 None] Volume bd0a249e-8860-4ebf-a57e-b41dd8290ef9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd0a249e-8860-4ebf-a57e-b41dd8290ef9', 'volume_size': 1} Jul 08 01:55:10 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-40a9a411-c72e-4ebe-a61a-91775e030c70 tempest-VolumesActionsTest-858798371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:55:10 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-40a9a411-c72e-4ebe-a61a-91775e030c70 tempest-VolumesActionsTest-858798371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:55:10 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-40a9a411-c72e-4ebe-a61a-91775e030c70 tempest-VolumesActionsTest-858798371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:55:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-506327048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd0a249e-8860-4ebf-a57e-b41dd8290ef9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2e418254e5b4204ac6e2d6dafbf6acc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:55:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:55:10Z,use_quota=True,user_id='8bf983e2216d48eea401f66f8848a17b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:55:10 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-40a9a411-c72e-4ebe-a61a-91775e030c70 tempest-VolumesActionsTest-858798371 None] Creating volume bd0a249e-8860-4ebf-a57e-b41dd8290ef9 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:55:10 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-40a9a411-c72e-4ebe-a61a-91775e030c70 tempest-VolumesActionsTest-858798371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:55:10 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-40a9a411-c72e-4ebe-a61a-91775e030c70 tempest-VolumesActionsTest-858798371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:55:10 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-40a9a411-c72e-4ebe-a61a-91775e030c70 tempest-VolumesActionsTest-858798371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:55:10 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-40a9a411-c72e-4ebe-a61a-91775e030c70 tempest-VolumesActionsTest-858798371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:55:10 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-40a9a411-c72e-4ebe-a61a-91775e030c70 tempest-VolumesActionsTest-858798371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:55:10 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-40a9a411-c72e-4ebe-a61a-91775e030c70 tempest-VolumesActionsTest-858798371 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:55:10 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-40a9a411-c72e-4ebe-a61a-91775e030c70 tempest-VolumesActionsTest-858798371 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:55:10 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-40a9a411-c72e-4ebe-a61a-91775e030c70 tempest-VolumesActionsTest-858798371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-bd0a249e-8860-4ebf-a57e-b41dd8290ef9 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:10 devstack sudo[99983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-bd0a249e-8860-4ebf-a57e-b41dd8290ef9 1073741824 Jul 08 01:55:10 devstack sudo[99983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:12 devstack sudo[99983]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:12 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-40a9a411-c72e-4ebe-a61a-91775e030c70 tempest-VolumesActionsTest-858798371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-bd0a249e-8860-4ebf-a57e-b41dd8290ef9 1073741824" returned: 0 in 1.697s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:12 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-40a9a411-c72e-4ebe-a61a-91775e030c70 tempest-VolumesActionsTest-858798371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-bd0a249e-8860-4ebf-a57e-b41dd8290ef9 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:12 devstack sudo[99992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-bd0a249e-8860-4ebf-a57e-b41dd8290ef9 Jul 08 01:55:12 devstack sudo[99992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:13 devstack sudo[99992]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-40a9a411-c72e-4ebe-a61a-91775e030c70 tempest-VolumesActionsTest-858798371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-bd0a249e-8860-4ebf-a57e-b41dd8290ef9" returned: 0 in 1.449s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:13 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-40a9a411-c72e-4ebe-a61a-91775e030c70 tempest-VolumesActionsTest-858798371 None] <== create_volume: return (3288ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:55:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-40a9a411-c72e-4ebe-a61a-91775e030c70 tempest-VolumesActionsTest-858798371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.291s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:55:13 devstack cinder-volume[87134]: DEBUG dbcounter [-] [87134] Writing DB stats cinder:UPDATE=75,cinder:SELECT=59,cinder:DELETE=7,cinder:INSERT=21 {{(pid=87134) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:55:14 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-40a9a411-c72e-4ebe-a61a-91775e030c70 tempest-VolumesActionsTest-858798371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74a2b378-1954-4993-849b-eb126b4097b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd0a249e-8860-4ebf-a57e-b41dd8290ef9', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:14 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-40a9a411-c72e-4ebe-a61a-91775e030c70 tempest-VolumesActionsTest-858798371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0d5ee9f-c92b-48d7-95e4-d6e14e7dd966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:14 devstack cinder-volume[87134]: DEBUG dbcounter [-] [87134] Writing DB stats cinder:SELECT=68,cinder:INSERT=20,cinder:UPDATE=77,cinder:DELETE=7 {{(pid=87134) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:55:14 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-40a9a411-c72e-4ebe-a61a-91775e030c70 tempest-VolumesActionsTest-858798371 None] Volume volume-bd0a249e-8860-4ebf-a57e-b41dd8290ef9 (bd0a249e-8860-4ebf-a57e-b41dd8290ef9): created successfully Jul 08 01:55:14 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-40a9a411-c72e-4ebe-a61a-91775e030c70 tempest-VolumesActionsTest-858798371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0d5ee9f-c92b-48d7-95e4-d6e14e7dd966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:14 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-40a9a411-c72e-4ebe-a61a-91775e030c70 tempest-VolumesActionsTest-858798371 None] Flow 'volume_create_manager' (331cda1a-b767-4c6f-82be-15ed9ee4364e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:55:14 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-40a9a411-c72e-4ebe-a61a-91775e030c70 tempest-VolumesActionsTest-858798371 None] Created volume successfully. Jul 08 01:55:15 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-cc7762ef-2397-4142-8a9d-3aedd5c83012 tempest-VolumesActionsTest-858798371 None] Acquiring lock "cinder-bd0a249e-8860-4ebf-a57e-b41dd8290ef9-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:55:16 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-cc7762ef-2397-4142-8a9d-3aedd5c83012 tempest-VolumesActionsTest-858798371 None] Lock "cinder-bd0a249e-8860-4ebf-a57e-b41dd8290ef9-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:55:16 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-cc7762ef-2397-4142-8a9d-3aedd5c83012 tempest-VolumesActionsTest-858798371 None] Acquiring lock "cinder-quobyte-bd0a249e-8860-4ebf-a57e-b41dd8290ef9" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:55:16 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-cc7762ef-2397-4142-8a9d-3aedd5c83012 tempest-VolumesActionsTest-858798371 None] Lock "cinder-quobyte-bd0a249e-8860-4ebf-a57e-b41dd8290ef9" acquired by "delete_volume" :: waited 0.024s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:55:16 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea34335e-aa58-4d3b-8c70-778752d1a042]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:55:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-cc7762ef-2397-4142-8a9d-3aedd5c83012 tempest-VolumesActionsTest-858798371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-bd0a249e-8860-4ebf-a57e-b41dd8290ef9 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:16 devstack sudo[100018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-bd0a249e-8860-4ebf-a57e-b41dd8290ef9 Jul 08 01:55:16 devstack sudo[100018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:18 devstack sudo[100018]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-cc7762ef-2397-4142-8a9d-3aedd5c83012 tempest-VolumesActionsTest-858798371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-bd0a249e-8860-4ebf-a57e-b41dd8290ef9" returned: 0 in 1.781s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-cc7762ef-2397-4142-8a9d-3aedd5c83012 tempest-VolumesActionsTest-858798371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-bd0a249e-8860-4ebf-a57e-b41dd8290ef9 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:18 devstack sudo[100089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-bd0a249e-8860-4ebf-a57e-b41dd8290ef9 Jul 08 01:55:18 devstack sudo[100089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:19 devstack sudo[100089]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-cc7762ef-2397-4142-8a9d-3aedd5c83012 tempest-VolumesActionsTest-858798371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-bd0a249e-8860-4ebf-a57e-b41dd8290ef9" returned: 0 in 1.155s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:19 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-cc7762ef-2397-4142-8a9d-3aedd5c83012 tempest-VolumesActionsTest-858798371 None] Lock "cinder-quobyte-bd0a249e-8860-4ebf-a57e-b41dd8290ef9" released by "delete_volume" :: held 3.075s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:55:19 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-cc7762ef-2397-4142-8a9d-3aedd5c83012 tempest-VolumesActionsTest-858798371 None] Created reservations ['b061a355-d3dd-4115-a37c-10defc911e20', '51c73864-e258-47c5-a9fb-7756fbceeb02', '022b27dd-c726-47fd-9b85-4734bda5149d', 'be900a4a-d19a-40f6-ac86-5cb82e5a3daa'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:55:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-cc7762ef-2397-4142-8a9d-3aedd5c83012 tempest-VolumesActionsTest-858798371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:55:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-cc7762ef-2397-4142-8a9d-3aedd5c83012 tempest-VolumesActionsTest-858798371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:55:19 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-cc7762ef-2397-4142-8a9d-3aedd5c83012 tempest-VolumesActionsTest-858798371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:55:19 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-cc7762ef-2397-4142-8a9d-3aedd5c83012 tempest-VolumesActionsTest-858798371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:55:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-cc7762ef-2397-4142-8a9d-3aedd5c83012 tempest-VolumesActionsTest-858798371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:55:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-cc7762ef-2397-4142-8a9d-3aedd5c83012 tempest-VolumesActionsTest-858798371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:19 devstack sudo[100093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:55:19 devstack sudo[100093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:20 devstack sudo[100093]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-cc7762ef-2397-4142-8a9d-3aedd5c83012 tempest-VolumesActionsTest-858798371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 1.147s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:20 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-cc7762ef-2397-4142-8a9d-3aedd5c83012 tempest-VolumesActionsTest-858798371 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:55:20 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-cc7762ef-2397-4142-8a9d-3aedd5c83012 tempest-VolumesActionsTest-858798371 None] Deleted volume successfully. Jul 08 01:55:20 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-cc7762ef-2397-4142-8a9d-3aedd5c83012 tempest-VolumesActionsTest-858798371 None] Lock "cinder-bd0a249e-8860-4ebf-a57e-b41dd8290ef9-delete_volume" released by "delete_volume" :: held 4.810s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:55:20 devstack cinder-volume[87134]: DEBUG oslo_service.periodic_task [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87134) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:55:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:55:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:55:20 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:55:20 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:55:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:55:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:20 devstack sudo[100097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:55:20 devstack sudo[100097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:22 devstack sudo[100097]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 1.223s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:22 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:55:22 devstack cinder-volume[87134]: DEBUG oslo_service.periodic_task [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running periodic task VolumeManager._thread_info {{(pid=87134) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:55:22 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] thread count: 28 {{(pid=87134) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:55:22 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] thread info: [<_MainThread(MainThread, started 129378964615296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87134) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:55:29 devstack cinder-volume[87134]: DEBUG dbcounter [-] [87134] Writing DB stats cinder:DELETE=1,cinder:UPDATE=8,cinder:SELECT=5,cinder:INSERT=2 {{(pid=87134) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:55:30 devstack cinder-volume[87134]: DEBUG dbcounter [-] [87134] Writing DB stats cinder:UPDATE=9,cinder:SELECT=5,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87134) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:55:35 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-1239ae6d-3e26-488f-916d-178d97048fa6 tempest-AbsoluteLimitsTests-946655667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:55:35 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1239ae6d-3e26-488f-916d-178d97048fa6 tempest-AbsoluteLimitsTests-946655667 None] Flow 'volume_create_manager' (48baa122-5d20-4001-b66f-a879e3945997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:55:35 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1239ae6d-3e26-488f-916d-178d97048fa6 tempest-AbsoluteLimitsTests-946655667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97ce180d-e855-4af1-ab68-8986511290d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:35 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1239ae6d-3e26-488f-916d-178d97048fa6 tempest-AbsoluteLimitsTests-946655667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97ce180d-e855-4af1-ab68-8986511290d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:55:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1941382846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96cc86d9-c94c-4c1e-8f94-042650df1670,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d26912ab3e8843f3b391e907e76bdc80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:55:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:55:35Z,use_quota=True,user_id='8de63507e1eb4d0bbc50b53503dab14a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:35 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1239ae6d-3e26-488f-916d-178d97048fa6 tempest-AbsoluteLimitsTests-946655667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3b5e9ef-ea69-405e-8818-ac607db36e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:35 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1239ae6d-3e26-488f-916d-178d97048fa6 tempest-AbsoluteLimitsTests-946655667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3b5e9ef-ea69-405e-8818-ac607db36e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:35 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1239ae6d-3e26-488f-916d-178d97048fa6 tempest-AbsoluteLimitsTests-946655667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9cbb034-cfc5-424d-a747-2e21067c18af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:35 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1239ae6d-3e26-488f-916d-178d97048fa6 tempest-AbsoluteLimitsTests-946655667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9cbb034-cfc5-424d-a747-2e21067c18af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96cc86d9-c94c-4c1e-8f94-042650df1670', 'volume_name': 'volume-96cc86d9-c94c-4c1e-8f94-042650df1670', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:35 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1239ae6d-3e26-488f-916d-178d97048fa6 tempest-AbsoluteLimitsTests-946655667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a1c7f83-e2e6-4b40-afca-8f53f0066440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:35 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1239ae6d-3e26-488f-916d-178d97048fa6 tempest-AbsoluteLimitsTests-946655667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a1c7f83-e2e6-4b40-afca-8f53f0066440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:35 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1239ae6d-3e26-488f-916d-178d97048fa6 tempest-AbsoluteLimitsTests-946655667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fae121b-84df-42d2-9713-6536b5dc7b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:35 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-1239ae6d-3e26-488f-916d-178d97048fa6 tempest-AbsoluteLimitsTests-946655667 None] Volume 96cc86d9-c94c-4c1e-8f94-042650df1670: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96cc86d9-c94c-4c1e-8f94-042650df1670', 'volume_size': 1} Jul 08 01:55:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-1239ae6d-3e26-488f-916d-178d97048fa6 tempest-AbsoluteLimitsTests-946655667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:55:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-1239ae6d-3e26-488f-916d-178d97048fa6 tempest-AbsoluteLimitsTests-946655667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:55:35 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-1239ae6d-3e26-488f-916d-178d97048fa6 tempest-AbsoluteLimitsTests-946655667 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:55:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1941382846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96cc86d9-c94c-4c1e-8f94-042650df1670,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d26912ab3e8843f3b391e907e76bdc80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:55:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:55:35Z,use_quota=True,user_id='8de63507e1eb4d0bbc50b53503dab14a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:55:35 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-1239ae6d-3e26-488f-916d-178d97048fa6 tempest-AbsoluteLimitsTests-946655667 None] Creating volume 96cc86d9-c94c-4c1e-8f94-042650df1670 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:55:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-1239ae6d-3e26-488f-916d-178d97048fa6 tempest-AbsoluteLimitsTests-946655667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:55:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-1239ae6d-3e26-488f-916d-178d97048fa6 tempest-AbsoluteLimitsTests-946655667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:55:35 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-1239ae6d-3e26-488f-916d-178d97048fa6 tempest-AbsoluteLimitsTests-946655667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:55:35 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-1239ae6d-3e26-488f-916d-178d97048fa6 tempest-AbsoluteLimitsTests-946655667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:55:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-1239ae6d-3e26-488f-916d-178d97048fa6 tempest-AbsoluteLimitsTests-946655667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:55:35 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-1239ae6d-3e26-488f-916d-178d97048fa6 tempest-AbsoluteLimitsTests-946655667 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:55:35 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-1239ae6d-3e26-488f-916d-178d97048fa6 tempest-AbsoluteLimitsTests-946655667 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:55:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1239ae6d-3e26-488f-916d-178d97048fa6 tempest-AbsoluteLimitsTests-946655667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-96cc86d9-c94c-4c1e-8f94-042650df1670 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:35 devstack sudo[100288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-96cc86d9-c94c-4c1e-8f94-042650df1670 1073741824 Jul 08 01:55:35 devstack sudo[100288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:36 devstack sudo[100288]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1239ae6d-3e26-488f-916d-178d97048fa6 tempest-AbsoluteLimitsTests-946655667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-96cc86d9-c94c-4c1e-8f94-042650df1670 1073741824" returned: 0 in 0.910s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1239ae6d-3e26-488f-916d-178d97048fa6 tempest-AbsoluteLimitsTests-946655667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-96cc86d9-c94c-4c1e-8f94-042650df1670 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:36 devstack sudo[100293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-96cc86d9-c94c-4c1e-8f94-042650df1670 Jul 08 01:55:36 devstack sudo[100293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:37 devstack sudo[100293]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1239ae6d-3e26-488f-916d-178d97048fa6 tempest-AbsoluteLimitsTests-946655667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-96cc86d9-c94c-4c1e-8f94-042650df1670" returned: 0 in 0.656s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:37 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-1239ae6d-3e26-488f-916d-178d97048fa6 tempest-AbsoluteLimitsTests-946655667 None] <== create_volume: return (1610ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:55:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-1239ae6d-3e26-488f-916d-178d97048fa6 tempest-AbsoluteLimitsTests-946655667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.613s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:55:37 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1239ae6d-3e26-488f-916d-178d97048fa6 tempest-AbsoluteLimitsTests-946655667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fae121b-84df-42d2-9713-6536b5dc7b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96cc86d9-c94c-4c1e-8f94-042650df1670', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:37 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1239ae6d-3e26-488f-916d-178d97048fa6 tempest-AbsoluteLimitsTests-946655667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25e63d0c-1d97-4a2a-830c-a0f1b7d08ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:37 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-1239ae6d-3e26-488f-916d-178d97048fa6 tempest-AbsoluteLimitsTests-946655667 None] Volume volume-96cc86d9-c94c-4c1e-8f94-042650df1670 (96cc86d9-c94c-4c1e-8f94-042650df1670): created successfully Jul 08 01:55:37 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1239ae6d-3e26-488f-916d-178d97048fa6 tempest-AbsoluteLimitsTests-946655667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25e63d0c-1d97-4a2a-830c-a0f1b7d08ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:37 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1239ae6d-3e26-488f-916d-178d97048fa6 tempest-AbsoluteLimitsTests-946655667 None] Flow 'volume_create_manager' (48baa122-5d20-4001-b66f-a879e3945997) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:55:37 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-1239ae6d-3e26-488f-916d-178d97048fa6 tempest-AbsoluteLimitsTests-946655667 None] Created volume successfully. Jul 08 01:55:37 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-dae21dff-764f-4381-bd38-6f15c48da8f2 tempest-AbsoluteLimitsTests-946655667 None] Acquiring lock "cinder-96cc86d9-c94c-4c1e-8f94-042650df1670-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:55:37 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-dae21dff-764f-4381-bd38-6f15c48da8f2 tempest-AbsoluteLimitsTests-946655667 None] Lock "cinder-96cc86d9-c94c-4c1e-8f94-042650df1670-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:55:37 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-dae21dff-764f-4381-bd38-6f15c48da8f2 tempest-AbsoluteLimitsTests-946655667 None] Acquiring lock "cinder-quobyte-96cc86d9-c94c-4c1e-8f94-042650df1670" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:55:37 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-dae21dff-764f-4381-bd38-6f15c48da8f2 tempest-AbsoluteLimitsTests-946655667 None] Lock "cinder-quobyte-96cc86d9-c94c-4c1e-8f94-042650df1670" acquired by "delete_volume" :: waited 0.019s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:55:37 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f304b1-28b5-42c0-a297-2b310d0733f4]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:55:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-dae21dff-764f-4381-bd38-6f15c48da8f2 tempest-AbsoluteLimitsTests-946655667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-96cc86d9-c94c-4c1e-8f94-042650df1670 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:37 devstack sudo[100298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-96cc86d9-c94c-4c1e-8f94-042650df1670 Jul 08 01:55:37 devstack sudo[100298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:38 devstack sudo[100298]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-dae21dff-764f-4381-bd38-6f15c48da8f2 tempest-AbsoluteLimitsTests-946655667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-96cc86d9-c94c-4c1e-8f94-042650df1670" returned: 0 in 0.779s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-dae21dff-764f-4381-bd38-6f15c48da8f2 tempest-AbsoluteLimitsTests-946655667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-96cc86d9-c94c-4c1e-8f94-042650df1670 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:38 devstack sudo[100308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-96cc86d9-c94c-4c1e-8f94-042650df1670 Jul 08 01:55:38 devstack sudo[100308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:39 devstack sudo[100308]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-dae21dff-764f-4381-bd38-6f15c48da8f2 tempest-AbsoluteLimitsTests-946655667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-96cc86d9-c94c-4c1e-8f94-042650df1670" returned: 0 in 0.715s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:39 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-dae21dff-764f-4381-bd38-6f15c48da8f2 tempest-AbsoluteLimitsTests-946655667 None] Lock "cinder-quobyte-96cc86d9-c94c-4c1e-8f94-042650df1670" released by "delete_volume" :: held 1.534s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:55:39 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-dae21dff-764f-4381-bd38-6f15c48da8f2 tempest-AbsoluteLimitsTests-946655667 None] Created reservations ['1963154e-3996-42cd-8bec-81c524cd9534', '8ef870f2-3fad-4758-aa18-d26ccd76f20c', '079d1a92-3ed0-4dad-b8ac-5ab9d2e07f7e', '6e7011e6-5e69-4598-b607-3cb1f0ee3cba'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:55:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-dae21dff-764f-4381-bd38-6f15c48da8f2 tempest-AbsoluteLimitsTests-946655667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:55:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-dae21dff-764f-4381-bd38-6f15c48da8f2 tempest-AbsoluteLimitsTests-946655667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:55:39 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-dae21dff-764f-4381-bd38-6f15c48da8f2 tempest-AbsoluteLimitsTests-946655667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:55:39 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-dae21dff-764f-4381-bd38-6f15c48da8f2 tempest-AbsoluteLimitsTests-946655667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:55:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-dae21dff-764f-4381-bd38-6f15c48da8f2 tempest-AbsoluteLimitsTests-946655667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:55:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-dae21dff-764f-4381-bd38-6f15c48da8f2 tempest-AbsoluteLimitsTests-946655667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:39 devstack sudo[100311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:55:39 devstack sudo[100311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:39 devstack sudo[100311]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-dae21dff-764f-4381-bd38-6f15c48da8f2 tempest-AbsoluteLimitsTests-946655667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.652s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:39 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-dae21dff-764f-4381-bd38-6f15c48da8f2 tempest-AbsoluteLimitsTests-946655667 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:55:39 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-dae21dff-764f-4381-bd38-6f15c48da8f2 tempest-AbsoluteLimitsTests-946655667 None] Deleted volume successfully. Jul 08 01:55:39 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-dae21dff-764f-4381-bd38-6f15c48da8f2 tempest-AbsoluteLimitsTests-946655667 None] Lock "cinder-96cc86d9-c94c-4c1e-8f94-042650df1670-delete_volume" released by "delete_volume" :: held 2.416s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:55:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-90d2b324-e8b7-457b-a51c-287457c7d6f5 req-e8dd20c4-c815-43a7-829e-7354b6ab4395 tempest-TestStampPattern-656958745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:55:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-90d2b324-e8b7-457b-a51c-287457c7d6f5 req-e8dd20c4-c815-43a7-829e-7354b6ab4395 tempest-TestStampPattern-656958745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:55:41 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d4ec94-ed22-4fe0-ba59-7e251f789e57]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:55:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-90d2b324-e8b7-457b-a51c-287457c7d6f5 req-e8dd20c4-c815-43a7-829e-7354b6ab4395 tempest-TestStampPattern-656958745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-773e60c8-acd6-407d-afee-1c1a06403187 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:41 devstack sudo[100329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-773e60c8-acd6-407d-afee-1c1a06403187 Jul 08 01:55:41 devstack sudo[100329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:41 devstack sudo[100329]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-90d2b324-e8b7-457b-a51c-287457c7d6f5 req-e8dd20c4-c815-43a7-829e-7354b6ab4395 tempest-TestStampPattern-656958745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-773e60c8-acd6-407d-afee-1c1a06403187" returned: 0 in 0.892s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-90d2b324-e8b7-457b-a51c-287457c7d6f5 req-e8dd20c4-c815-43a7-829e-7354b6ab4395 tempest-TestStampPattern-656958745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.911s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:55:42 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [req-90d2b324-e8b7-457b-a51c-287457c7d6f5 req-e8dd20c4-c815-43a7-829e-7354b6ab4395 tempest-TestStampPattern-656958745 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17', 'name': 'volume-773e60c8-acd6-407d-afee-1c1a06403187', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6658a9ef-2b0f-4cf8-b17a-51522bbe519d', 'enforce_multipath': True} {{(pid=87134) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:55:42 devstack cinder-volume[87134]: INFO cinder.volume.manager [req-90d2b324-e8b7-457b-a51c-287457c7d6f5 req-e8dd20c4-c815-43a7-829e-7354b6ab4395 tempest-TestStampPattern-656958745 None] attachment_update completed successfully. Jul 08 01:55:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-fd5b28e0-b299-4487-9a30-238c57f94b8a req-11942e64-51e7-4494-9063-12fcfeed7363 tempest-TestInstancesWithCinderVolumes-108683866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:55:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-fd5b28e0-b299-4487-9a30-238c57f94b8a req-11942e64-51e7-4494-9063-12fcfeed7363 tempest-TestInstancesWithCinderVolumes-108683866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:55:44 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ceb0eb1-23e9-4b1c-a41c-5fd3d52c838f]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:55:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-fd5b28e0-b299-4487-9a30-238c57f94b8a req-11942e64-51e7-4494-9063-12fcfeed7363 tempest-TestInstancesWithCinderVolumes-108683866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e953a563-a0b3-4b57-9c77-fc3f6e9d0409 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:44 devstack sudo[100345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e953a563-a0b3-4b57-9c77-fc3f6e9d0409 Jul 08 01:55:44 devstack sudo[100345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:44 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e3f49c3-7675-49ff-b19c-95cee940ea5f tempest-VolumesDeleteCascade-1588680236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:55:44 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-3e3f49c3-7675-49ff-b19c-95cee940ea5f tempest-VolumesDeleteCascade-1588680236 None] Flow 'volume_create_manager' (ef15f454-8462-490b-a0e6-cd1dcab09352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:55:44 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-3e3f49c3-7675-49ff-b19c-95cee940ea5f tempest-VolumesDeleteCascade-1588680236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4e9f186-2af9-4485-a0ea-e8cde2a6d1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:44 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-3e3f49c3-7675-49ff-b19c-95cee940ea5f tempest-VolumesDeleteCascade-1588680236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4e9f186-2af9-4485-a0ea-e8cde2a6d1b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:55:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1913521983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=179047e6-c40e-4898-9c73-8c46fb26ee03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f0733f155f942dfbbd8d6f06702ee27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:55:44Z,use_quota=True,user_id='67329447c3ce49339701d73eb871f400',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:44 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-3e3f49c3-7675-49ff-b19c-95cee940ea5f tempest-VolumesDeleteCascade-1588680236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89493601-1f79-4766-accd-892988595429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:44 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-3e3f49c3-7675-49ff-b19c-95cee940ea5f tempest-VolumesDeleteCascade-1588680236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89493601-1f79-4766-accd-892988595429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:44 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-3e3f49c3-7675-49ff-b19c-95cee940ea5f tempest-VolumesDeleteCascade-1588680236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fef61764-cabc-4d30-bd6f-3a8d66d6329d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:44 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-3e3f49c3-7675-49ff-b19c-95cee940ea5f tempest-VolumesDeleteCascade-1588680236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fef61764-cabc-4d30-bd6f-3a8d66d6329d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '179047e6-c40e-4898-9c73-8c46fb26ee03', 'volume_name': 'volume-179047e6-c40e-4898-9c73-8c46fb26ee03', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:44 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-3e3f49c3-7675-49ff-b19c-95cee940ea5f tempest-VolumesDeleteCascade-1588680236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baffc58f-a4a3-47ef-acf2-209f5e728eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:44 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-3e3f49c3-7675-49ff-b19c-95cee940ea5f tempest-VolumesDeleteCascade-1588680236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baffc58f-a4a3-47ef-acf2-209f5e728eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:44 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-3e3f49c3-7675-49ff-b19c-95cee940ea5f tempest-VolumesDeleteCascade-1588680236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b0db11d-28bb-41f3-b8d6-300240f53582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:44 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-3e3f49c3-7675-49ff-b19c-95cee940ea5f tempest-VolumesDeleteCascade-1588680236 None] Volume 179047e6-c40e-4898-9c73-8c46fb26ee03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-179047e6-c40e-4898-9c73-8c46fb26ee03', 'volume_size': 1} Jul 08 01:55:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-3e3f49c3-7675-49ff-b19c-95cee940ea5f tempest-VolumesDeleteCascade-1588680236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:55:44 devstack sudo[100345]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-fd5b28e0-b299-4487-9a30-238c57f94b8a req-11942e64-51e7-4494-9063-12fcfeed7363 tempest-TestInstancesWithCinderVolumes-108683866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e953a563-a0b3-4b57-9c77-fc3f6e9d0409" returned: 0 in 0.789s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-fd5b28e0-b299-4487-9a30-238c57f94b8a req-11942e64-51e7-4494-9063-12fcfeed7363 tempest-TestInstancesWithCinderVolumes-108683866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.805s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:55:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-3e3f49c3-7675-49ff-b19c-95cee940ea5f tempest-VolumesDeleteCascade-1588680236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.385s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:55:44 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-3e3f49c3-7675-49ff-b19c-95cee940ea5f tempest-VolumesDeleteCascade-1588680236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:55:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1913521983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=179047e6-c40e-4898-9c73-8c46fb26ee03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f0733f155f942dfbbd8d6f06702ee27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:55:44Z,use_quota=True,user_id='67329447c3ce49339701d73eb871f400',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:55:44 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-3e3f49c3-7675-49ff-b19c-95cee940ea5f tempest-VolumesDeleteCascade-1588680236 None] Creating volume 179047e6-c40e-4898-9c73-8c46fb26ee03 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:55:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-3e3f49c3-7675-49ff-b19c-95cee940ea5f tempest-VolumesDeleteCascade-1588680236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:55:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-3e3f49c3-7675-49ff-b19c-95cee940ea5f tempest-VolumesDeleteCascade-1588680236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:55:44 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-3e3f49c3-7675-49ff-b19c-95cee940ea5f tempest-VolumesDeleteCascade-1588680236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:55:44 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-3e3f49c3-7675-49ff-b19c-95cee940ea5f tempest-VolumesDeleteCascade-1588680236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:55:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-3e3f49c3-7675-49ff-b19c-95cee940ea5f tempest-VolumesDeleteCascade-1588680236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:55:44 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-3e3f49c3-7675-49ff-b19c-95cee940ea5f tempest-VolumesDeleteCascade-1588680236 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:55:44 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-3e3f49c3-7675-49ff-b19c-95cee940ea5f tempest-VolumesDeleteCascade-1588680236 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:55:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-3e3f49c3-7675-49ff-b19c-95cee940ea5f tempest-VolumesDeleteCascade-1588680236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:44 devstack sudo[100350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03 1073741824 Jul 08 01:55:44 devstack sudo[100350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:44 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [req-fd5b28e0-b299-4487-9a30-238c57f94b8a req-11942e64-51e7-4494-9063-12fcfeed7363 tempest-TestInstancesWithCinderVolumes-108683866 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17', 'name': 'volume-e953a563-a0b3-4b57-9c77-fc3f6e9d0409', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '48daa828-f4a6-4ba9-ae0d-f622f3055edd', 'enforce_multipath': True} {{(pid=87134) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:55:45 devstack cinder-volume[87134]: INFO cinder.volume.manager [req-fd5b28e0-b299-4487-9a30-238c57f94b8a req-11942e64-51e7-4494-9063-12fcfeed7363 tempest-TestInstancesWithCinderVolumes-108683866 None] attachment_update completed successfully. Jul 08 01:55:45 devstack sudo[100350]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-3e3f49c3-7675-49ff-b19c-95cee940ea5f tempest-VolumesDeleteCascade-1588680236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03 1073741824" returned: 0 in 0.956s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-3e3f49c3-7675-49ff-b19c-95cee940ea5f tempest-VolumesDeleteCascade-1588680236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:46 devstack sudo[100358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03 Jul 08 01:55:46 devstack sudo[100358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:46 devstack sudo[100358]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-3e3f49c3-7675-49ff-b19c-95cee940ea5f tempest-VolumesDeleteCascade-1588680236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03" returned: 0 in 0.722s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:46 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-3e3f49c3-7675-49ff-b19c-95cee940ea5f tempest-VolumesDeleteCascade-1588680236 None] <== create_volume: return (1833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:55:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-3e3f49c3-7675-49ff-b19c-95cee940ea5f tempest-VolumesDeleteCascade-1588680236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.836s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:55:46 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-3e3f49c3-7675-49ff-b19c-95cee940ea5f tempest-VolumesDeleteCascade-1588680236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b0db11d-28bb-41f3-b8d6-300240f53582) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-179047e6-c40e-4898-9c73-8c46fb26ee03', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:46 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-3e3f49c3-7675-49ff-b19c-95cee940ea5f tempest-VolumesDeleteCascade-1588680236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b909ebd3-a304-4017-813c-e2b01e87d974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:55:46 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-3e3f49c3-7675-49ff-b19c-95cee940ea5f tempest-VolumesDeleteCascade-1588680236 None] Volume volume-179047e6-c40e-4898-9c73-8c46fb26ee03 (179047e6-c40e-4898-9c73-8c46fb26ee03): created successfully Jul 08 01:55:46 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-3e3f49c3-7675-49ff-b19c-95cee940ea5f tempest-VolumesDeleteCascade-1588680236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b909ebd3-a304-4017-813c-e2b01e87d974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:55:46 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-3e3f49c3-7675-49ff-b19c-95cee940ea5f tempest-VolumesDeleteCascade-1588680236 None] Flow 'volume_create_manager' (ef15f454-8462-490b-a0e6-cd1dcab09352) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:55:46 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-3e3f49c3-7675-49ff-b19c-95cee940ea5f tempest-VolumesDeleteCascade-1588680236 None] Created volume successfully. Jul 08 01:55:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-ea29276d-88da-4f8e-9e72-22fc20dea1b2 tempest-VolumesDeleteCascade-1588680236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:55:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-ea29276d-88da-4f8e-9e72-22fc20dea1b2 tempest-VolumesDeleteCascade-1588680236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:55:47 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-ea29276d-88da-4f8e-9e72-22fc20dea1b2 tempest-VolumesDeleteCascade-1588680236 None] Creating offline snapshot 4dca7fee-1bec-4d54-bc1e-26c5a91c8db5 of volume 179047e6-c40e-4898-9c73-8c46fb26ee03 {{(pid=87134) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:55:47 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b1909f-21b3-46fa-9fc3-cdb74bed1971]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:55:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ea29276d-88da-4f8e-9e72-22fc20dea1b2 tempest-VolumesDeleteCascade-1588680236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:47 devstack sudo[100371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03 Jul 08 01:55:47 devstack sudo[100371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:48 devstack sudo[100371]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ea29276d-88da-4f8e-9e72-22fc20dea1b2 tempest-VolumesDeleteCascade-1588680236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03" returned: 0 in 0.851s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ea29276d-88da-4f8e-9e72-22fc20dea1b2 tempest-VolumesDeleteCascade-1588680236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03.4dca7fee-1bec-4d54-bc1e-26c5a91c8db5 1G {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:48 devstack sudo[100384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03.4dca7fee-1bec-4d54-bc1e-26c5a91c8db5 1G Jul 08 01:55:48 devstack sudo[100384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:49 devstack sudo[100384]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:49 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ea29276d-88da-4f8e-9e72-22fc20dea1b2 tempest-VolumesDeleteCascade-1588680236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03.4dca7fee-1bec-4d54-bc1e-26c5a91c8db5 1G" returned: 0 in 0.950s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:49 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ea29276d-88da-4f8e-9e72-22fc20dea1b2 tempest-VolumesDeleteCascade-1588680236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-179047e6-c40e-4898-9c73-8c46fb26ee03 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03.4dca7fee-1bec-4d54-bc1e-26c5a91c8db5 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:49 devstack sudo[100400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-179047e6-c40e-4898-9c73-8c46fb26ee03 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03.4dca7fee-1bec-4d54-bc1e-26c5a91c8db5 Jul 08 01:55:49 devstack sudo[100400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:50 devstack sudo[100400]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:50 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ea29276d-88da-4f8e-9e72-22fc20dea1b2 tempest-VolumesDeleteCascade-1588680236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-179047e6-c40e-4898-9c73-8c46fb26ee03 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03.4dca7fee-1bec-4d54-bc1e-26c5a91c8db5" returned: 0 in 0.713s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:50 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-ea29276d-88da-4f8e-9e72-22fc20dea1b2 tempest-VolumesDeleteCascade-1588680236 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03.4dca7fee-1bec-4d54-bc1e-26c5a91c8db5 is being set with open permissions: ugo+rw Jul 08 01:55:50 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ea29276d-88da-4f8e-9e72-22fc20dea1b2 tempest-VolumesDeleteCascade-1588680236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03.4dca7fee-1bec-4d54-bc1e-26c5a91c8db5 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:50 devstack sudo[100405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03.4dca7fee-1bec-4d54-bc1e-26c5a91c8db5 Jul 08 01:55:50 devstack sudo[100405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:50 devstack cinder-volume[87134]: INFO cinder.volume.manager [req-0c620a9d-7103-4f22-960f-0d96d058925d req-21def114-388b-40c6-a3cd-286323de27e1 tempest-TestStampPattern-656958745 None] Terminate volume connection completed successfully. Jul 08 01:55:50 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [req-0c620a9d-7103-4f22-960f-0d96d058925d req-21def114-388b-40c6-a3cd-286323de27e1 tempest-TestStampPattern-656958745 None] Deleting attachment 6658a9ef-2b0f-4cf8-b17a-51522bbe519d. {{(pid=87134) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:55:51 devstack sudo[100405]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ea29276d-88da-4f8e-9e72-22fc20dea1b2 tempest-VolumesDeleteCascade-1588680236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03.4dca7fee-1bec-4d54-bc1e-26c5a91c8db5" returned: 0 in 0.673s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ea29276d-88da-4f8e-9e72-22fc20dea1b2 tempest-VolumesDeleteCascade-1588680236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:51 devstack sudo[100410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03.info Jul 08 01:55:51 devstack sudo[100410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:51 devstack sudo[100410]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ea29276d-88da-4f8e-9e72-22fc20dea1b2 tempest-VolumesDeleteCascade-1588680236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03.info" returned: 0 in 0.732s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:51 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-ea29276d-88da-4f8e-9e72-22fc20dea1b2 tempest-VolumesDeleteCascade-1588680236 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03.info is being set with open permissions: ugo+rw Jul 08 01:55:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ea29276d-88da-4f8e-9e72-22fc20dea1b2 tempest-VolumesDeleteCascade-1588680236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:51 devstack sudo[100413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03.info Jul 08 01:55:51 devstack sudo[100413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:52 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-bd076b02-20e4-4127-861c-615d4bd0b16e req-dc3af4ff-3cdc-40d3-bf6b-8957c8e2cdfa tempest-TestInstancesWithCinderVolumes-108683866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:55:52 devstack sudo[100413]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:52 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ea29276d-88da-4f8e-9e72-22fc20dea1b2 tempest-VolumesDeleteCascade-1588680236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03.info" returned: 0 in 0.681s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:52 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-ea29276d-88da-4f8e-9e72-22fc20dea1b2 tempest-VolumesDeleteCascade-1588680236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.699s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:55:52 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-bd076b02-20e4-4127-861c-615d4bd0b16e req-dc3af4ff-3cdc-40d3-bf6b-8957c8e2cdfa tempest-TestInstancesWithCinderVolumes-108683866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.110s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:55:52 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[327d12f1-d850-4a19-95d5-58542b1153d3]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:55:52 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-bd076b02-20e4-4127-861c-615d4bd0b16e req-dc3af4ff-3cdc-40d3-bf6b-8957c8e2cdfa tempest-TestInstancesWithCinderVolumes-108683866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-cc1d83f7-0539-4c7c-ab36-b9902bb10a9b {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:52 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-ea29276d-88da-4f8e-9e72-22fc20dea1b2 tempest-VolumesDeleteCascade-1588680236 None] Create snapshot completed successfully Jul 08 01:55:52 devstack sudo[100424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-cc1d83f7-0539-4c7c-ab36-b9902bb10a9b Jul 08 01:55:52 devstack sudo[100424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:52 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-4e0aca1c-e0a6-4d8f-896f-00e3b707321a tempest-TestStampPattern-656958745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:55:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-2c0112b5-54a0-48b7-904a-c28fa5422a41 tempest-VolumesDeleteCascade-1588680236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:55:53 devstack sudo[100424]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-bd076b02-20e4-4127-861c-615d4bd0b16e req-dc3af4ff-3cdc-40d3-bf6b-8957c8e2cdfa tempest-TestInstancesWithCinderVolumes-108683866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-cc1d83f7-0539-4c7c-ab36-b9902bb10a9b" returned: 0 in 0.888s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-bd076b02-20e4-4127-861c-615d4bd0b16e req-dc3af4ff-3cdc-40d3-bf6b-8957c8e2cdfa tempest-TestInstancesWithCinderVolumes-108683866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.910s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:55:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-4e0aca1c-e0a6-4d8f-896f-00e3b707321a tempest-TestStampPattern-656958745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.497s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:55:53 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-4e0aca1c-e0a6-4d8f-896f-00e3b707321a tempest-TestStampPattern-656958745 None] Creating offline snapshot 75b26816-905f-4743-acd3-4e9f4b095dd3 of volume 773e60c8-acd6-407d-afee-1c1a06403187 {{(pid=87134) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:55:53 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[f97f2a58-785c-4c3b-b378-3540473260ce]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:55:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4e0aca1c-e0a6-4d8f-896f-00e3b707321a tempest-TestStampPattern-656958745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-773e60c8-acd6-407d-afee-1c1a06403187 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:53 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [req-bd076b02-20e4-4127-861c-615d4bd0b16e req-dc3af4ff-3cdc-40d3-bf6b-8957c8e2cdfa tempest-TestInstancesWithCinderVolumes-108683866 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17', 'name': 'volume-cc1d83f7-0539-4c7c-ab36-b9902bb10a9b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a4465b7f-625e-4d9b-8df6-20d0baf613c7', 'enforce_multipath': True} {{(pid=87134) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:55:53 devstack cinder-volume[87134]: INFO cinder.volume.manager [req-bd076b02-20e4-4127-861c-615d4bd0b16e req-dc3af4ff-3cdc-40d3-bf6b-8957c8e2cdfa tempest-TestInstancesWithCinderVolumes-108683866 None] attachment_update completed successfully. Jul 08 01:55:53 devstack sudo[100430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-773e60c8-acd6-407d-afee-1c1a06403187 Jul 08 01:55:53 devstack sudo[100430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:54 devstack sudo[100430]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4e0aca1c-e0a6-4d8f-896f-00e3b707321a tempest-TestStampPattern-656958745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-773e60c8-acd6-407d-afee-1c1a06403187" returned: 0 in 0.815s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4e0aca1c-e0a6-4d8f-896f-00e3b707321a tempest-TestStampPattern-656958745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-773e60c8-acd6-407d-afee-1c1a06403187,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-773e60c8-acd6-407d-afee-1c1a06403187.75b26816-905f-4743-acd3-4e9f4b095dd3 1G {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:54 devstack sudo[100437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-773e60c8-acd6-407d-afee-1c1a06403187,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-773e60c8-acd6-407d-afee-1c1a06403187.75b26816-905f-4743-acd3-4e9f4b095dd3 1G Jul 08 01:55:54 devstack sudo[100437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:55 devstack sudo[100437]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:55 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4e0aca1c-e0a6-4d8f-896f-00e3b707321a tempest-TestStampPattern-656958745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-773e60c8-acd6-407d-afee-1c1a06403187,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-773e60c8-acd6-407d-afee-1c1a06403187.75b26816-905f-4743-acd3-4e9f4b095dd3 1G" returned: 0 in 0.877s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:55 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4e0aca1c-e0a6-4d8f-896f-00e3b707321a tempest-TestStampPattern-656958745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-773e60c8-acd6-407d-afee-1c1a06403187 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-773e60c8-acd6-407d-afee-1c1a06403187.75b26816-905f-4743-acd3-4e9f4b095dd3 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:55 devstack sudo[100443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-773e60c8-acd6-407d-afee-1c1a06403187 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-773e60c8-acd6-407d-afee-1c1a06403187.75b26816-905f-4743-acd3-4e9f4b095dd3 Jul 08 01:55:55 devstack sudo[100443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:55 devstack sudo[100443]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:55 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4e0aca1c-e0a6-4d8f-896f-00e3b707321a tempest-TestStampPattern-656958745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-773e60c8-acd6-407d-afee-1c1a06403187 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-773e60c8-acd6-407d-afee-1c1a06403187.75b26816-905f-4743-acd3-4e9f4b095dd3" returned: 0 in 0.755s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:55 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-4e0aca1c-e0a6-4d8f-896f-00e3b707321a tempest-TestStampPattern-656958745 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-773e60c8-acd6-407d-afee-1c1a06403187.75b26816-905f-4743-acd3-4e9f4b095dd3 is being set with open permissions: ugo+rw Jul 08 01:55:55 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4e0aca1c-e0a6-4d8f-896f-00e3b707321a tempest-TestStampPattern-656958745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-773e60c8-acd6-407d-afee-1c1a06403187.75b26816-905f-4743-acd3-4e9f4b095dd3 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:55 devstack sudo[100448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-773e60c8-acd6-407d-afee-1c1a06403187.75b26816-905f-4743-acd3-4e9f4b095dd3 Jul 08 01:55:55 devstack sudo[100448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:56 devstack sudo[100448]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:56 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4e0aca1c-e0a6-4d8f-896f-00e3b707321a tempest-TestStampPattern-656958745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-773e60c8-acd6-407d-afee-1c1a06403187.75b26816-905f-4743-acd3-4e9f4b095dd3" returned: 0 in 0.701s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:56 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4e0aca1c-e0a6-4d8f-896f-00e3b707321a tempest-TestStampPattern-656958745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-773e60c8-acd6-407d-afee-1c1a06403187.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:56 devstack sudo[100451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-773e60c8-acd6-407d-afee-1c1a06403187.info Jul 08 01:55:56 devstack sudo[100451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:57 devstack sudo[100451]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:57 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4e0aca1c-e0a6-4d8f-896f-00e3b707321a tempest-TestStampPattern-656958745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-773e60c8-acd6-407d-afee-1c1a06403187.info" returned: 0 in 0.719s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:57 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-4e0aca1c-e0a6-4d8f-896f-00e3b707321a tempest-TestStampPattern-656958745 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-773e60c8-acd6-407d-afee-1c1a06403187.info is being set with open permissions: ugo+rw Jul 08 01:55:57 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4e0aca1c-e0a6-4d8f-896f-00e3b707321a tempest-TestStampPattern-656958745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-773e60c8-acd6-407d-afee-1c1a06403187.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:57 devstack sudo[100454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-773e60c8-acd6-407d-afee-1c1a06403187.info Jul 08 01:55:57 devstack sudo[100454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:58 devstack sudo[100454]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:58 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4e0aca1c-e0a6-4d8f-896f-00e3b707321a tempest-TestStampPattern-656958745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-773e60c8-acd6-407d-afee-1c1a06403187.info" returned: 0 in 0.664s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:58 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-4e0aca1c-e0a6-4d8f-896f-00e3b707321a tempest-TestStampPattern-656958745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.628s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:55:58 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-2c0112b5-54a0-48b7-904a-c28fa5422a41 tempest-VolumesDeleteCascade-1588680236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.865s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:55:58 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-2c0112b5-54a0-48b7-904a-c28fa5422a41 tempest-VolumesDeleteCascade-1588680236 None] Creating offline snapshot b3f719dd-29a3-49a2-b8ee-3a084ff3957f of volume 179047e6-c40e-4898-9c73-8c46fb26ee03 {{(pid=87134) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:55:58 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[f442db21-099f-496c-9a47-d3438660bee7]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:55:58 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2c0112b5-54a0-48b7-904a-c28fa5422a41 tempest-VolumesDeleteCascade-1588680236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03.4dca7fee-1bec-4d54-bc1e-26c5a91c8db5 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:58 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-4e0aca1c-e0a6-4d8f-896f-00e3b707321a tempest-TestStampPattern-656958745 None] Create snapshot completed successfully Jul 08 01:55:58 devstack sudo[100465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03.4dca7fee-1bec-4d54-bc1e-26c5a91c8db5 Jul 08 01:55:58 devstack sudo[100465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:55:59 devstack sudo[100465]: pam_unix(sudo:session): session closed for user root Jul 08 01:55:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2c0112b5-54a0-48b7-904a-c28fa5422a41 tempest-VolumesDeleteCascade-1588680236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03.4dca7fee-1bec-4d54-bc1e-26c5a91c8db5" returned: 0 in 0.932s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:55:59 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-2c0112b5-54a0-48b7-904a-c28fa5422a41 tempest-VolumesDeleteCascade-1588680236 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-179047e6-c40e-4898-9c73-8c46fb26ee03(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:55:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2c0112b5-54a0-48b7-904a-c28fa5422a41 tempest-VolumesDeleteCascade-1588680236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03.4dca7fee-1bec-4d54-bc1e-26c5a91c8db5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03.b3f719dd-29a3-49a2-b8ee-3a084ff3957f 1G {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:55:59 devstack sudo[100470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03.4dca7fee-1bec-4d54-bc1e-26c5a91c8db5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03.b3f719dd-29a3-49a2-b8ee-3a084ff3957f 1G Jul 08 01:55:59 devstack sudo[100470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:00 devstack sudo[100470]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2c0112b5-54a0-48b7-904a-c28fa5422a41 tempest-VolumesDeleteCascade-1588680236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03.4dca7fee-1bec-4d54-bc1e-26c5a91c8db5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03.b3f719dd-29a3-49a2-b8ee-3a084ff3957f 1G" returned: 0 in 1.036s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2c0112b5-54a0-48b7-904a-c28fa5422a41 tempest-VolumesDeleteCascade-1588680236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-179047e6-c40e-4898-9c73-8c46fb26ee03.4dca7fee-1bec-4d54-bc1e-26c5a91c8db5 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03.b3f719dd-29a3-49a2-b8ee-3a084ff3957f {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:00 devstack sudo[100480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-179047e6-c40e-4898-9c73-8c46fb26ee03.4dca7fee-1bec-4d54-bc1e-26c5a91c8db5 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03.b3f719dd-29a3-49a2-b8ee-3a084ff3957f Jul 08 01:56:00 devstack sudo[100480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:01 devstack sudo[100480]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2c0112b5-54a0-48b7-904a-c28fa5422a41 tempest-VolumesDeleteCascade-1588680236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-179047e6-c40e-4898-9c73-8c46fb26ee03.4dca7fee-1bec-4d54-bc1e-26c5a91c8db5 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03.b3f719dd-29a3-49a2-b8ee-3a084ff3957f" returned: 0 in 0.906s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:01 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-2c0112b5-54a0-48b7-904a-c28fa5422a41 tempest-VolumesDeleteCascade-1588680236 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03.b3f719dd-29a3-49a2-b8ee-3a084ff3957f is being set with open permissions: ugo+rw Jul 08 01:56:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2c0112b5-54a0-48b7-904a-c28fa5422a41 tempest-VolumesDeleteCascade-1588680236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03.b3f719dd-29a3-49a2-b8ee-3a084ff3957f {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:01 devstack sudo[100500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03.b3f719dd-29a3-49a2-b8ee-3a084ff3957f Jul 08 01:56:01 devstack sudo[100500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:01 devstack sudo[100500]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2c0112b5-54a0-48b7-904a-c28fa5422a41 tempest-VolumesDeleteCascade-1588680236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03.b3f719dd-29a3-49a2-b8ee-3a084ff3957f" returned: 0 in 0.824s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-2c0112b5-54a0-48b7-904a-c28fa5422a41 tempest-VolumesDeleteCascade-1588680236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.819s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:56:01 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-2c0112b5-54a0-48b7-904a-c28fa5422a41 tempest-VolumesDeleteCascade-1588680236 None] Create snapshot completed successfully Jul 08 01:56:02 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-bfd74b38-4429-4dd1-834b-029468661803 tempest-VolumesDeleteCascade-1588680236 None] Acquiring lock "cinder-179047e6-c40e-4898-9c73-8c46fb26ee03-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:56:02 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-bfd74b38-4429-4dd1-834b-029468661803 tempest-VolumesDeleteCascade-1588680236 None] Lock "cinder-179047e6-c40e-4898-9c73-8c46fb26ee03-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:56:02 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-bfd74b38-4429-4dd1-834b-029468661803 tempest-VolumesDeleteCascade-1588680236 None] Performing cascade delete. {{(pid=87134) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 08 01:56:02 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-bfd74b38-4429-4dd1-834b-029468661803 tempest-VolumesDeleteCascade-1588680236 None] Acquiring lock "cinder-4dca7fee-1bec-4d54-bc1e-26c5a91c8db5-delete_snapshot" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:56:02 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-bfd74b38-4429-4dd1-834b-029468661803 tempest-VolumesDeleteCascade-1588680236 None] Lock "cinder-4dca7fee-1bec-4d54-bc1e-26c5a91c8db5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:56:02 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-bfd74b38-4429-4dd1-834b-029468661803 tempest-VolumesDeleteCascade-1588680236 None] Acquiring lock "cinder-quobyte-179047e6-c40e-4898-9c73-8c46fb26ee03" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:56:02 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-bfd74b38-4429-4dd1-834b-029468661803 tempest-VolumesDeleteCascade-1588680236 None] Lock "cinder-quobyte-179047e6-c40e-4898-9c73-8c46fb26ee03" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:56:02 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-bfd74b38-4429-4dd1-834b-029468661803 tempest-VolumesDeleteCascade-1588680236 None] Acquiring lock "cinder-quobyte-4dca7fee-1bec-4d54-bc1e-26c5a91c8db5" by "_delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:56:02 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-bfd74b38-4429-4dd1-834b-029468661803 tempest-VolumesDeleteCascade-1588680236 None] Lock "cinder-quobyte-4dca7fee-1bec-4d54-bc1e-26c5a91c8db5" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:56:02 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-bfd74b38-4429-4dd1-834b-029468661803 tempest-VolumesDeleteCascade-1588680236 None] Deleting offline snapshot 4dca7fee-1bec-4d54-bc1e-26c5a91c8db5 of volume 179047e6-c40e-4898-9c73-8c46fb26ee03 {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:56:02 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-bfd74b38-4429-4dd1-834b-029468661803 tempest-VolumesDeleteCascade-1588680236 None] snapshot_file for this snap is: volume-179047e6-c40e-4898-9c73-8c46fb26ee03.4dca7fee-1bec-4d54-bc1e-26c5a91c8db5 {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:56:02 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[e23522a5-c0d4-45e6-aa4a-11d643f8df24]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:56:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-bfd74b38-4429-4dd1-834b-029468661803 tempest-VolumesDeleteCascade-1588680236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03.4dca7fee-1bec-4d54-bc1e-26c5a91c8db5 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:03 devstack sudo[100509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03.4dca7fee-1bec-4d54-bc1e-26c5a91c8db5 Jul 08 01:56:03 devstack sudo[100509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:03 devstack cinder-volume[87134]: INFO cinder.volume.manager [req-98872f5a-62b5-4c2d-a256-f89607b71142 req-f5da9cd7-faef-480b-85c8-1e0f7dcf0a5a tempest-TestInstancesWithCinderVolumes-108683866 None] Terminate volume connection completed successfully. Jul 08 01:56:03 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [req-98872f5a-62b5-4c2d-a256-f89607b71142 req-f5da9cd7-faef-480b-85c8-1e0f7dcf0a5a tempest-TestInstancesWithCinderVolumes-108683866 None] Deleting attachment 48daa828-f4a6-4ba9-ae0d-f622f3055edd. {{(pid=87134) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:56:03 devstack sudo[100509]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:03 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-bfd74b38-4429-4dd1-834b-029468661803 tempest-VolumesDeleteCascade-1588680236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03.4dca7fee-1bec-4d54-bc1e-26c5a91c8db5" returned: 0 in 0.850s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:03 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-bfd74b38-4429-4dd1-834b-029468661803 tempest-VolumesDeleteCascade-1588680236 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-179047e6-c40e-4898-9c73-8c46fb26ee03(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:56:03 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8e5901-6795-4d3b-bc9a-f014d757d0df]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:56:03 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-bfd74b38-4429-4dd1-834b-029468661803 tempest-VolumesDeleteCascade-1588680236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:03 devstack sudo[100520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03 Jul 08 01:56:03 devstack sudo[100520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:04 devstack sudo[100520]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:04 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-bfd74b38-4429-4dd1-834b-029468661803 tempest-VolumesDeleteCascade-1588680236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03" returned: 0 in 0.920s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:04 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec13d01-d860-4fa7-92d5-f8d2294d9fdd]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:56:04 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-bfd74b38-4429-4dd1-834b-029468661803 tempest-VolumesDeleteCascade-1588680236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03.b3f719dd-29a3-49a2-b8ee-3a084ff3957f {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:05 devstack sudo[100552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03.b3f719dd-29a3-49a2-b8ee-3a084ff3957f Jul 08 01:56:05 devstack sudo[100552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:05 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-b9847909-a599-40b0-b2f0-8e52c1835e74 tempest-TestInstancesWithCinderVolumes-108683866 None] Acquiring lock "cinder-e953a563-a0b3-4b57-9c77-fc3f6e9d0409-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:56:05 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-b9847909-a599-40b0-b2f0-8e52c1835e74 tempest-TestInstancesWithCinderVolumes-108683866 None] Lock "cinder-e953a563-a0b3-4b57-9c77-fc3f6e9d0409-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:56:05 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-b9847909-a599-40b0-b2f0-8e52c1835e74 tempest-TestInstancesWithCinderVolumes-108683866 None] Acquiring lock "cinder-quobyte-e953a563-a0b3-4b57-9c77-fc3f6e9d0409" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:56:05 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-b9847909-a599-40b0-b2f0-8e52c1835e74 tempest-TestInstancesWithCinderVolumes-108683866 None] Lock "cinder-quobyte-e953a563-a0b3-4b57-9c77-fc3f6e9d0409" acquired by "delete_volume" :: waited 0.019s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:56:05 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e9d602-7769-4d55-8190-e2b54aaba0b7]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:56:05 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b9847909-a599-40b0-b2f0-8e52c1835e74 tempest-TestInstancesWithCinderVolumes-108683866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e953a563-a0b3-4b57-9c77-fc3f6e9d0409 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:05 devstack sudo[100558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e953a563-a0b3-4b57-9c77-fc3f6e9d0409 Jul 08 01:56:05 devstack sudo[100558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:05 devstack sudo[100552]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:05 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-bfd74b38-4429-4dd1-834b-029468661803 tempest-VolumesDeleteCascade-1588680236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03.b3f719dd-29a3-49a2-b8ee-3a084ff3957f" returned: 0 in 1.115s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:05 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-bfd74b38-4429-4dd1-834b-029468661803 tempest-VolumesDeleteCascade-1588680236 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-179047e6-c40e-4898-9c73-8c46fb26ee03(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:56:05 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5dfa570-f105-4524-a967-d58e4916c220]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:56:05 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-bfd74b38-4429-4dd1-834b-029468661803 tempest-VolumesDeleteCascade-1588680236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03.4dca7fee-1bec-4d54-bc1e-26c5a91c8db5 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:06 devstack sudo[100563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03.4dca7fee-1bec-4d54-bc1e-26c5a91c8db5 Jul 08 01:56:06 devstack sudo[100563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:06 devstack sudo[100558]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:06 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b9847909-a599-40b0-b2f0-8e52c1835e74 tempest-TestInstancesWithCinderVolumes-108683866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e953a563-a0b3-4b57-9c77-fc3f6e9d0409" returned: 0 in 0.998s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:06 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b9847909-a599-40b0-b2f0-8e52c1835e74 tempest-TestInstancesWithCinderVolumes-108683866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e953a563-a0b3-4b57-9c77-fc3f6e9d0409 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:06 devstack sudo[100568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e953a563-a0b3-4b57-9c77-fc3f6e9d0409 Jul 08 01:56:06 devstack sudo[100568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:07 devstack sudo[100563]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:07 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-bfd74b38-4429-4dd1-834b-029468661803 tempest-VolumesDeleteCascade-1588680236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03.4dca7fee-1bec-4d54-bc1e-26c5a91c8db5" returned: 0 in 1.078s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:07 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-bfd74b38-4429-4dd1-834b-029468661803 tempest-VolumesDeleteCascade-1588680236 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-179047e6-c40e-4898-9c73-8c46fb26ee03(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:56:07 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d7685e7-a38f-49fc-946b-7fd856edd363]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:56:07 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-bfd74b38-4429-4dd1-834b-029468661803 tempest-VolumesDeleteCascade-1588680236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:07 devstack sudo[100568]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:07 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b9847909-a599-40b0-b2f0-8e52c1835e74 tempest-TestInstancesWithCinderVolumes-108683866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e953a563-a0b3-4b57-9c77-fc3f6e9d0409" returned: 0 in 0.776s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:07 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-b9847909-a599-40b0-b2f0-8e52c1835e74 tempest-TestInstancesWithCinderVolumes-108683866 None] Lock "cinder-quobyte-e953a563-a0b3-4b57-9c77-fc3f6e9d0409" released by "delete_volume" :: held 1.828s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:56:07 devstack cinder-volume[87134]: WARNING cinder.quota [None req-b9847909-a599-40b0-b2f0-8e52c1835e74 tempest-TestInstancesWithCinderVolumes-108683866 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-666576521-1639324303 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-666576521-1639324303, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:56:07 devstack cinder-volume[87134]: WARNING cinder.quota [None req-b9847909-a599-40b0-b2f0-8e52c1835e74 tempest-TestInstancesWithCinderVolumes-108683866 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-666576521-1639324303 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-666576521-1639324303, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:56:07 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-b9847909-a599-40b0-b2f0-8e52c1835e74 tempest-TestInstancesWithCinderVolumes-108683866 None] Created reservations ['e2034833-939e-4fb8-afd8-ff49cd8a64e2', '33c0b77c-ed03-459d-bd59-9380a7db39c9', 'f04da5e1-05d8-42dd-9b11-8cebc6bd046a', 'b72d6b4f-4145-46d7-889a-3d840e0ad3a3'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:56:07 devstack sudo[100574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03 Jul 08 01:56:07 devstack sudo[100574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:07 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b9847909-a599-40b0-b2f0-8e52c1835e74 tempest-TestInstancesWithCinderVolumes-108683866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:56:07 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b9847909-a599-40b0-b2f0-8e52c1835e74 tempest-TestInstancesWithCinderVolumes-108683866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:56:07 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-b9847909-a599-40b0-b2f0-8e52c1835e74 tempest-TestInstancesWithCinderVolumes-108683866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:56:07 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-b9847909-a599-40b0-b2f0-8e52c1835e74 tempest-TestInstancesWithCinderVolumes-108683866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:56:07 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b9847909-a599-40b0-b2f0-8e52c1835e74 tempest-TestInstancesWithCinderVolumes-108683866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:56:07 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b9847909-a599-40b0-b2f0-8e52c1835e74 tempest-TestInstancesWithCinderVolumes-108683866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:07 devstack sudo[100576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:56:07 devstack sudo[100576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:08 devstack sudo[100576]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:08 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b9847909-a599-40b0-b2f0-8e52c1835e74 tempest-TestInstancesWithCinderVolumes-108683866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.751s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:08 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-b9847909-a599-40b0-b2f0-8e52c1835e74 tempest-TestInstancesWithCinderVolumes-108683866 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:56:08 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-b9847909-a599-40b0-b2f0-8e52c1835e74 tempest-TestInstancesWithCinderVolumes-108683866 None] Deleted volume successfully. Jul 08 01:56:08 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-b9847909-a599-40b0-b2f0-8e52c1835e74 tempest-TestInstancesWithCinderVolumes-108683866 None] Lock "cinder-e953a563-a0b3-4b57-9c77-fc3f6e9d0409-delete_volume" released by "delete_volume" :: held 2.925s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:56:08 devstack sudo[100574]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:08 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-bfd74b38-4429-4dd1-834b-029468661803 tempest-VolumesDeleteCascade-1588680236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03" returned: 0 in 1.076s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:08 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-bfd74b38-4429-4dd1-834b-029468661803 tempest-VolumesDeleteCascade-1588680236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03.4dca7fee-1bec-4d54-bc1e-26c5a91c8db5 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:08 devstack sudo[100591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03.4dca7fee-1bec-4d54-bc1e-26c5a91c8db5 Jul 08 01:56:08 devstack sudo[100591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:09 devstack sudo[100591]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:09 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-bfd74b38-4429-4dd1-834b-029468661803 tempest-VolumesDeleteCascade-1588680236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03.4dca7fee-1bec-4d54-bc1e-26c5a91c8db5" returned: 0 in 1.094s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:09 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-bfd74b38-4429-4dd1-834b-029468661803 tempest-VolumesDeleteCascade-1588680236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03.4dca7fee-1bec-4d54-bc1e-26c5a91c8db5 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:09 devstack sudo[100618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03.4dca7fee-1bec-4d54-bc1e-26c5a91c8db5 Jul 08 01:56:09 devstack sudo[100618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:09 devstack sudo[100618]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:09 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-bfd74b38-4429-4dd1-834b-029468661803 tempest-VolumesDeleteCascade-1588680236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03.4dca7fee-1bec-4d54-bc1e-26c5a91c8db5" returned: 0 in 0.701s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:09 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-bfd74b38-4429-4dd1-834b-029468661803 tempest-VolumesDeleteCascade-1588680236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-179047e6-c40e-4898-9c73-8c46fb26ee03 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03.b3f719dd-29a3-49a2-b8ee-3a084ff3957f -F qcow2 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:09 devstack sudo[100621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-179047e6-c40e-4898-9c73-8c46fb26ee03 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03.b3f719dd-29a3-49a2-b8ee-3a084ff3957f -F qcow2 Jul 08 01:56:09 devstack sudo[100621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:10 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-82476331-39ba-478a-b01a-c8d86825b296 tempest-TestStampPattern-656958745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:56:10 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-82476331-39ba-478a-b01a-c8d86825b296 tempest-TestStampPattern-656958745 None] Flow 'volume_create_manager' (03a46bcf-4907-446d-a10d-c666dc2571da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:56:10 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-82476331-39ba-478a-b01a-c8d86825b296 tempest-TestStampPattern-656958745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4d8c227-d0d4-4b66-9ce8-b46c87b7cc3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:10 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-82476331-39ba-478a-b01a-c8d86825b296 tempest-TestStampPattern-656958745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4d8c227-d0d4-4b66-9ce8-b46c87b7cc3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:56:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1116691033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fe5bef5-2586-484c-93c0-6604c1e3a220,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f133791143d54463b40a9a562f66f287',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:56:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=75b26816-905f-4743-acd3-4e9f4b095dd3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:56:11Z,use_quota=True,user_id='ecb69198235a4f3db8d70918e137e57a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:10 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-82476331-39ba-478a-b01a-c8d86825b296 tempest-TestStampPattern-656958745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1a8c367-cc76-4cde-9de8-383b61d7c164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:10 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-82476331-39ba-478a-b01a-c8d86825b296 tempest-TestStampPattern-656958745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1a8c367-cc76-4cde-9de8-383b61d7c164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:10 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-82476331-39ba-478a-b01a-c8d86825b296 tempest-TestStampPattern-656958745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a28d8ef2-5bcc-4097-a734-700ecfd2753a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:10 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-82476331-39ba-478a-b01a-c8d86825b296 tempest-TestStampPattern-656958745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a28d8ef2-5bcc-4097-a734-700ecfd2753a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8fe5bef5-2586-484c-93c0-6604c1e3a220', 'volume_name': 'volume-8fe5bef5-2586-484c-93c0-6604c1e3a220', 'volume_size': 1, 'snapshot_id': '75b26816-905f-4743-acd3-4e9f4b095dd3'}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:10 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-82476331-39ba-478a-b01a-c8d86825b296 tempest-TestStampPattern-656958745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91d90164-50ad-473b-8cce-888294caecbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:10 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-82476331-39ba-478a-b01a-c8d86825b296 tempest-TestStampPattern-656958745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91d90164-50ad-473b-8cce-888294caecbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:10 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-82476331-39ba-478a-b01a-c8d86825b296 tempest-TestStampPattern-656958745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (598cad98-afc0-4efc-9487-d6be8dae649b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:10 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-82476331-39ba-478a-b01a-c8d86825b296 tempest-TestStampPattern-656958745 None] Volume 8fe5bef5-2586-484c-93c0-6604c1e3a220: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8fe5bef5-2586-484c-93c0-6604c1e3a220', 'volume_size': 1, 'snapshot_id': '75b26816-905f-4743-acd3-4e9f4b095dd3'} Jul 08 01:56:10 devstack cinder-volume[87134]: INFO cinder.volume.manager [req-e6e5c0f6-81b9-4e04-ab8d-84e80a07b226 req-4784619d-0163-497d-b36f-b2b97ef67115 tempest-TestInstancesWithCinderVolumes-108683866 None] Terminate volume connection completed successfully. Jul 08 01:56:10 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [req-e6e5c0f6-81b9-4e04-ab8d-84e80a07b226 req-4784619d-0163-497d-b36f-b2b97ef67115 tempest-TestInstancesWithCinderVolumes-108683866 None] Deleting attachment a4465b7f-625e-4d9b-8df6-20d0baf613c7. {{(pid=87134) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:56:10 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-82476331-39ba-478a-b01a-c8d86825b296 tempest-TestStampPattern-656958745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:56:10 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-82476331-39ba-478a-b01a-c8d86825b296 tempest-TestStampPattern-656958745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:56:10 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-82476331-39ba-478a-b01a-c8d86825b296 tempest-TestStampPattern-656958745 None] Acquiring lock "cinder-quobyte-75b26816-905f-4743-acd3-4e9f4b095dd3-8fe5bef5-2586-484c-93c0-6604c1e3a220" by "_create_volume_from_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:56:10 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-82476331-39ba-478a-b01a-c8d86825b296 tempest-TestStampPattern-656958745 None] Lock "cinder-quobyte-75b26816-905f-4743-acd3-4e9f4b095dd3-8fe5bef5-2586-484c-93c0-6604c1e3a220" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:56:10 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-82476331-39ba-478a-b01a-c8d86825b296 tempest-TestStampPattern-656958745 None] Creating volume 8fe5bef5-2586-484c-93c0-6604c1e3a220 from snapshot 75b26816-905f-4743-acd3-4e9f4b095dd3 {{(pid=87134) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 01:56:10 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-82476331-39ba-478a-b01a-c8d86825b296 tempest-TestStampPattern-656958745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:56:10 devstack sudo[100621]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:10 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-82476331-39ba-478a-b01a-c8d86825b296 tempest-TestStampPattern-656958745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:56:10 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-82476331-39ba-478a-b01a-c8d86825b296 tempest-TestStampPattern-656958745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:56:10 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-82476331-39ba-478a-b01a-c8d86825b296 tempest-TestStampPattern-656958745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:56:10 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-82476331-39ba-478a-b01a-c8d86825b296 tempest-TestStampPattern-656958745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:56:10 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-82476331-39ba-478a-b01a-c8d86825b296 tempest-TestStampPattern-656958745 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:56:10 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-82476331-39ba-478a-b01a-c8d86825b296 tempest-TestStampPattern-656958745 None] Acquiring lock "cinder-quobyte-8fe5bef5-2586-484c-93c0-6604c1e3a220" by "_copy_volume_from_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:56:10 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-bfd74b38-4429-4dd1-834b-029468661803 tempest-VolumesDeleteCascade-1588680236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-179047e6-c40e-4898-9c73-8c46fb26ee03 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03.b3f719dd-29a3-49a2-b8ee-3a084ff3957f -F qcow2" returned: 0 in 0.878s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:10 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-82476331-39ba-478a-b01a-c8d86825b296 tempest-TestStampPattern-656958745 None] Lock "cinder-quobyte-8fe5bef5-2586-484c-93c0-6604c1e3a220" acquired by "_copy_volume_from_snapshot" :: waited 0.044s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:56:10 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-82476331-39ba-478a-b01a-c8d86825b296 tempest-TestStampPattern-656958745 None] snapshot: 75b26816-905f-4743-acd3-4e9f4b095dd3, volume: 8fe5bef5-2586-484c-93c0-6604c1e3a220, {{(pid=87134) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 01:56:10 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-bfd74b38-4429-4dd1-834b-029468661803 tempest-VolumesDeleteCascade-1588680236 None] Lock "cinder-quobyte-4dca7fee-1bec-4d54-bc1e-26c5a91c8db5" released by "_delete_snapshot" :: held 7.932s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:56:10 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-bfd74b38-4429-4dd1-834b-029468661803 tempest-VolumesDeleteCascade-1588680236 None] Lock "cinder-quobyte-179047e6-c40e-4898-9c73-8c46fb26ee03" released by "delete_snapshot" :: held 7.960s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:56:10 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-82476331-39ba-478a-b01a-c8d86825b296 tempest-TestStampPattern-656958745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:56:10 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-82476331-39ba-478a-b01a-c8d86825b296 tempest-TestStampPattern-656958745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:56:10 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-82476331-39ba-478a-b01a-c8d86825b296 tempest-TestStampPattern-656958745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:56:10 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-82476331-39ba-478a-b01a-c8d86825b296 tempest-TestStampPattern-656958745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:56:10 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-82476331-39ba-478a-b01a-c8d86825b296 tempest-TestStampPattern-656958745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:56:10 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea882ef0-dea8-4069-8e2c-13ec8e3a0ba0]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:56:10 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-82476331-39ba-478a-b01a-c8d86825b296 tempest-TestStampPattern-656958745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-773e60c8-acd6-407d-afee-1c1a06403187.75b26816-905f-4743-acd3-4e9f4b095dd3 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:11 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-bfd74b38-4429-4dd1-834b-029468661803 tempest-VolumesDeleteCascade-1588680236 None] Created reservations ['4a5c6c9a-0098-4963-8daf-ebd9c32801a2', 'ea02a43f-c6de-47f8-85d9-694fd4847566', '770cace2-5c30-4129-90de-e26c8ea59c3f', '5f6c82db-003c-4fda-a35d-c743a2d1b78a'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:56:11 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-bfd74b38-4429-4dd1-834b-029468661803 tempest-VolumesDeleteCascade-1588680236 None] Delete snapshot completed successfully. Jul 08 01:56:11 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-bfd74b38-4429-4dd1-834b-029468661803 tempest-VolumesDeleteCascade-1588680236 None] Lock "cinder-4dca7fee-1bec-4d54-bc1e-26c5a91c8db5-delete_snapshot" released by "delete_snapshot" :: held 8.211s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:56:11 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-bfd74b38-4429-4dd1-834b-029468661803 tempest-VolumesDeleteCascade-1588680236 None] Acquiring lock "cinder-b3f719dd-29a3-49a2-b8ee-3a084ff3957f-delete_snapshot" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:56:11 devstack sudo[100628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-773e60c8-acd6-407d-afee-1c1a06403187.75b26816-905f-4743-acd3-4e9f4b095dd3 Jul 08 01:56:11 devstack sudo[100628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:11 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-bfd74b38-4429-4dd1-834b-029468661803 tempest-VolumesDeleteCascade-1588680236 None] Lock "cinder-b3f719dd-29a3-49a2-b8ee-3a084ff3957f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:56:11 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-bfd74b38-4429-4dd1-834b-029468661803 tempest-VolumesDeleteCascade-1588680236 None] Acquiring lock "cinder-quobyte-179047e6-c40e-4898-9c73-8c46fb26ee03" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:56:11 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-bfd74b38-4429-4dd1-834b-029468661803 tempest-VolumesDeleteCascade-1588680236 None] Lock "cinder-quobyte-179047e6-c40e-4898-9c73-8c46fb26ee03" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:56:11 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-bfd74b38-4429-4dd1-834b-029468661803 tempest-VolumesDeleteCascade-1588680236 None] Acquiring lock "cinder-quobyte-b3f719dd-29a3-49a2-b8ee-3a084ff3957f" by "_delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:56:11 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-bfd74b38-4429-4dd1-834b-029468661803 tempest-VolumesDeleteCascade-1588680236 None] Lock "cinder-quobyte-b3f719dd-29a3-49a2-b8ee-3a084ff3957f" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:56:11 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-bfd74b38-4429-4dd1-834b-029468661803 tempest-VolumesDeleteCascade-1588680236 None] Deleting offline snapshot b3f719dd-29a3-49a2-b8ee-3a084ff3957f of volume 179047e6-c40e-4898-9c73-8c46fb26ee03 {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:56:11 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-bfd74b38-4429-4dd1-834b-029468661803 tempest-VolumesDeleteCascade-1588680236 None] snapshot_file for this snap is: volume-179047e6-c40e-4898-9c73-8c46fb26ee03.b3f719dd-29a3-49a2-b8ee-3a084ff3957f {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:56:11 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee0c4ce9-3c5e-4fcc-bea7-097b8270468b]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:56:11 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-bfd74b38-4429-4dd1-834b-029468661803 tempest-VolumesDeleteCascade-1588680236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03.b3f719dd-29a3-49a2-b8ee-3a084ff3957f {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:11 devstack sudo[100632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03.b3f719dd-29a3-49a2-b8ee-3a084ff3957f Jul 08 01:56:11 devstack sudo[100632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:12 devstack sudo[100628]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:12 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-82476331-39ba-478a-b01a-c8d86825b296 tempest-TestStampPattern-656958745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-773e60c8-acd6-407d-afee-1c1a06403187.75b26816-905f-4743-acd3-4e9f4b095dd3" returned: 0 in 1.167s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:12 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-82476331-39ba-478a-b01a-c8d86825b296 tempest-TestStampPattern-656958745 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-773e60c8-acd6-407d-afee-1c1a06403187(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:56:12 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-82476331-39ba-478a-b01a-c8d86825b296 tempest-TestStampPattern-656958745 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-773e60c8-acd6-407d-afee-1c1a06403187 {{(pid=87134) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 01:56:12 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-82476331-39ba-478a-b01a-c8d86825b296 tempest-TestStampPattern-656958745 None] Creating direct copy from snapshot {{(pid=87134) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 01:56:12 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65392aa-7bdd-46a2-a9fd-4ecdc49ff734]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:56:12 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-82476331-39ba-478a-b01a-c8d86825b296 tempest-TestStampPattern-656958745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-773e60c8-acd6-407d-afee-1c1a06403187 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:12 devstack sudo[100632]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:12 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-bfd74b38-4429-4dd1-834b-029468661803 tempest-VolumesDeleteCascade-1588680236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03.b3f719dd-29a3-49a2-b8ee-3a084ff3957f" returned: 0 in 1.012s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:12 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-bfd74b38-4429-4dd1-834b-029468661803 tempest-VolumesDeleteCascade-1588680236 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-179047e6-c40e-4898-9c73-8c46fb26ee03(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:56:12 devstack sudo[100642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-773e60c8-acd6-407d-afee-1c1a06403187 Jul 08 01:56:12 devstack sudo[100642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:12 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[515d2e3e-a3a5-4d67-9826-72d4796fe170]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:56:12 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-bfd74b38-4429-4dd1-834b-029468661803 tempest-VolumesDeleteCascade-1588680236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:12 devstack sudo[100646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03 Jul 08 01:56:12 devstack sudo[100646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:12 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-fb677168-33dc-48a4-b424-2b98207b08ab tempest-TestInstancesWithCinderVolumes-108683866 None] Acquiring lock "cinder-cc1d83f7-0539-4c7c-ab36-b9902bb10a9b-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:56:12 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-fb677168-33dc-48a4-b424-2b98207b08ab tempest-TestInstancesWithCinderVolumes-108683866 None] Lock "cinder-cc1d83f7-0539-4c7c-ab36-b9902bb10a9b-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:56:12 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-fb677168-33dc-48a4-b424-2b98207b08ab tempest-TestInstancesWithCinderVolumes-108683866 None] Acquiring lock "cinder-quobyte-cc1d83f7-0539-4c7c-ab36-b9902bb10a9b" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:56:12 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-fb677168-33dc-48a4-b424-2b98207b08ab tempest-TestInstancesWithCinderVolumes-108683866 None] Lock "cinder-quobyte-cc1d83f7-0539-4c7c-ab36-b9902bb10a9b" acquired by "delete_volume" :: waited 0.043s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:56:12 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[754fc64c-75f7-4ef2-8cb9-4d17d7ec3bcf]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:56:12 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-fb677168-33dc-48a4-b424-2b98207b08ab tempest-TestInstancesWithCinderVolumes-108683866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-cc1d83f7-0539-4c7c-ab36-b9902bb10a9b {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:13 devstack sudo[100649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-cc1d83f7-0539-4c7c-ab36-b9902bb10a9b Jul 08 01:56:13 devstack sudo[100649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:13 devstack sudo[100642]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-82476331-39ba-478a-b01a-c8d86825b296 tempest-TestStampPattern-656958745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-773e60c8-acd6-407d-afee-1c1a06403187" returned: 0 in 1.180s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:13 devstack cinder-volume[87134]: DEBUG cinder.utils [None req-82476331-39ba-478a-b01a-c8d86825b296 tempest-TestStampPattern-656958745 None] Path /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8fe5bef5-2586-484c-93c0-6604c1e3a220 not found in is_blk_device check {{(pid=87134) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 01:56:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-82476331-39ba-478a-b01a-c8d86825b296 tempest-TestStampPattern-656958745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-773e60c8-acd6-407d-afee-1c1a06403187 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8fe5bef5-2586-484c-93c0-6604c1e3a220 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:13 devstack sudo[100654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-773e60c8-acd6-407d-afee-1c1a06403187 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8fe5bef5-2586-484c-93c0-6604c1e3a220 Jul 08 01:56:13 devstack sudo[100654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:13 devstack sudo[100646]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-bfd74b38-4429-4dd1-834b-029468661803 tempest-VolumesDeleteCascade-1588680236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03" returned: 0 in 1.284s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-bfd74b38-4429-4dd1-834b-029468661803 tempest-VolumesDeleteCascade-1588680236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03.b3f719dd-29a3-49a2-b8ee-3a084ff3957f {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:13 devstack sudo[100659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03.b3f719dd-29a3-49a2-b8ee-3a084ff3957f Jul 08 01:56:13 devstack sudo[100659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:14 devstack sudo[100649]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:14 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-fb677168-33dc-48a4-b424-2b98207b08ab tempest-TestInstancesWithCinderVolumes-108683866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-cc1d83f7-0539-4c7c-ab36-b9902bb10a9b" returned: 0 in 1.141s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:14 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-fb677168-33dc-48a4-b424-2b98207b08ab tempest-TestInstancesWithCinderVolumes-108683866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-cc1d83f7-0539-4c7c-ab36-b9902bb10a9b {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:14 devstack sudo[100664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-cc1d83f7-0539-4c7c-ab36-b9902bb10a9b Jul 08 01:56:14 devstack sudo[100664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:14 devstack sudo[100659]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:14 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-bfd74b38-4429-4dd1-834b-029468661803 tempest-VolumesDeleteCascade-1588680236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03.b3f719dd-29a3-49a2-b8ee-3a084ff3957f" returned: 0 in 1.291s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:14 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-bfd74b38-4429-4dd1-834b-029468661803 tempest-VolumesDeleteCascade-1588680236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03.b3f719dd-29a3-49a2-b8ee-3a084ff3957f {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:14 devstack sudo[100681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03.b3f719dd-29a3-49a2-b8ee-3a084ff3957f Jul 08 01:56:14 devstack sudo[100681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:15 devstack sudo[100664]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-fb677168-33dc-48a4-b424-2b98207b08ab tempest-TestInstancesWithCinderVolumes-108683866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-cc1d83f7-0539-4c7c-ab36-b9902bb10a9b" returned: 0 in 1.392s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:15 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-fb677168-33dc-48a4-b424-2b98207b08ab tempest-TestInstancesWithCinderVolumes-108683866 None] Lock "cinder-quobyte-cc1d83f7-0539-4c7c-ab36-b9902bb10a9b" released by "delete_volume" :: held 2.648s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:56:15 devstack cinder-volume[87134]: WARNING cinder.quota [None req-fb677168-33dc-48a4-b424-2b98207b08ab tempest-TestInstancesWithCinderVolumes-108683866 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-601836119-153855777 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-601836119-153855777, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:56:15 devstack cinder-volume[87134]: WARNING cinder.quota [None req-fb677168-33dc-48a4-b424-2b98207b08ab tempest-TestInstancesWithCinderVolumes-108683866 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-601836119-153855777 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-601836119-153855777, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:56:15 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-fb677168-33dc-48a4-b424-2b98207b08ab tempest-TestInstancesWithCinderVolumes-108683866 None] Created reservations ['04619aa3-4189-4ac0-8c85-3b18a959105c', 'a3e82e0b-caef-47c6-9737-98abb52aaa82', 'f4a33ce2-c88a-4f47-bdcb-d8e8dc24b9ce', '17350a5e-f733-4b42-b8db-a8478ca4393c'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:56:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-fb677168-33dc-48a4-b424-2b98207b08ab tempest-TestInstancesWithCinderVolumes-108683866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:56:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-fb677168-33dc-48a4-b424-2b98207b08ab tempest-TestInstancesWithCinderVolumes-108683866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:56:15 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-fb677168-33dc-48a4-b424-2b98207b08ab tempest-TestInstancesWithCinderVolumes-108683866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:56:15 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-fb677168-33dc-48a4-b424-2b98207b08ab tempest-TestInstancesWithCinderVolumes-108683866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:56:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-fb677168-33dc-48a4-b424-2b98207b08ab tempest-TestInstancesWithCinderVolumes-108683866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:56:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-fb677168-33dc-48a4-b424-2b98207b08ab tempest-TestInstancesWithCinderVolumes-108683866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:16 devstack sudo[100684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:56:16 devstack sudo[100684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:17 devstack sudo[100681]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-bfd74b38-4429-4dd1-834b-029468661803 tempest-VolumesDeleteCascade-1588680236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03.b3f719dd-29a3-49a2-b8ee-3a084ff3957f" returned: 0 in 2.222s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:17 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-bfd74b38-4429-4dd1-834b-029468661803 tempest-VolumesDeleteCascade-1588680236 None] Lock "cinder-quobyte-b3f719dd-29a3-49a2-b8ee-3a084ff3957f" released by "_delete_snapshot" :: held 6.028s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:56:17 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-bfd74b38-4429-4dd1-834b-029468661803 tempest-VolumesDeleteCascade-1588680236 None] Lock "cinder-quobyte-179047e6-c40e-4898-9c73-8c46fb26ee03" released by "delete_snapshot" :: held 6.075s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:56:17 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-bfd74b38-4429-4dd1-834b-029468661803 tempest-VolumesDeleteCascade-1588680236 None] Created reservations ['d768913a-fe2e-4d20-888d-995d2105807b', '90e5d0f2-fc8b-4dcf-a827-4f8288c7a186', 'ea075026-c841-4f23-a62b-c29e134fcb93', '975ee62b-f210-4257-bbec-a7fa64e5b62f'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:56:17 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-bfd74b38-4429-4dd1-834b-029468661803 tempest-VolumesDeleteCascade-1588680236 None] Delete snapshot completed successfully. Jul 08 01:56:18 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-bfd74b38-4429-4dd1-834b-029468661803 tempest-VolumesDeleteCascade-1588680236 None] Lock "cinder-b3f719dd-29a3-49a2-b8ee-3a084ff3957f-delete_snapshot" released by "delete_snapshot" :: held 6.868s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:56:18 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-bfd74b38-4429-4dd1-834b-029468661803 tempest-VolumesDeleteCascade-1588680236 None] Snapshots deleted, issuing volume delete {{(pid=87134) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 08 01:56:18 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-bfd74b38-4429-4dd1-834b-029468661803 tempest-VolumesDeleteCascade-1588680236 None] Acquiring lock "cinder-quobyte-179047e6-c40e-4898-9c73-8c46fb26ee03" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:56:18 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-bfd74b38-4429-4dd1-834b-029468661803 tempest-VolumesDeleteCascade-1588680236 None] Lock "cinder-quobyte-179047e6-c40e-4898-9c73-8c46fb26ee03" acquired by "delete_volume" :: waited 0.049s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:56:18 devstack sudo[100684]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-fb677168-33dc-48a4-b424-2b98207b08ab tempest-TestInstancesWithCinderVolumes-108683866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 2.224s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:18 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-fb677168-33dc-48a4-b424-2b98207b08ab tempest-TestInstancesWithCinderVolumes-108683866 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:56:18 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[338f9d2f-1000-4244-8dac-012d1fe31d6b]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:56:18 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-fb677168-33dc-48a4-b424-2b98207b08ab tempest-TestInstancesWithCinderVolumes-108683866 None] Deleted volume successfully. Jul 08 01:56:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-bfd74b38-4429-4dd1-834b-029468661803 tempest-VolumesDeleteCascade-1588680236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:18 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-fb677168-33dc-48a4-b424-2b98207b08ab tempest-TestInstancesWithCinderVolumes-108683866 None] Lock "cinder-cc1d83f7-0539-4c7c-ab36-b9902bb10a9b-delete_volume" released by "delete_volume" :: held 5.644s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:56:18 devstack sudo[100688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03 Jul 08 01:56:18 devstack sudo[100688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:20 devstack cinder-volume[87134]: DEBUG oslo_service.periodic_task [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87134) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:56:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:56:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:56:20 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:56:20 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:56:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:56:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:20 devstack sudo[100699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:56:20 devstack sudo[100699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:21 devstack sudo[100688]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-bfd74b38-4429-4dd1-834b-029468661803 tempest-VolumesDeleteCascade-1588680236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03" returned: 0 in 2.809s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-bfd74b38-4429-4dd1-834b-029468661803 tempest-VolumesDeleteCascade-1588680236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:21 devstack sudo[100701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03 Jul 08 01:56:21 devstack sudo[100701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:21 devstack sudo[100654]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-82476331-39ba-478a-b01a-c8d86825b296 tempest-TestStampPattern-656958745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-773e60c8-acd6-407d-afee-1c1a06403187 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8fe5bef5-2586-484c-93c0-6604c1e3a220" returned: 0 in 7.962s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:21 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f231ad0-341f-4bac-852e-173faf4540f9]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:56:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-82476331-39ba-478a-b01a-c8d86825b296 tempest-TestStampPattern-656958745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-773e60c8-acd6-407d-afee-1c1a06403187 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:21 devstack sudo[100703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-773e60c8-acd6-407d-afee-1c1a06403187 Jul 08 01:56:21 devstack sudo[100703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:22 devstack sudo[100701]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:22 devstack sudo[100699]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 1.705s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:22 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:56:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-bfd74b38-4429-4dd1-834b-029468661803 tempest-VolumesDeleteCascade-1588680236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-179047e6-c40e-4898-9c73-8c46fb26ee03" returned: 0 in 1.625s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:22 devstack cinder-volume[87134]: DEBUG oslo_service.periodic_task [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running periodic task VolumeManager._thread_info {{(pid=87134) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:56:22 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] thread count: 28 {{(pid=87134) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:56:22 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] thread info: [<_MainThread(MainThread, started 129378964615296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87134) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:56:22 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-bfd74b38-4429-4dd1-834b-029468661803 tempest-VolumesDeleteCascade-1588680236 None] Lock "cinder-quobyte-179047e6-c40e-4898-9c73-8c46fb26ee03" released by "delete_volume" :: held 4.631s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:56:22 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-bfd74b38-4429-4dd1-834b-029468661803 tempest-VolumesDeleteCascade-1588680236 None] Created reservations ['2332e15d-3dfe-41bb-9a83-0884565ecbf8', '2a44e703-1867-4d23-bdcb-ce5bca7ef755', '991c4ec7-88f5-48d2-9a7f-c4d88c988ab2', 'efecc0dd-1264-4f09-94f6-d0e91f5e077d'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:56:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-bfd74b38-4429-4dd1-834b-029468661803 tempest-VolumesDeleteCascade-1588680236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:56:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-bfd74b38-4429-4dd1-834b-029468661803 tempest-VolumesDeleteCascade-1588680236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:56:22 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-bfd74b38-4429-4dd1-834b-029468661803 tempest-VolumesDeleteCascade-1588680236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:56:22 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-bfd74b38-4429-4dd1-834b-029468661803 tempest-VolumesDeleteCascade-1588680236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:56:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-bfd74b38-4429-4dd1-834b-029468661803 tempest-VolumesDeleteCascade-1588680236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:56:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-bfd74b38-4429-4dd1-834b-029468661803 tempest-VolumesDeleteCascade-1588680236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:23 devstack sudo[100728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:56:23 devstack sudo[100728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:23 devstack sudo[100703]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:23 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-82476331-39ba-478a-b01a-c8d86825b296 tempest-TestStampPattern-656958745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-773e60c8-acd6-407d-afee-1c1a06403187" returned: 0 in 1.849s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:23 devstack cinder-volume[87134]: DEBUG cinder.image.image_utils [None req-82476331-39ba-478a-b01a-c8d86825b296 tempest-TestStampPattern-656958745 None] Image conversion details: src /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-773e60c8-acd6-407d-afee-1c1a06403187, size 1024.00 MB, duration 7.96 sec, destination /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8fe5bef5-2586-484c-93c0-6604c1e3a220 {{(pid=87134) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:56:23 devstack cinder-volume[87134]: INFO cinder.image.image_utils [None req-82476331-39ba-478a-b01a-c8d86825b296 tempest-TestStampPattern-656958745 None] Converted 1024.00 MB image at 128.59 MB/s Jul 08 01:56:23 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-82476331-39ba-478a-b01a-c8d86825b296 tempest-TestStampPattern-656958745 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8fe5bef5-2586-484c-93c0-6604c1e3a220 is being set with open permissions: ugo+rw Jul 08 01:56:23 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-82476331-39ba-478a-b01a-c8d86825b296 tempest-TestStampPattern-656958745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8fe5bef5-2586-484c-93c0-6604c1e3a220 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:23 devstack sudo[100730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8fe5bef5-2586-484c-93c0-6604c1e3a220 Jul 08 01:56:23 devstack sudo[100730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:24 devstack sudo[100728]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-bfd74b38-4429-4dd1-834b-029468661803 tempest-VolumesDeleteCascade-1588680236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 1.579s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:24 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-bfd74b38-4429-4dd1-834b-029468661803 tempest-VolumesDeleteCascade-1588680236 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:56:24 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-bfd74b38-4429-4dd1-834b-029468661803 tempest-VolumesDeleteCascade-1588680236 None] Deleted volume successfully. Jul 08 01:56:24 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-bfd74b38-4429-4dd1-834b-029468661803 tempest-VolumesDeleteCascade-1588680236 None] Lock "cinder-179047e6-c40e-4898-9c73-8c46fb26ee03-delete_volume" released by "delete_volume" :: held 21.816s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:56:24 devstack sudo[100730]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-82476331-39ba-478a-b01a-c8d86825b296 tempest-TestStampPattern-656958745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8fe5bef5-2586-484c-93c0-6604c1e3a220" returned: 0 in 1.447s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:24 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-82476331-39ba-478a-b01a-c8d86825b296 tempest-TestStampPattern-656958745 None] Lock "cinder-quobyte-8fe5bef5-2586-484c-93c0-6604c1e3a220" released by "_copy_volume_from_snapshot" :: held 13.774s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:56:24 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-82476331-39ba-478a-b01a-c8d86825b296 tempest-TestStampPattern-656958745 None] Lock "cinder-quobyte-75b26816-905f-4743-acd3-4e9f4b095dd3-8fe5bef5-2586-484c-93c0-6604c1e3a220" released by "_create_volume_from_snapshot" :: held 13.856s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:56:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-82476331-39ba-478a-b01a-c8d86825b296 tempest-TestStampPattern-656958745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.873s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:56:24 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-82476331-39ba-478a-b01a-c8d86825b296 tempest-TestStampPattern-656958745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (598cad98-afc0-4efc-9487-d6be8dae649b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fe5bef5-2586-484c-93c0-6604c1e3a220', 'volume_size': 1, 'snapshot_id': '75b26816-905f-4743-acd3-4e9f4b095dd3'}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:24 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-82476331-39ba-478a-b01a-c8d86825b296 tempest-TestStampPattern-656958745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cd936a6-92cf-4459-a887-3ebf0cc84440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:24 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-55d9e0e1-2ebc-4bb1-8281-6c9ea8d57b63 tempest-VolumesDeleteCascade-1588680236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:56:24 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-55d9e0e1-2ebc-4bb1-8281-6c9ea8d57b63 tempest-VolumesDeleteCascade-1588680236 None] Flow 'volume_create_manager' (0b715ac0-ad2b-4252-8117-5520229c2194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:56:24 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-55d9e0e1-2ebc-4bb1-8281-6c9ea8d57b63 tempest-VolumesDeleteCascade-1588680236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbb82ff1-d5e6-49a2-88b8-6c984d5d44ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:24 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-82476331-39ba-478a-b01a-c8d86825b296 tempest-TestStampPattern-656958745 None] Volume volume-8fe5bef5-2586-484c-93c0-6604c1e3a220 (8fe5bef5-2586-484c-93c0-6604c1e3a220): created successfully Jul 08 01:56:24 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-82476331-39ba-478a-b01a-c8d86825b296 tempest-TestStampPattern-656958745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cd936a6-92cf-4459-a887-3ebf0cc84440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:24 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-82476331-39ba-478a-b01a-c8d86825b296 tempest-TestStampPattern-656958745 None] Flow 'volume_create_manager' (03a46bcf-4907-446d-a10d-c666dc2571da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:56:24 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-55d9e0e1-2ebc-4bb1-8281-6c9ea8d57b63 tempest-VolumesDeleteCascade-1588680236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbb82ff1-d5e6-49a2-88b8-6c984d5d44ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:56:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-396726238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f0733f155f942dfbbd8d6f06702ee27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:56:25Z,use_quota=True,user_id='67329447c3ce49339701d73eb871f400',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:24 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-55d9e0e1-2ebc-4bb1-8281-6c9ea8d57b63 tempest-VolumesDeleteCascade-1588680236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd76b258-d4f9-462a-8125-7d9f8221d64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:24 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-55d9e0e1-2ebc-4bb1-8281-6c9ea8d57b63 tempest-VolumesDeleteCascade-1588680236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd76b258-d4f9-462a-8125-7d9f8221d64d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:24 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-55d9e0e1-2ebc-4bb1-8281-6c9ea8d57b63 tempest-VolumesDeleteCascade-1588680236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (071838da-c99d-4dcf-b6ef-2e4833a4069a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:24 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-55d9e0e1-2ebc-4bb1-8281-6c9ea8d57b63 tempest-VolumesDeleteCascade-1588680236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (071838da-c99d-4dcf-b6ef-2e4833a4069a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2', 'volume_name': 'volume-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:24 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-55d9e0e1-2ebc-4bb1-8281-6c9ea8d57b63 tempest-VolumesDeleteCascade-1588680236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15bb56fb-6914-4184-9ad5-d96cef580a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:24 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-55d9e0e1-2ebc-4bb1-8281-6c9ea8d57b63 tempest-VolumesDeleteCascade-1588680236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15bb56fb-6914-4184-9ad5-d96cef580a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:24 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-55d9e0e1-2ebc-4bb1-8281-6c9ea8d57b63 tempest-VolumesDeleteCascade-1588680236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddace46f-4d2e-4c80-822d-c5c23be04daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:24 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-55d9e0e1-2ebc-4bb1-8281-6c9ea8d57b63 tempest-VolumesDeleteCascade-1588680236 None] Volume 4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2', 'volume_size': 1} Jul 08 01:56:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55d9e0e1-2ebc-4bb1-8281-6c9ea8d57b63 tempest-VolumesDeleteCascade-1588680236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:56:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55d9e0e1-2ebc-4bb1-8281-6c9ea8d57b63 tempest-VolumesDeleteCascade-1588680236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:56:24 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-55d9e0e1-2ebc-4bb1-8281-6c9ea8d57b63 tempest-VolumesDeleteCascade-1588680236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:56:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-396726238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f0733f155f942dfbbd8d6f06702ee27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:56:25Z,use_quota=True,user_id='67329447c3ce49339701d73eb871f400',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:56:24 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-55d9e0e1-2ebc-4bb1-8281-6c9ea8d57b63 tempest-VolumesDeleteCascade-1588680236 None] Creating volume 4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:56:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55d9e0e1-2ebc-4bb1-8281-6c9ea8d57b63 tempest-VolumesDeleteCascade-1588680236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:56:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55d9e0e1-2ebc-4bb1-8281-6c9ea8d57b63 tempest-VolumesDeleteCascade-1588680236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:56:24 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-55d9e0e1-2ebc-4bb1-8281-6c9ea8d57b63 tempest-VolumesDeleteCascade-1588680236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:56:24 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-55d9e0e1-2ebc-4bb1-8281-6c9ea8d57b63 tempest-VolumesDeleteCascade-1588680236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:56:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55d9e0e1-2ebc-4bb1-8281-6c9ea8d57b63 tempest-VolumesDeleteCascade-1588680236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:56:24 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-55d9e0e1-2ebc-4bb1-8281-6c9ea8d57b63 tempest-VolumesDeleteCascade-1588680236 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:56:24 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-55d9e0e1-2ebc-4bb1-8281-6c9ea8d57b63 tempest-VolumesDeleteCascade-1588680236 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:56:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-55d9e0e1-2ebc-4bb1-8281-6c9ea8d57b63 tempest-VolumesDeleteCascade-1588680236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:24 devstack sudo[100755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2 1073741824 Jul 08 01:56:24 devstack sudo[100755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:24 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-82476331-39ba-478a-b01a-c8d86825b296 tempest-TestStampPattern-656958745 None] Created volume successfully. Jul 08 01:56:24 devstack cinder-volume[87134]: INFO cinder.volume.manager [req-b6faf0b4-b061-45e3-ae42-015f52738d3d req-d25b20ae-82d3-48a9-bafa-928bd2ea89a0 tempest-TestInstancesWithCinderVolumes-108683866 None] Terminate volume connection completed successfully. Jul 08 01:56:24 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [req-b6faf0b4-b061-45e3-ae42-015f52738d3d req-d25b20ae-82d3-48a9-bafa-928bd2ea89a0 tempest-TestInstancesWithCinderVolumes-108683866 None] Deleting attachment 350776cc-a31e-4b5f-b7b9-048c090e5a08. {{(pid=87134) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:56:25 devstack sudo[100755]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:25 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-55d9e0e1-2ebc-4bb1-8281-6c9ea8d57b63 tempest-VolumesDeleteCascade-1588680236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2 1073741824" returned: 0 in 1.028s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:25 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-55d9e0e1-2ebc-4bb1-8281-6c9ea8d57b63 tempest-VolumesDeleteCascade-1588680236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:25 devstack sudo[100772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2 Jul 08 01:56:25 devstack sudo[100772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:26 devstack sudo[100772]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:26 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-55d9e0e1-2ebc-4bb1-8281-6c9ea8d57b63 tempest-VolumesDeleteCascade-1588680236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2" returned: 0 in 0.963s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:26 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-55d9e0e1-2ebc-4bb1-8281-6c9ea8d57b63 tempest-VolumesDeleteCascade-1588680236 None] <== create_volume: return (2039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:56:26 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55d9e0e1-2ebc-4bb1-8281-6c9ea8d57b63 tempest-VolumesDeleteCascade-1588680236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.041s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:56:26 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-55d9e0e1-2ebc-4bb1-8281-6c9ea8d57b63 tempest-VolumesDeleteCascade-1588680236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddace46f-4d2e-4c80-822d-c5c23be04daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:26 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-55d9e0e1-2ebc-4bb1-8281-6c9ea8d57b63 tempest-VolumesDeleteCascade-1588680236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (347984e4-c297-4806-bf57-e4a6ddd2c496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:26 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-55d9e0e1-2ebc-4bb1-8281-6c9ea8d57b63 tempest-VolumesDeleteCascade-1588680236 None] Volume volume-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2 (4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2): created successfully Jul 08 01:56:26 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-55d9e0e1-2ebc-4bb1-8281-6c9ea8d57b63 tempest-VolumesDeleteCascade-1588680236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (347984e4-c297-4806-bf57-e4a6ddd2c496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:26 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-55d9e0e1-2ebc-4bb1-8281-6c9ea8d57b63 tempest-VolumesDeleteCascade-1588680236 None] Flow 'volume_create_manager' (0b715ac0-ad2b-4252-8117-5520229c2194) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:56:27 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-55d9e0e1-2ebc-4bb1-8281-6c9ea8d57b63 tempest-VolumesDeleteCascade-1588680236 None] Created volume successfully. Jul 08 01:56:28 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b2d3aace-cd1b-4ad7-8701-a4a5bfc6f71f tempest-VolumesDeleteCascade-1588680236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:56:28 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b2d3aace-cd1b-4ad7-8701-a4a5bfc6f71f tempest-VolumesDeleteCascade-1588680236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:56:28 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-b2d3aace-cd1b-4ad7-8701-a4a5bfc6f71f tempest-VolumesDeleteCascade-1588680236 None] Creating offline snapshot fb65a3f0-d3c5-468f-8b4f-27fffe779d3a of volume 4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2 {{(pid=87134) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:56:28 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db370d8-eec7-406c-a2b1-06f6ed91aad9]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:56:28 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b2d3aace-cd1b-4ad7-8701-a4a5bfc6f71f tempest-VolumesDeleteCascade-1588680236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:28 devstack sudo[100796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2 Jul 08 01:56:28 devstack sudo[100796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:28 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-eedee3af-13d8-41fe-b4bb-889b9388290f tempest-TestInstancesWithCinderVolumes-108683866 None] Acquiring lock "cinder-d3d4cc6b-a71d-491c-bd63-5198a70aac1a-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:56:28 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-eedee3af-13d8-41fe-b4bb-889b9388290f tempest-TestInstancesWithCinderVolumes-108683866 None] Lock "cinder-d3d4cc6b-a71d-491c-bd63-5198a70aac1a-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:56:28 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-eedee3af-13d8-41fe-b4bb-889b9388290f tempest-TestInstancesWithCinderVolumes-108683866 None] Acquiring lock "cinder-quobyte-d3d4cc6b-a71d-491c-bd63-5198a70aac1a" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:56:28 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-eedee3af-13d8-41fe-b4bb-889b9388290f tempest-TestInstancesWithCinderVolumes-108683866 None] Lock "cinder-quobyte-d3d4cc6b-a71d-491c-bd63-5198a70aac1a" acquired by "delete_volume" :: waited 0.016s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:56:28 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe34fff3-27b2-4302-bd1e-04276bc697d6]: (4, 'raw') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:56:28 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-eedee3af-13d8-41fe-b4bb-889b9388290f tempest-TestInstancesWithCinderVolumes-108683866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d3d4cc6b-a71d-491c-bd63-5198a70aac1a {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:29 devstack sudo[100799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d3d4cc6b-a71d-491c-bd63-5198a70aac1a Jul 08 01:56:29 devstack sudo[100799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:29 devstack sudo[100796]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b2d3aace-cd1b-4ad7-8701-a4a5bfc6f71f tempest-VolumesDeleteCascade-1588680236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2" returned: 0 in 0.891s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b2d3aace-cd1b-4ad7-8701-a4a5bfc6f71f tempest-VolumesDeleteCascade-1588680236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2.fb65a3f0-d3c5-468f-8b4f-27fffe779d3a 1G {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:29 devstack sudo[100804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2.fb65a3f0-d3c5-468f-8b4f-27fffe779d3a 1G Jul 08 01:56:29 devstack sudo[100804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:30 devstack sudo[100799]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-eedee3af-13d8-41fe-b4bb-889b9388290f tempest-TestInstancesWithCinderVolumes-108683866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d3d4cc6b-a71d-491c-bd63-5198a70aac1a" returned: 0 in 1.130s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-eedee3af-13d8-41fe-b4bb-889b9388290f tempest-TestInstancesWithCinderVolumes-108683866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d3d4cc6b-a71d-491c-bd63-5198a70aac1a {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:30 devstack sudo[100866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d3d4cc6b-a71d-491c-bd63-5198a70aac1a Jul 08 01:56:30 devstack sudo[100866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:30 devstack sudo[100804]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b2d3aace-cd1b-4ad7-8701-a4a5bfc6f71f tempest-VolumesDeleteCascade-1588680236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2.fb65a3f0-d3c5-468f-8b4f-27fffe779d3a 1G" returned: 0 in 1.140s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b2d3aace-cd1b-4ad7-8701-a4a5bfc6f71f tempest-VolumesDeleteCascade-1588680236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2.fb65a3f0-d3c5-468f-8b4f-27fffe779d3a {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:30 devstack sudo[100869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2.fb65a3f0-d3c5-468f-8b4f-27fffe779d3a Jul 08 01:56:30 devstack sudo[100869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:31 devstack sudo[100866]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-eedee3af-13d8-41fe-b4bb-889b9388290f tempest-TestInstancesWithCinderVolumes-108683866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d3d4cc6b-a71d-491c-bd63-5198a70aac1a" returned: 1 in 0.997s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-eedee3af-13d8-41fe-b4bb-889b9388290f tempest-TestInstancesWithCinderVolumes-108683866 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d3d4cc6b-a71d-491c-bd63-5198a70aac1a' failed. Not Retrying. {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:56:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-eedee3af-13d8-41fe-b4bb-889b9388290f tempest-TestInstancesWithCinderVolumes-108683866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d3d4cc6b-a71d-491c-bd63-5198a70aac1a {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:31 devstack sudo[100884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d3d4cc6b-a71d-491c-bd63-5198a70aac1a Jul 08 01:56:31 devstack sudo[100884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:31 devstack sudo[100869]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b2d3aace-cd1b-4ad7-8701-a4a5bfc6f71f tempest-VolumesDeleteCascade-1588680236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2.fb65a3f0-d3c5-468f-8b4f-27fffe779d3a" returned: 0 in 1.022s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:31 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-b2d3aace-cd1b-4ad7-8701-a4a5bfc6f71f tempest-VolumesDeleteCascade-1588680236 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2.fb65a3f0-d3c5-468f-8b4f-27fffe779d3a is being set with open permissions: ugo+rw Jul 08 01:56:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b2d3aace-cd1b-4ad7-8701-a4a5bfc6f71f tempest-VolumesDeleteCascade-1588680236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2.fb65a3f0-d3c5-468f-8b4f-27fffe779d3a {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:31 devstack sudo[100887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2.fb65a3f0-d3c5-468f-8b4f-27fffe779d3a Jul 08 01:56:31 devstack sudo[100887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:31 devstack sudo[100884]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-eedee3af-13d8-41fe-b4bb-889b9388290f tempest-TestInstancesWithCinderVolumes-108683866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d3d4cc6b-a71d-491c-bd63-5198a70aac1a" returned: 0 in 0.882s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:31 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-eedee3af-13d8-41fe-b4bb-889b9388290f tempest-TestInstancesWithCinderVolumes-108683866 None] Lock "cinder-quobyte-d3d4cc6b-a71d-491c-bd63-5198a70aac1a" released by "delete_volume" :: held 3.089s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:56:31 devstack cinder-volume[87134]: DEBUG dbcounter [-] [87134] Writing DB stats cinder:UPDATE=58,cinder:SELECT=71,cinder:INSERT=15,cinder:DELETE=5 {{(pid=87134) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:56:31 devstack cinder-volume[87134]: DEBUG dbcounter [-] [87134] Writing DB stats cinder:SELECT=74,cinder:UPDATE=70,cinder:INSERT=14,cinder:DELETE=6 {{(pid=87134) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:56:32 devstack cinder-volume[87134]: WARNING cinder.quota [None req-eedee3af-13d8-41fe-b4bb-889b9388290f tempest-TestInstancesWithCinderVolumes-108683866 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-122924132-110978480 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-122924132-110978480, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:56:32 devstack cinder-volume[87134]: WARNING cinder.quota [None req-eedee3af-13d8-41fe-b4bb-889b9388290f tempest-TestInstancesWithCinderVolumes-108683866 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-122924132-110978480 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-122924132-110978480, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:56:32 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-eedee3af-13d8-41fe-b4bb-889b9388290f tempest-TestInstancesWithCinderVolumes-108683866 None] Created reservations ['58809d5b-5a18-4330-a365-23b7812666ba', 'de453b4d-f422-427b-b18a-cd10acebd288', 'c3287031-f8ac-4445-8713-9f1b877fec31', 'fee8f6fd-c18c-449e-a6b0-f28f792efbd8'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:56:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-eedee3af-13d8-41fe-b4bb-889b9388290f tempest-TestInstancesWithCinderVolumes-108683866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:56:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-eedee3af-13d8-41fe-b4bb-889b9388290f tempest-TestInstancesWithCinderVolumes-108683866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:56:32 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-eedee3af-13d8-41fe-b4bb-889b9388290f tempest-TestInstancesWithCinderVolumes-108683866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:56:32 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-eedee3af-13d8-41fe-b4bb-889b9388290f tempest-TestInstancesWithCinderVolumes-108683866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:56:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-eedee3af-13d8-41fe-b4bb-889b9388290f tempest-TestInstancesWithCinderVolumes-108683866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:56:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-eedee3af-13d8-41fe-b4bb-889b9388290f tempest-TestInstancesWithCinderVolumes-108683866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:32 devstack sudo[100887]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b2d3aace-cd1b-4ad7-8701-a4a5bfc6f71f tempest-VolumesDeleteCascade-1588680236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2.fb65a3f0-d3c5-468f-8b4f-27fffe779d3a" returned: 0 in 0.901s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:32 devstack sudo[100891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:56:32 devstack sudo[100891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b2d3aace-cd1b-4ad7-8701-a4a5bfc6f71f tempest-VolumesDeleteCascade-1588680236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:32 devstack sudo[100893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2.info Jul 08 01:56:32 devstack sudo[100893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:33 devstack sudo[100891]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-eedee3af-13d8-41fe-b4bb-889b9388290f tempest-TestInstancesWithCinderVolumes-108683866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.905s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:33 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-eedee3af-13d8-41fe-b4bb-889b9388290f tempest-TestInstancesWithCinderVolumes-108683866 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:56:33 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-eedee3af-13d8-41fe-b4bb-889b9388290f tempest-TestInstancesWithCinderVolumes-108683866 None] Deleted volume successfully. Jul 08 01:56:33 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-eedee3af-13d8-41fe-b4bb-889b9388290f tempest-TestInstancesWithCinderVolumes-108683866 None] Lock "cinder-d3d4cc6b-a71d-491c-bd63-5198a70aac1a-delete_volume" released by "delete_volume" :: held 4.391s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:56:33 devstack sudo[100893]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b2d3aace-cd1b-4ad7-8701-a4a5bfc6f71f tempest-VolumesDeleteCascade-1588680236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2.info" returned: 0 in 1.289s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:33 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-b2d3aace-cd1b-4ad7-8701-a4a5bfc6f71f tempest-VolumesDeleteCascade-1588680236 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2.info is being set with open permissions: ugo+rw Jul 08 01:56:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b2d3aace-cd1b-4ad7-8701-a4a5bfc6f71f tempest-VolumesDeleteCascade-1588680236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:33 devstack sudo[100898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2.info Jul 08 01:56:33 devstack sudo[100898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:34 devstack sudo[100898]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b2d3aace-cd1b-4ad7-8701-a4a5bfc6f71f tempest-VolumesDeleteCascade-1588680236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2.info" returned: 0 in 0.769s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b2d3aace-cd1b-4ad7-8701-a4a5bfc6f71f tempest-VolumesDeleteCascade-1588680236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.145s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:56:34 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-b2d3aace-cd1b-4ad7-8701-a4a5bfc6f71f tempest-VolumesDeleteCascade-1588680236 None] Create snapshot completed successfully Jul 08 01:56:35 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-b91f2699-6f2d-4eb5-9196-fe62409957b7 tempest-VolumesDeleteCascade-1588680236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:56:35 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b91f2699-6f2d-4eb5-9196-fe62409957b7 tempest-VolumesDeleteCascade-1588680236 None] Flow 'volume_create_manager' (603c89cd-94c2-49a6-9911-d13cb64a1c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:56:35 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b91f2699-6f2d-4eb5-9196-fe62409957b7 tempest-VolumesDeleteCascade-1588680236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a106bd7-c674-4bb0-95aa-6c12f189a3de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:35 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b91f2699-6f2d-4eb5-9196-fe62409957b7 tempest-VolumesDeleteCascade-1588680236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a106bd7-c674-4bb0-95aa-6c12f189a3de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:56:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-132502329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d55b11c5-6273-4390-a21c-664ce695bec2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f0733f155f942dfbbd8d6f06702ee27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:56:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fb65a3f0-d3c5-468f-8b4f-27fffe779d3a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:56:35Z,use_quota=True,user_id='67329447c3ce49339701d73eb871f400',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:35 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b91f2699-6f2d-4eb5-9196-fe62409957b7 tempest-VolumesDeleteCascade-1588680236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e86109be-7b22-47af-bc39-5e8e390c376a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:35 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b91f2699-6f2d-4eb5-9196-fe62409957b7 tempest-VolumesDeleteCascade-1588680236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e86109be-7b22-47af-bc39-5e8e390c376a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:35 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b91f2699-6f2d-4eb5-9196-fe62409957b7 tempest-VolumesDeleteCascade-1588680236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b64a058-ca44-45d7-a283-7aabe2e7a4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:35 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b91f2699-6f2d-4eb5-9196-fe62409957b7 tempest-VolumesDeleteCascade-1588680236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b64a058-ca44-45d7-a283-7aabe2e7a4c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd55b11c5-6273-4390-a21c-664ce695bec2', 'volume_name': 'volume-d55b11c5-6273-4390-a21c-664ce695bec2', 'volume_size': 1, 'snapshot_id': 'fb65a3f0-d3c5-468f-8b4f-27fffe779d3a'}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:35 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b91f2699-6f2d-4eb5-9196-fe62409957b7 tempest-VolumesDeleteCascade-1588680236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c60b883-01d6-4858-8b54-e99c4cbad818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:35 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b91f2699-6f2d-4eb5-9196-fe62409957b7 tempest-VolumesDeleteCascade-1588680236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c60b883-01d6-4858-8b54-e99c4cbad818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:35 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b91f2699-6f2d-4eb5-9196-fe62409957b7 tempest-VolumesDeleteCascade-1588680236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (478e939b-6a98-4ee0-9941-f9c0213fc146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:35 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-b91f2699-6f2d-4eb5-9196-fe62409957b7 tempest-VolumesDeleteCascade-1588680236 None] Volume d55b11c5-6273-4390-a21c-664ce695bec2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d55b11c5-6273-4390-a21c-664ce695bec2', 'volume_size': 1, 'snapshot_id': 'fb65a3f0-d3c5-468f-8b4f-27fffe779d3a'} Jul 08 01:56:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b91f2699-6f2d-4eb5-9196-fe62409957b7 tempest-VolumesDeleteCascade-1588680236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:56:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b91f2699-6f2d-4eb5-9196-fe62409957b7 tempest-VolumesDeleteCascade-1588680236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:56:35 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-b91f2699-6f2d-4eb5-9196-fe62409957b7 tempest-VolumesDeleteCascade-1588680236 None] Acquiring lock "cinder-quobyte-fb65a3f0-d3c5-468f-8b4f-27fffe779d3a-d55b11c5-6273-4390-a21c-664ce695bec2" by "_create_volume_from_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:56:35 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-b91f2699-6f2d-4eb5-9196-fe62409957b7 tempest-VolumesDeleteCascade-1588680236 None] Lock "cinder-quobyte-fb65a3f0-d3c5-468f-8b4f-27fffe779d3a-d55b11c5-6273-4390-a21c-664ce695bec2" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:56:35 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-b91f2699-6f2d-4eb5-9196-fe62409957b7 tempest-VolumesDeleteCascade-1588680236 None] Creating volume d55b11c5-6273-4390-a21c-664ce695bec2 from snapshot fb65a3f0-d3c5-468f-8b4f-27fffe779d3a {{(pid=87134) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 01:56:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b91f2699-6f2d-4eb5-9196-fe62409957b7 tempest-VolumesDeleteCascade-1588680236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:56:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b91f2699-6f2d-4eb5-9196-fe62409957b7 tempest-VolumesDeleteCascade-1588680236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:56:35 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-b91f2699-6f2d-4eb5-9196-fe62409957b7 tempest-VolumesDeleteCascade-1588680236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:56:35 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-b91f2699-6f2d-4eb5-9196-fe62409957b7 tempest-VolumesDeleteCascade-1588680236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:56:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b91f2699-6f2d-4eb5-9196-fe62409957b7 tempest-VolumesDeleteCascade-1588680236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:56:35 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-b91f2699-6f2d-4eb5-9196-fe62409957b7 tempest-VolumesDeleteCascade-1588680236 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:56:35 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-b91f2699-6f2d-4eb5-9196-fe62409957b7 tempest-VolumesDeleteCascade-1588680236 None] Acquiring lock "cinder-quobyte-d55b11c5-6273-4390-a21c-664ce695bec2" by "_copy_volume_from_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:56:35 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-b91f2699-6f2d-4eb5-9196-fe62409957b7 tempest-VolumesDeleteCascade-1588680236 None] Lock "cinder-quobyte-d55b11c5-6273-4390-a21c-664ce695bec2" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:56:35 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-b91f2699-6f2d-4eb5-9196-fe62409957b7 tempest-VolumesDeleteCascade-1588680236 None] snapshot: fb65a3f0-d3c5-468f-8b4f-27fffe779d3a, volume: d55b11c5-6273-4390-a21c-664ce695bec2, {{(pid=87134) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 01:56:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b91f2699-6f2d-4eb5-9196-fe62409957b7 tempest-VolumesDeleteCascade-1588680236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:56:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b91f2699-6f2d-4eb5-9196-fe62409957b7 tempest-VolumesDeleteCascade-1588680236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:56:35 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-b91f2699-6f2d-4eb5-9196-fe62409957b7 tempest-VolumesDeleteCascade-1588680236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:56:35 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-b91f2699-6f2d-4eb5-9196-fe62409957b7 tempest-VolumesDeleteCascade-1588680236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:56:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b91f2699-6f2d-4eb5-9196-fe62409957b7 tempest-VolumesDeleteCascade-1588680236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:56:35 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[367c8f98-0c58-4b99-8723-5dcdace242c3]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:56:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b91f2699-6f2d-4eb5-9196-fe62409957b7 tempest-VolumesDeleteCascade-1588680236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2.fb65a3f0-d3c5-468f-8b4f-27fffe779d3a {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:35 devstack sudo[100902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2.fb65a3f0-d3c5-468f-8b4f-27fffe779d3a Jul 08 01:56:35 devstack sudo[100902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:36 devstack sudo[100902]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b91f2699-6f2d-4eb5-9196-fe62409957b7 tempest-VolumesDeleteCascade-1588680236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2.fb65a3f0-d3c5-468f-8b4f-27fffe779d3a" returned: 0 in 1.237s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:36 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-b91f2699-6f2d-4eb5-9196-fe62409957b7 tempest-VolumesDeleteCascade-1588680236 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:56:36 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-b91f2699-6f2d-4eb5-9196-fe62409957b7 tempest-VolumesDeleteCascade-1588680236 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2 {{(pid=87134) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 01:56:36 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-b91f2699-6f2d-4eb5-9196-fe62409957b7 tempest-VolumesDeleteCascade-1588680236 None] Creating direct copy from snapshot {{(pid=87134) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 01:56:36 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc18104-2c26-4674-b7c8-b56757272260]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:56:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b91f2699-6f2d-4eb5-9196-fe62409957b7 tempest-VolumesDeleteCascade-1588680236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:37 devstack sudo[100909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2 Jul 08 01:56:37 devstack sudo[100909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:38 devstack sudo[100909]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b91f2699-6f2d-4eb5-9196-fe62409957b7 tempest-VolumesDeleteCascade-1588680236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2" returned: 0 in 1.273s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:38 devstack cinder-volume[87134]: DEBUG cinder.utils [None req-b91f2699-6f2d-4eb5-9196-fe62409957b7 tempest-VolumesDeleteCascade-1588680236 None] Path /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d55b11c5-6273-4390-a21c-664ce695bec2 not found in is_blk_device check {{(pid=87134) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 01:56:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b91f2699-6f2d-4eb5-9196-fe62409957b7 tempest-VolumesDeleteCascade-1588680236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d55b11c5-6273-4390-a21c-664ce695bec2 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:38 devstack sudo[100914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d55b11c5-6273-4390-a21c-664ce695bec2 Jul 08 01:56:38 devstack sudo[100914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:45 devstack sudo[100914]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b91f2699-6f2d-4eb5-9196-fe62409957b7 tempest-VolumesDeleteCascade-1588680236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d55b11c5-6273-4390-a21c-664ce695bec2" returned: 0 in 6.916s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:45 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[beadb23d-8bdd-4563-891f-06c02e641ab1]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:56:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b91f2699-6f2d-4eb5-9196-fe62409957b7 tempest-VolumesDeleteCascade-1588680236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:45 devstack sudo[100940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2 Jul 08 01:56:45 devstack sudo[100940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:45 devstack cinder-volume[87134]: DEBUG dbcounter [-] [87134] Writing DB stats cinder:SELECT=7,cinder:INSERT=2,cinder:UPDATE=11 {{(pid=87134) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:56:45 devstack cinder-volume[87134]: DEBUG dbcounter [-] [87134] Writing DB stats cinder:INSERT=3,cinder:UPDATE=7,cinder:SELECT=8,cinder:DELETE=2 {{(pid=87134) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:56:46 devstack sudo[100940]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b91f2699-6f2d-4eb5-9196-fe62409957b7 tempest-VolumesDeleteCascade-1588680236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2" returned: 0 in 1.088s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:46 devstack cinder-volume[87134]: DEBUG cinder.image.image_utils [None req-b91f2699-6f2d-4eb5-9196-fe62409957b7 tempest-VolumesDeleteCascade-1588680236 None] Image conversion details: src /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2, size 1024.00 MB, duration 6.92 sec, destination /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d55b11c5-6273-4390-a21c-664ce695bec2 {{(pid=87134) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:56:46 devstack cinder-volume[87134]: INFO cinder.image.image_utils [None req-b91f2699-6f2d-4eb5-9196-fe62409957b7 tempest-VolumesDeleteCascade-1588680236 None] Converted 1024.00 MB image at 148.05 MB/s Jul 08 01:56:46 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-b91f2699-6f2d-4eb5-9196-fe62409957b7 tempest-VolumesDeleteCascade-1588680236 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d55b11c5-6273-4390-a21c-664ce695bec2 is being set with open permissions: ugo+rw Jul 08 01:56:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b91f2699-6f2d-4eb5-9196-fe62409957b7 tempest-VolumesDeleteCascade-1588680236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d55b11c5-6273-4390-a21c-664ce695bec2 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:46 devstack sudo[100945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d55b11c5-6273-4390-a21c-664ce695bec2 Jul 08 01:56:46 devstack sudo[100945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:47 devstack sudo[100945]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b91f2699-6f2d-4eb5-9196-fe62409957b7 tempest-VolumesDeleteCascade-1588680236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d55b11c5-6273-4390-a21c-664ce695bec2" returned: 0 in 0.857s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:47 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-b91f2699-6f2d-4eb5-9196-fe62409957b7 tempest-VolumesDeleteCascade-1588680236 None] Lock "cinder-quobyte-d55b11c5-6273-4390-a21c-664ce695bec2" released by "_copy_volume_from_snapshot" :: held 11.540s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:56:47 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-b91f2699-6f2d-4eb5-9196-fe62409957b7 tempest-VolumesDeleteCascade-1588680236 None] Lock "cinder-quobyte-fb65a3f0-d3c5-468f-8b4f-27fffe779d3a-d55b11c5-6273-4390-a21c-664ce695bec2" released by "_create_volume_from_snapshot" :: held 11.585s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:56:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b91f2699-6f2d-4eb5-9196-fe62409957b7 tempest-VolumesDeleteCascade-1588680236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.608s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:56:47 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b91f2699-6f2d-4eb5-9196-fe62409957b7 tempest-VolumesDeleteCascade-1588680236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (478e939b-6a98-4ee0-9941-f9c0213fc146) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d55b11c5-6273-4390-a21c-664ce695bec2', 'volume_size': 1, 'snapshot_id': 'fb65a3f0-d3c5-468f-8b4f-27fffe779d3a'}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:47 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b91f2699-6f2d-4eb5-9196-fe62409957b7 tempest-VolumesDeleteCascade-1588680236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (663ebaeb-238e-4211-8f6b-4ea289bc1654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:56:47 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-b91f2699-6f2d-4eb5-9196-fe62409957b7 tempest-VolumesDeleteCascade-1588680236 None] Volume volume-d55b11c5-6273-4390-a21c-664ce695bec2 (d55b11c5-6273-4390-a21c-664ce695bec2): created successfully Jul 08 01:56:47 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b91f2699-6f2d-4eb5-9196-fe62409957b7 tempest-VolumesDeleteCascade-1588680236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (663ebaeb-238e-4211-8f6b-4ea289bc1654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:56:47 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b91f2699-6f2d-4eb5-9196-fe62409957b7 tempest-VolumesDeleteCascade-1588680236 None] Flow 'volume_create_manager' (603c89cd-94c2-49a6-9911-d13cb64a1c6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:56:47 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-b91f2699-6f2d-4eb5-9196-fe62409957b7 tempest-VolumesDeleteCascade-1588680236 None] Created volume successfully. Jul 08 01:56:47 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7508f56e-c4ea-4674-a5fa-96c924b2bcae tempest-VolumesDeleteCascade-1588680236 None] Acquiring lock "cinder-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:56:48 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7508f56e-c4ea-4674-a5fa-96c924b2bcae tempest-VolumesDeleteCascade-1588680236 None] Lock "cinder-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:56:48 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-7508f56e-c4ea-4674-a5fa-96c924b2bcae tempest-VolumesDeleteCascade-1588680236 None] Performing cascade delete. {{(pid=87134) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 08 01:56:48 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7508f56e-c4ea-4674-a5fa-96c924b2bcae tempest-VolumesDeleteCascade-1588680236 None] Acquiring lock "cinder-fb65a3f0-d3c5-468f-8b4f-27fffe779d3a-delete_snapshot" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:56:48 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7508f56e-c4ea-4674-a5fa-96c924b2bcae tempest-VolumesDeleteCascade-1588680236 None] Lock "cinder-fb65a3f0-d3c5-468f-8b4f-27fffe779d3a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:56:48 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7508f56e-c4ea-4674-a5fa-96c924b2bcae tempest-VolumesDeleteCascade-1588680236 None] Acquiring lock "cinder-quobyte-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:56:48 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7508f56e-c4ea-4674-a5fa-96c924b2bcae tempest-VolumesDeleteCascade-1588680236 None] Lock "cinder-quobyte-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:56:48 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7508f56e-c4ea-4674-a5fa-96c924b2bcae tempest-VolumesDeleteCascade-1588680236 None] Acquiring lock "cinder-quobyte-fb65a3f0-d3c5-468f-8b4f-27fffe779d3a" by "_delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:56:48 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7508f56e-c4ea-4674-a5fa-96c924b2bcae tempest-VolumesDeleteCascade-1588680236 None] Lock "cinder-quobyte-fb65a3f0-d3c5-468f-8b4f-27fffe779d3a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:56:48 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-7508f56e-c4ea-4674-a5fa-96c924b2bcae tempest-VolumesDeleteCascade-1588680236 None] Deleting offline snapshot fb65a3f0-d3c5-468f-8b4f-27fffe779d3a of volume 4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2 {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:56:48 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-7508f56e-c4ea-4674-a5fa-96c924b2bcae tempest-VolumesDeleteCascade-1588680236 None] snapshot_file for this snap is: volume-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2.fb65a3f0-d3c5-468f-8b4f-27fffe779d3a {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:56:48 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[3168123e-e197-4cd3-a190-7d13b5936fc9]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:56:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7508f56e-c4ea-4674-a5fa-96c924b2bcae tempest-VolumesDeleteCascade-1588680236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2.fb65a3f0-d3c5-468f-8b4f-27fffe779d3a {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:48 devstack sudo[100950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2.fb65a3f0-d3c5-468f-8b4f-27fffe779d3a Jul 08 01:56:48 devstack sudo[100950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:49 devstack sudo[100950]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:49 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7508f56e-c4ea-4674-a5fa-96c924b2bcae tempest-VolumesDeleteCascade-1588680236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2.fb65a3f0-d3c5-468f-8b4f-27fffe779d3a" returned: 0 in 0.869s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:49 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-7508f56e-c4ea-4674-a5fa-96c924b2bcae tempest-VolumesDeleteCascade-1588680236 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:56:49 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[702e6c4a-6e35-49bc-ab10-0ba06f9d9f7d]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:56:49 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7508f56e-c4ea-4674-a5fa-96c924b2bcae tempest-VolumesDeleteCascade-1588680236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:49 devstack sudo[100956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2 Jul 08 01:56:49 devstack sudo[100956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:49 devstack sudo[100956]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:49 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7508f56e-c4ea-4674-a5fa-96c924b2bcae tempest-VolumesDeleteCascade-1588680236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2" returned: 0 in 0.911s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:49 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7508f56e-c4ea-4674-a5fa-96c924b2bcae tempest-VolumesDeleteCascade-1588680236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2.fb65a3f0-d3c5-468f-8b4f-27fffe779d3a {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:49 devstack sudo[100961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2.fb65a3f0-d3c5-468f-8b4f-27fffe779d3a Jul 08 01:56:49 devstack sudo[100961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:50 devstack sudo[100961]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:50 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7508f56e-c4ea-4674-a5fa-96c924b2bcae tempest-VolumesDeleteCascade-1588680236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2.fb65a3f0-d3c5-468f-8b4f-27fffe779d3a" returned: 0 in 0.889s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:50 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7508f56e-c4ea-4674-a5fa-96c924b2bcae tempest-VolumesDeleteCascade-1588680236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2.fb65a3f0-d3c5-468f-8b4f-27fffe779d3a {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:50 devstack sudo[100967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2.fb65a3f0-d3c5-468f-8b4f-27fffe779d3a Jul 08 01:56:50 devstack sudo[100967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:51 devstack sudo[100967]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7508f56e-c4ea-4674-a5fa-96c924b2bcae tempest-VolumesDeleteCascade-1588680236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2.fb65a3f0-d3c5-468f-8b4f-27fffe779d3a" returned: 0 in 0.725s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:51 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7508f56e-c4ea-4674-a5fa-96c924b2bcae tempest-VolumesDeleteCascade-1588680236 None] Lock "cinder-quobyte-fb65a3f0-d3c5-468f-8b4f-27fffe779d3a" released by "_delete_snapshot" :: held 3.501s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:56:51 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7508f56e-c4ea-4674-a5fa-96c924b2bcae tempest-VolumesDeleteCascade-1588680236 None] Lock "cinder-quobyte-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2" released by "delete_snapshot" :: held 3.526s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:56:51 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-7508f56e-c4ea-4674-a5fa-96c924b2bcae tempest-VolumesDeleteCascade-1588680236 None] Created reservations ['02287bea-c640-4e56-b6b6-255ebd5e73a0', 'cd62497f-f7e7-4f85-9184-206c796c5368', 'c4519d14-ba6d-4e62-a88b-31214ea3f5e9', 'e488e004-42b8-4349-acba-4ec557b8da97'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:56:51 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-7508f56e-c4ea-4674-a5fa-96c924b2bcae tempest-VolumesDeleteCascade-1588680236 None] Delete snapshot completed successfully. Jul 08 01:56:51 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7508f56e-c4ea-4674-a5fa-96c924b2bcae tempest-VolumesDeleteCascade-1588680236 None] Lock "cinder-fb65a3f0-d3c5-468f-8b4f-27fffe779d3a-delete_snapshot" released by "delete_snapshot" :: held 3.760s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:56:51 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-7508f56e-c4ea-4674-a5fa-96c924b2bcae tempest-VolumesDeleteCascade-1588680236 None] Snapshots deleted, issuing volume delete {{(pid=87134) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 08 01:56:51 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7508f56e-c4ea-4674-a5fa-96c924b2bcae tempest-VolumesDeleteCascade-1588680236 None] Acquiring lock "cinder-quobyte-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:56:51 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7508f56e-c4ea-4674-a5fa-96c924b2bcae tempest-VolumesDeleteCascade-1588680236 None] Lock "cinder-quobyte-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2" acquired by "delete_volume" :: waited 0.022s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:56:51 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab98efd2-d535-46ff-ab34-b62361bd0a91]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:56:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7508f56e-c4ea-4674-a5fa-96c924b2bcae tempest-VolumesDeleteCascade-1588680236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:52 devstack sudo[100970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2 Jul 08 01:56:52 devstack sudo[100970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:52 devstack sudo[100970]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:52 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7508f56e-c4ea-4674-a5fa-96c924b2bcae tempest-VolumesDeleteCascade-1588680236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2" returned: 0 in 0.907s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:52 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7508f56e-c4ea-4674-a5fa-96c924b2bcae tempest-VolumesDeleteCascade-1588680236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:52 devstack sudo[100976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2 Jul 08 01:56:52 devstack sudo[100976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:53 devstack sudo[100976]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7508f56e-c4ea-4674-a5fa-96c924b2bcae tempest-VolumesDeleteCascade-1588680236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2" returned: 0 in 0.728s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:53 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7508f56e-c4ea-4674-a5fa-96c924b2bcae tempest-VolumesDeleteCascade-1588680236 None] Lock "cinder-quobyte-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2" released by "delete_volume" :: held 1.722s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:56:53 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-7508f56e-c4ea-4674-a5fa-96c924b2bcae tempest-VolumesDeleteCascade-1588680236 None] Created reservations ['0d151e8d-773b-4f6c-ba76-c5936b273c1b', 'b578c56e-b59a-45f1-8559-856a782c8528', 'b3f3ffb6-8c6c-43ee-a472-7f2407c85b43', 'fc6ef15c-7c1c-4681-9250-5df3c73bce5f'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:56:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7508f56e-c4ea-4674-a5fa-96c924b2bcae tempest-VolumesDeleteCascade-1588680236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:56:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7508f56e-c4ea-4674-a5fa-96c924b2bcae tempest-VolumesDeleteCascade-1588680236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:56:53 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-7508f56e-c4ea-4674-a5fa-96c924b2bcae tempest-VolumesDeleteCascade-1588680236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:56:53 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-7508f56e-c4ea-4674-a5fa-96c924b2bcae tempest-VolumesDeleteCascade-1588680236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:56:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7508f56e-c4ea-4674-a5fa-96c924b2bcae tempest-VolumesDeleteCascade-1588680236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:56:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7508f56e-c4ea-4674-a5fa-96c924b2bcae tempest-VolumesDeleteCascade-1588680236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:53 devstack sudo[100979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:56:53 devstack sudo[100979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:54 devstack sudo[100979]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7508f56e-c4ea-4674-a5fa-96c924b2bcae tempest-VolumesDeleteCascade-1588680236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.685s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:54 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-7508f56e-c4ea-4674-a5fa-96c924b2bcae tempest-VolumesDeleteCascade-1588680236 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:56:54 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-7508f56e-c4ea-4674-a5fa-96c924b2bcae tempest-VolumesDeleteCascade-1588680236 None] Deleted volume successfully. Jul 08 01:56:54 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7508f56e-c4ea-4674-a5fa-96c924b2bcae tempest-VolumesDeleteCascade-1588680236 None] Lock "cinder-4fb7989f-4ef5-4c17-bb7d-fe69ee0725d2-delete_volume" released by "delete_volume" :: held 6.429s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:56:54 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-6ff3b0a3-65a0-4a21-948a-aa7771c34e2f tempest-VolumesDeleteCascade-1588680236 None] Acquiring lock "cinder-d55b11c5-6273-4390-a21c-664ce695bec2-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:56:54 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-6ff3b0a3-65a0-4a21-948a-aa7771c34e2f tempest-VolumesDeleteCascade-1588680236 None] Lock "cinder-d55b11c5-6273-4390-a21c-664ce695bec2-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:56:54 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-6ff3b0a3-65a0-4a21-948a-aa7771c34e2f tempest-VolumesDeleteCascade-1588680236 None] Acquiring lock "cinder-quobyte-d55b11c5-6273-4390-a21c-664ce695bec2" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:56:54 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-6ff3b0a3-65a0-4a21-948a-aa7771c34e2f tempest-VolumesDeleteCascade-1588680236 None] Lock "cinder-quobyte-d55b11c5-6273-4390-a21c-664ce695bec2" acquired by "delete_volume" :: waited 0.027s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:56:54 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[b149f1ee-0b45-487e-904a-d95a63d9e75e]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:56:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6ff3b0a3-65a0-4a21-948a-aa7771c34e2f tempest-VolumesDeleteCascade-1588680236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d55b11c5-6273-4390-a21c-664ce695bec2 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:54 devstack sudo[100982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d55b11c5-6273-4390-a21c-664ce695bec2 Jul 08 01:56:54 devstack sudo[100982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:55 devstack sudo[100982]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:55 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6ff3b0a3-65a0-4a21-948a-aa7771c34e2f tempest-VolumesDeleteCascade-1588680236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d55b11c5-6273-4390-a21c-664ce695bec2" returned: 0 in 0.965s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:55 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6ff3b0a3-65a0-4a21-948a-aa7771c34e2f tempest-VolumesDeleteCascade-1588680236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d55b11c5-6273-4390-a21c-664ce695bec2 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:55 devstack sudo[100987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d55b11c5-6273-4390-a21c-664ce695bec2 Jul 08 01:56:55 devstack sudo[100987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:56 devstack sudo[100987]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:56 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6ff3b0a3-65a0-4a21-948a-aa7771c34e2f tempest-VolumesDeleteCascade-1588680236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d55b11c5-6273-4390-a21c-664ce695bec2" returned: 0 in 0.687s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:56 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-6ff3b0a3-65a0-4a21-948a-aa7771c34e2f tempest-VolumesDeleteCascade-1588680236 None] Lock "cinder-quobyte-d55b11c5-6273-4390-a21c-664ce695bec2" released by "delete_volume" :: held 1.707s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:56:56 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-6ff3b0a3-65a0-4a21-948a-aa7771c34e2f tempest-VolumesDeleteCascade-1588680236 None] Created reservations ['5413b91d-ac29-4320-b19a-476002425bfd', '7687979b-fdcb-4924-8107-ae83e57dedc6', '928d8ee3-13dc-4bf5-b640-856c377e9a68', '6e335450-130c-42ef-8d96-5d1553caffab'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:56:56 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6ff3b0a3-65a0-4a21-948a-aa7771c34e2f tempest-VolumesDeleteCascade-1588680236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:56:56 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6ff3b0a3-65a0-4a21-948a-aa7771c34e2f tempest-VolumesDeleteCascade-1588680236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:56:56 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-6ff3b0a3-65a0-4a21-948a-aa7771c34e2f tempest-VolumesDeleteCascade-1588680236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:56:56 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-6ff3b0a3-65a0-4a21-948a-aa7771c34e2f tempest-VolumesDeleteCascade-1588680236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:56:56 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6ff3b0a3-65a0-4a21-948a-aa7771c34e2f tempest-VolumesDeleteCascade-1588680236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:56:56 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6ff3b0a3-65a0-4a21-948a-aa7771c34e2f tempest-VolumesDeleteCascade-1588680236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:56:56 devstack sudo[100990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:56:56 devstack sudo[100990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:56:57 devstack sudo[100990]: pam_unix(sudo:session): session closed for user root Jul 08 01:56:57 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6ff3b0a3-65a0-4a21-948a-aa7771c34e2f tempest-VolumesDeleteCascade-1588680236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.906s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:56:57 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-6ff3b0a3-65a0-4a21-948a-aa7771c34e2f tempest-VolumesDeleteCascade-1588680236 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:56:57 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-6ff3b0a3-65a0-4a21-948a-aa7771c34e2f tempest-VolumesDeleteCascade-1588680236 None] Deleted volume successfully. Jul 08 01:56:57 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-6ff3b0a3-65a0-4a21-948a-aa7771c34e2f tempest-VolumesDeleteCascade-1588680236 None] Lock "cinder-d55b11c5-6273-4390-a21c-664ce695bec2-delete_volume" released by "delete_volume" :: held 2.912s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:57:00 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cc1325a-215c-4ca0-aa2d-d1f06a33a25b tempest-VolumesCloneNegativeTest-1151356936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:57:00 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-7cc1325a-215c-4ca0-aa2d-d1f06a33a25b tempest-VolumesCloneNegativeTest-1151356936 None] Flow 'volume_create_manager' (4f321379-0643-4908-9349-73682fc0e6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:57:00 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-7cc1325a-215c-4ca0-aa2d-d1f06a33a25b tempest-VolumesCloneNegativeTest-1151356936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (277569f0-6b00-40ab-806a-cb93d768d2e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:01 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-7cc1325a-215c-4ca0-aa2d-d1f06a33a25b tempest-VolumesCloneNegativeTest-1151356936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (277569f0-6b00-40ab-806a-cb93d768d2e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:57:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-479995787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77c007a1-c9ff-4602-a9ac-5d9c93db43ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a25ec62a67ef49efad47d86fd199e6e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:57:01Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:57:01Z,use_quota=True,user_id='eab56932955b4caebe3d4b78363f3d00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:01 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-7cc1325a-215c-4ca0-aa2d-d1f06a33a25b tempest-VolumesCloneNegativeTest-1151356936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c6b2d0b-cf6b-4228-8a79-30112d393758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:01 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-7cc1325a-215c-4ca0-aa2d-d1f06a33a25b tempest-VolumesCloneNegativeTest-1151356936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c6b2d0b-cf6b-4228-8a79-30112d393758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:01 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-7cc1325a-215c-4ca0-aa2d-d1f06a33a25b tempest-VolumesCloneNegativeTest-1151356936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0cf3ced-2467-4c27-bf98-a4dc72dad154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:01 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-7cc1325a-215c-4ca0-aa2d-d1f06a33a25b tempest-VolumesCloneNegativeTest-1151356936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0cf3ced-2467-4c27-bf98-a4dc72dad154) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77c007a1-c9ff-4602-a9ac-5d9c93db43ca', 'volume_name': 'volume-77c007a1-c9ff-4602-a9ac-5d9c93db43ca', 'volume_size': 2}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:01 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-7cc1325a-215c-4ca0-aa2d-d1f06a33a25b tempest-VolumesCloneNegativeTest-1151356936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b2f4d5d-cbb0-46b4-9b2b-d487e4cbe684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:01 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-7cc1325a-215c-4ca0-aa2d-d1f06a33a25b tempest-VolumesCloneNegativeTest-1151356936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b2f4d5d-cbb0-46b4-9b2b-d487e4cbe684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:01 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-7cc1325a-215c-4ca0-aa2d-d1f06a33a25b tempest-VolumesCloneNegativeTest-1151356936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d18403fc-2615-4c7e-8253-c8aae750093e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:01 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-7cc1325a-215c-4ca0-aa2d-d1f06a33a25b tempest-VolumesCloneNegativeTest-1151356936 None] Volume 77c007a1-c9ff-4602-a9ac-5d9c93db43ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77c007a1-c9ff-4602-a9ac-5d9c93db43ca', 'volume_size': 2} Jul 08 01:57:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7cc1325a-215c-4ca0-aa2d-d1f06a33a25b tempest-VolumesCloneNegativeTest-1151356936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:57:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7cc1325a-215c-4ca0-aa2d-d1f06a33a25b tempest-VolumesCloneNegativeTest-1151356936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:57:01 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-7cc1325a-215c-4ca0-aa2d-d1f06a33a25b tempest-VolumesCloneNegativeTest-1151356936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:57:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-479995787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77c007a1-c9ff-4602-a9ac-5d9c93db43ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a25ec62a67ef49efad47d86fd199e6e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:57:01Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:57:01Z,use_quota=True,user_id='eab56932955b4caebe3d4b78363f3d00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:57:01 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-7cc1325a-215c-4ca0-aa2d-d1f06a33a25b tempest-VolumesCloneNegativeTest-1151356936 None] Creating volume 77c007a1-c9ff-4602-a9ac-5d9c93db43ca {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:57:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7cc1325a-215c-4ca0-aa2d-d1f06a33a25b tempest-VolumesCloneNegativeTest-1151356936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:57:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7cc1325a-215c-4ca0-aa2d-d1f06a33a25b tempest-VolumesCloneNegativeTest-1151356936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:57:01 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-7cc1325a-215c-4ca0-aa2d-d1f06a33a25b tempest-VolumesCloneNegativeTest-1151356936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:57:01 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-7cc1325a-215c-4ca0-aa2d-d1f06a33a25b tempest-VolumesCloneNegativeTest-1151356936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:57:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7cc1325a-215c-4ca0-aa2d-d1f06a33a25b tempest-VolumesCloneNegativeTest-1151356936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:57:01 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-7cc1325a-215c-4ca0-aa2d-d1f06a33a25b tempest-VolumesCloneNegativeTest-1151356936 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:57:01 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-7cc1325a-215c-4ca0-aa2d-d1f06a33a25b tempest-VolumesCloneNegativeTest-1151356936 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:57:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7cc1325a-215c-4ca0-aa2d-d1f06a33a25b tempest-VolumesCloneNegativeTest-1151356936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-77c007a1-c9ff-4602-a9ac-5d9c93db43ca 2147483648 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:01 devstack sudo[100993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-77c007a1-c9ff-4602-a9ac-5d9c93db43ca 2147483648 Jul 08 01:57:01 devstack sudo[100993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:02 devstack sudo[100993]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7cc1325a-215c-4ca0-aa2d-d1f06a33a25b tempest-VolumesCloneNegativeTest-1151356936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-77c007a1-c9ff-4602-a9ac-5d9c93db43ca 2147483648" returned: 0 in 1.194s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7cc1325a-215c-4ca0-aa2d-d1f06a33a25b tempest-VolumesCloneNegativeTest-1151356936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-77c007a1-c9ff-4602-a9ac-5d9c93db43ca {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:02 devstack sudo[100999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-77c007a1-c9ff-4602-a9ac-5d9c93db43ca Jul 08 01:57:02 devstack sudo[100999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:03 devstack sudo[100999]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:03 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7cc1325a-215c-4ca0-aa2d-d1f06a33a25b tempest-VolumesCloneNegativeTest-1151356936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-77c007a1-c9ff-4602-a9ac-5d9c93db43ca" returned: 0 in 0.733s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:03 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-7cc1325a-215c-4ca0-aa2d-d1f06a33a25b tempest-VolumesCloneNegativeTest-1151356936 None] <== create_volume: return (1986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:57:03 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7cc1325a-215c-4ca0-aa2d-d1f06a33a25b tempest-VolumesCloneNegativeTest-1151356936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.989s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:57:03 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-7cc1325a-215c-4ca0-aa2d-d1f06a33a25b tempest-VolumesCloneNegativeTest-1151356936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d18403fc-2615-4c7e-8253-c8aae750093e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77c007a1-c9ff-4602-a9ac-5d9c93db43ca', 'volume_size': 2}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:03 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-7cc1325a-215c-4ca0-aa2d-d1f06a33a25b tempest-VolumesCloneNegativeTest-1151356936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67f6d5d5-1ee5-4aa6-877e-d7378a193003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:03 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-7cc1325a-215c-4ca0-aa2d-d1f06a33a25b tempest-VolumesCloneNegativeTest-1151356936 None] Volume volume-77c007a1-c9ff-4602-a9ac-5d9c93db43ca (77c007a1-c9ff-4602-a9ac-5d9c93db43ca): created successfully Jul 08 01:57:03 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-7cc1325a-215c-4ca0-aa2d-d1f06a33a25b tempest-VolumesCloneNegativeTest-1151356936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67f6d5d5-1ee5-4aa6-877e-d7378a193003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:03 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-7cc1325a-215c-4ca0-aa2d-d1f06a33a25b tempest-VolumesCloneNegativeTest-1151356936 None] Flow 'volume_create_manager' (4f321379-0643-4908-9349-73682fc0e6ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:57:03 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-7cc1325a-215c-4ca0-aa2d-d1f06a33a25b tempest-VolumesCloneNegativeTest-1151356936 None] Created volume successfully. Jul 08 01:57:04 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-1a48c634-357d-4c7f-83cc-9d4e3f5574a4 tempest-VolumesCloneNegativeTest-1151356936 None] Acquiring lock "cinder-77c007a1-c9ff-4602-a9ac-5d9c93db43ca-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:57:04 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-1a48c634-357d-4c7f-83cc-9d4e3f5574a4 tempest-VolumesCloneNegativeTest-1151356936 None] Lock "cinder-77c007a1-c9ff-4602-a9ac-5d9c93db43ca-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:57:04 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-1a48c634-357d-4c7f-83cc-9d4e3f5574a4 tempest-VolumesCloneNegativeTest-1151356936 None] Acquiring lock "cinder-quobyte-77c007a1-c9ff-4602-a9ac-5d9c93db43ca" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:57:04 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-1a48c634-357d-4c7f-83cc-9d4e3f5574a4 tempest-VolumesCloneNegativeTest-1151356936 None] Lock "cinder-quobyte-77c007a1-c9ff-4602-a9ac-5d9c93db43ca" acquired by "delete_volume" :: waited 0.019s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:57:04 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04daaaa-8123-4d53-9de4-100b079664e6]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:57:04 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1a48c634-357d-4c7f-83cc-9d4e3f5574a4 tempest-VolumesCloneNegativeTest-1151356936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-77c007a1-c9ff-4602-a9ac-5d9c93db43ca {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:04 devstack sudo[101005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-77c007a1-c9ff-4602-a9ac-5d9c93db43ca Jul 08 01:57:04 devstack sudo[101005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:05 devstack sudo[101005]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:05 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1a48c634-357d-4c7f-83cc-9d4e3f5574a4 tempest-VolumesCloneNegativeTest-1151356936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-77c007a1-c9ff-4602-a9ac-5d9c93db43ca" returned: 0 in 0.906s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:05 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1a48c634-357d-4c7f-83cc-9d4e3f5574a4 tempest-VolumesCloneNegativeTest-1151356936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-77c007a1-c9ff-4602-a9ac-5d9c93db43ca {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:05 devstack sudo[101010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-77c007a1-c9ff-4602-a9ac-5d9c93db43ca Jul 08 01:57:05 devstack sudo[101010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:06 devstack sudo[101010]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:06 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1a48c634-357d-4c7f-83cc-9d4e3f5574a4 tempest-VolumesCloneNegativeTest-1151356936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-77c007a1-c9ff-4602-a9ac-5d9c93db43ca" returned: 0 in 0.764s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:06 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-1a48c634-357d-4c7f-83cc-9d4e3f5574a4 tempest-VolumesCloneNegativeTest-1151356936 None] Lock "cinder-quobyte-77c007a1-c9ff-4602-a9ac-5d9c93db43ca" released by "delete_volume" :: held 1.729s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:57:06 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-1a48c634-357d-4c7f-83cc-9d4e3f5574a4 tempest-VolumesCloneNegativeTest-1151356936 None] Created reservations ['244263fb-417f-49c3-8788-a6c1e10aee2d', '2cc2871d-0154-4e93-807e-c52f567d0b6d', '315fe9f4-7d46-43eb-914e-fedfb63a3701', '55383b1e-42fa-476a-948a-a8f725b59c7a'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:57:06 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-1a48c634-357d-4c7f-83cc-9d4e3f5574a4 tempest-VolumesCloneNegativeTest-1151356936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:57:06 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-1a48c634-357d-4c7f-83cc-9d4e3f5574a4 tempest-VolumesCloneNegativeTest-1151356936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:57:06 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-1a48c634-357d-4c7f-83cc-9d4e3f5574a4 tempest-VolumesCloneNegativeTest-1151356936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:57:06 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-1a48c634-357d-4c7f-83cc-9d4e3f5574a4 tempest-VolumesCloneNegativeTest-1151356936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:57:06 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-1a48c634-357d-4c7f-83cc-9d4e3f5574a4 tempest-VolumesCloneNegativeTest-1151356936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:57:06 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1a48c634-357d-4c7f-83cc-9d4e3f5574a4 tempest-VolumesCloneNegativeTest-1151356936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:06 devstack sudo[101013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:57:06 devstack sudo[101013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:07 devstack sudo[101013]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:07 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1a48c634-357d-4c7f-83cc-9d4e3f5574a4 tempest-VolumesCloneNegativeTest-1151356936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.791s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:07 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-1a48c634-357d-4c7f-83cc-9d4e3f5574a4 tempest-VolumesCloneNegativeTest-1151356936 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:57:07 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-1a48c634-357d-4c7f-83cc-9d4e3f5574a4 tempest-VolumesCloneNegativeTest-1151356936 None] Deleted volume successfully. Jul 08 01:57:07 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-1a48c634-357d-4c7f-83cc-9d4e3f5574a4 tempest-VolumesCloneNegativeTest-1151356936 None] Lock "cinder-77c007a1-c9ff-4602-a9ac-5d9c93db43ca-delete_volume" released by "delete_volume" :: held 2.766s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:57:10 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffd4a54a-a58d-4bc7-8a5f-e5d89da41397 tempest-VolumesExtendTest-460006720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:57:10 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ffd4a54a-a58d-4bc7-8a5f-e5d89da41397 tempest-VolumesExtendTest-460006720 None] Flow 'volume_create_manager' (75004e75-b13e-44e5-ad85-ad6066dcf7c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:57:10 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ffd4a54a-a58d-4bc7-8a5f-e5d89da41397 tempest-VolumesExtendTest-460006720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86630578-b469-4c5e-b0d5-ed88bfb20fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:10 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ffd4a54a-a58d-4bc7-8a5f-e5d89da41397 tempest-VolumesExtendTest-460006720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86630578-b469-4c5e-b0d5-ed88bfb20fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:57:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1670482437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=896ae2d8-1a31-44bd-8985-f5697ab46a0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25d4b5a375834020b518e48e4ddc9471',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:57:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:57:11Z,use_quota=True,user_id='dc7b44b8dd1d45f6acedb8b0fb2881a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:10 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ffd4a54a-a58d-4bc7-8a5f-e5d89da41397 tempest-VolumesExtendTest-460006720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0988353c-dc96-4596-a518-f64e16db95b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:10 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ffd4a54a-a58d-4bc7-8a5f-e5d89da41397 tempest-VolumesExtendTest-460006720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0988353c-dc96-4596-a518-f64e16db95b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:10 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ffd4a54a-a58d-4bc7-8a5f-e5d89da41397 tempest-VolumesExtendTest-460006720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dad0542-ef82-4616-8445-63b9c1560404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:10 devstack cinder-volume[87134]: DEBUG cinder.image.glance [None req-ffd4a54a-a58d-4bc7-8a5f-e5d89da41397 tempest-VolumesExtendTest-460006720 None] Creating Keystone auth plugin from conf {{(pid=87134) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 01:57:11 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ffd4a54a-a58d-4bc7-8a5f-e5d89da41397 tempest-VolumesExtendTest-460006720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dad0542-ef82-4616-8445-63b9c1560404) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '896ae2d8-1a31-44bd-8985-f5697ab46a0c', 'volume_name': 'volume-896ae2d8-1a31-44bd-8985-f5697ab46a0c', 'volume_size': 1, 'image_id': 'd85f0fe5-8496-4fc8-ab6c-110323b36076', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d85f0fe5-8496-4fc8-ab6c-110323b36076', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '44fe2859624d49239062555b2318d354', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd85f0fe5-8496-4fc8-ab6c-110323b36076', 'created_at': datetime.datetime(2026, 7, 7, 23, 34, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 34, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d85f0fe5-8496-4fc8-ab6c-110323b36076/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:11 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ffd4a54a-a58d-4bc7-8a5f-e5d89da41397 tempest-VolumesExtendTest-460006720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21895127-a6fc-48b5-9c4c-99c2e3407d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:11 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ffd4a54a-a58d-4bc7-8a5f-e5d89da41397 tempest-VolumesExtendTest-460006720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21895127-a6fc-48b5-9c4c-99c2e3407d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:11 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ffd4a54a-a58d-4bc7-8a5f-e5d89da41397 tempest-VolumesExtendTest-460006720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e916e73-061d-49ec-b33b-f6fab6d3c4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:11 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-ffd4a54a-a58d-4bc7-8a5f-e5d89da41397 tempest-VolumesExtendTest-460006720 None] Volume 896ae2d8-1a31-44bd-8985-f5697ab46a0c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-896ae2d8-1a31-44bd-8985-f5697ab46a0c', 'volume_size': 1, 'image_id': 'd85f0fe5-8496-4fc8-ab6c-110323b36076', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d85f0fe5-8496-4fc8-ab6c-110323b36076', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '44fe2859624d49239062555b2318d354', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd85f0fe5-8496-4fc8-ab6c-110323b36076', 'created_at': datetime.datetime(2026, 7, 7, 23, 34, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 34, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d85f0fe5-8496-4fc8-ab6c-110323b36076/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 08 01:57:11 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffd4a54a-a58d-4bc7-8a5f-e5d89da41397 tempest-VolumesExtendTest-460006720 None] Trying to clone 896ae2d8-1a31-44bd-8985-f5697ab46a0c from image d85f0fe5-8496-4fc8-ab6c-110323b36076 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d85f0fe5-8496-4fc8-ab6c-110323b36076', 'metadata': {}}]). {{(pid=87134) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 01:57:11 devstack cinder-volume[87134]: DEBUG cinder.image.image_utils [None req-ffd4a54a-a58d-4bc7-8a5f-e5d89da41397 tempest-VolumesExtendTest-460006720 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d85f0fe5-8496-4fc8-ab6c-110323b36076_an_0iv0mdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87134) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 01:57:11 devstack cinder-volume[87134]: INFO cinder.image.image_utils [None req-ffd4a54a-a58d-4bc7-8a5f-e5d89da41397 tempest-VolumesExtendTest-460006720 None] Image download 20.69 MB at 20.69 MB/s Jul 08 01:57:11 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75badfd-576f-4e27-a511-93fe8e291803]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:57:11 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ffd4a54a-a58d-4bc7-8a5f-e5d89da41397 tempest-VolumesExtendTest-460006720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d85f0fe5-8496-4fc8-ab6c-110323b36076_an_0iv0mdevstack@QuobyteHD {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:11 devstack sudo[101034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d85f0fe5-8496-4fc8-ab6c-110323b36076_an_0iv0mdevstack@QuobyteHD Jul 08 01:57:11 devstack sudo[101034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:12 devstack sudo[101034]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:12 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ffd4a54a-a58d-4bc7-8a5f-e5d89da41397 tempest-VolumesExtendTest-460006720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d85f0fe5-8496-4fc8-ab6c-110323b36076_an_0iv0mdevstack@QuobyteHD" returned: 0 in 0.863s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:12 devstack cinder-volume[87134]: DEBUG cinder.image.image_utils [None req-ffd4a54a-a58d-4bc7-8a5f-e5d89da41397 tempest-VolumesExtendTest-460006720 None] Temporary image d85f0fe5-8496-4fc8-ab6c-110323b36076 is fetched for user dc7b44b8dd1d45f6acedb8b0fb2881a1. {{(pid=87134) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 01:57:12 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e69baf-7dc4-4c58-aa15-e477b28dfef9]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:57:12 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ffd4a54a-a58d-4bc7-8a5f-e5d89da41397 tempest-VolumesExtendTest-460006720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d85f0fe5-8496-4fc8-ab6c-110323b36076_an_0iv0mdevstack@QuobyteHD {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:12 devstack sudo[101043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d85f0fe5-8496-4fc8-ab6c-110323b36076_an_0iv0mdevstack@QuobyteHD Jul 08 01:57:12 devstack sudo[101043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:13 devstack sudo[101043]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ffd4a54a-a58d-4bc7-8a5f-e5d89da41397 tempest-VolumesExtendTest-460006720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d85f0fe5-8496-4fc8-ab6c-110323b36076_an_0iv0mdevstack@QuobyteHD" returned: 0 in 0.923s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-ffd4a54a-a58d-4bc7-8a5f-e5d89da41397 tempest-VolumesExtendTest-460006720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:57:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-ffd4a54a-a58d-4bc7-8a5f-e5d89da41397 tempest-VolumesExtendTest-460006720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:57:13 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-ffd4a54a-a58d-4bc7-8a5f-e5d89da41397 tempest-VolumesExtendTest-460006720 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:57:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1670482437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=896ae2d8-1a31-44bd-8985-f5697ab46a0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25d4b5a375834020b518e48e4ddc9471',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:57:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:57:11Z,use_quota=True,user_id='dc7b44b8dd1d45f6acedb8b0fb2881a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:57:13 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-ffd4a54a-a58d-4bc7-8a5f-e5d89da41397 tempest-VolumesExtendTest-460006720 None] Creating volume 896ae2d8-1a31-44bd-8985-f5697ab46a0c {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:57:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-ffd4a54a-a58d-4bc7-8a5f-e5d89da41397 tempest-VolumesExtendTest-460006720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:57:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-ffd4a54a-a58d-4bc7-8a5f-e5d89da41397 tempest-VolumesExtendTest-460006720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:57:13 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-ffd4a54a-a58d-4bc7-8a5f-e5d89da41397 tempest-VolumesExtendTest-460006720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:57:13 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-ffd4a54a-a58d-4bc7-8a5f-e5d89da41397 tempest-VolumesExtendTest-460006720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:57:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-ffd4a54a-a58d-4bc7-8a5f-e5d89da41397 tempest-VolumesExtendTest-460006720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:57:13 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-ffd4a54a-a58d-4bc7-8a5f-e5d89da41397 tempest-VolumesExtendTest-460006720 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:57:13 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-ffd4a54a-a58d-4bc7-8a5f-e5d89da41397 tempest-VolumesExtendTest-460006720 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:57:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ffd4a54a-a58d-4bc7-8a5f-e5d89da41397 tempest-VolumesExtendTest-460006720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-896ae2d8-1a31-44bd-8985-f5697ab46a0c 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:13 devstack sudo[101053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-896ae2d8-1a31-44bd-8985-f5697ab46a0c 1073741824 Jul 08 01:57:13 devstack sudo[101053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:14 devstack sudo[101053]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:14 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ffd4a54a-a58d-4bc7-8a5f-e5d89da41397 tempest-VolumesExtendTest-460006720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-896ae2d8-1a31-44bd-8985-f5697ab46a0c 1073741824" returned: 0 in 1.056s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:14 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ffd4a54a-a58d-4bc7-8a5f-e5d89da41397 tempest-VolumesExtendTest-460006720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-896ae2d8-1a31-44bd-8985-f5697ab46a0c {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:14 devstack sudo[101059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-896ae2d8-1a31-44bd-8985-f5697ab46a0c Jul 08 01:57:14 devstack sudo[101059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:15 devstack sudo[101059]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ffd4a54a-a58d-4bc7-8a5f-e5d89da41397 tempest-VolumesExtendTest-460006720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-896ae2d8-1a31-44bd-8985-f5697ab46a0c" returned: 0 in 0.928s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:15 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-ffd4a54a-a58d-4bc7-8a5f-e5d89da41397 tempest-VolumesExtendTest-460006720 None] <== create_volume: return (2034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:57:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-ffd4a54a-a58d-4bc7-8a5f-e5d89da41397 tempest-VolumesExtendTest-460006720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.042s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:57:15 devstack cinder-volume[87134]: DEBUG cinder.volume.volume_utils [None req-ffd4a54a-a58d-4bc7-8a5f-e5d89da41397 tempest-VolumesExtendTest-460006720 None] Attempting download of d85f0fe5-8496-4fc8-ab6c-110323b36076 ((None, [{'url': 'file:///opt/stack/data/glance/images/d85f0fe5-8496-4fc8-ab6c-110323b36076', 'metadata': {}}])) to volume 896ae2d8-1a31-44bd-8985-f5697ab46a0c. {{(pid=87134) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 01:57:15 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[9697e14f-4ce7-4fe2-ac23-0499a2e396d1]: (4, 'raw') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:57:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ffd4a54a-a58d-4bc7-8a5f-e5d89da41397 tempest-VolumesExtendTest-460006720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d85f0fe5-8496-4fc8-ab6c-110323b36076_0ee1yv3d {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:15 devstack sudo[101063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d85f0fe5-8496-4fc8-ab6c-110323b36076_0ee1yv3d Jul 08 01:57:15 devstack sudo[101063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-35530919-e017-4885-9849-5b04d18b1346 req-dc6c90bf-26ee-4ab2-a091-ba91e0610513 tempest-TestStampPattern-656958745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:57:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-35530919-e017-4885-9849-5b04d18b1346 req-dc6c90bf-26ee-4ab2-a091-ba91e0610513 tempest-TestStampPattern-656958745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:57:15 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc3a02e-d283-4e5c-9ad0-98c8cd727282]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:57:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-35530919-e017-4885-9849-5b04d18b1346 req-dc6c90bf-26ee-4ab2-a091-ba91e0610513 tempest-TestStampPattern-656958745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8fe5bef5-2586-484c-93c0-6604c1e3a220 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:16 devstack sudo[101073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8fe5bef5-2586-484c-93c0-6604c1e3a220 Jul 08 01:57:16 devstack sudo[101073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:16 devstack sudo[101063]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ffd4a54a-a58d-4bc7-8a5f-e5d89da41397 tempest-VolumesExtendTest-460006720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d85f0fe5-8496-4fc8-ab6c-110323b36076_0ee1yv3d" returned: 0 in 0.871s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ffd4a54a-a58d-4bc7-8a5f-e5d89da41397 tempest-VolumesExtendTest-460006720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d85f0fe5-8496-4fc8-ab6c-110323b36076_0ee1yv3d {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:16 devstack sudo[101077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d85f0fe5-8496-4fc8-ab6c-110323b36076_0ee1yv3d Jul 08 01:57:16 devstack sudo[101077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:16 devstack sudo[101073]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-35530919-e017-4885-9849-5b04d18b1346 req-dc6c90bf-26ee-4ab2-a091-ba91e0610513 tempest-TestStampPattern-656958745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8fe5bef5-2586-484c-93c0-6604c1e3a220" returned: 0 in 0.956s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-35530919-e017-4885-9849-5b04d18b1346 req-dc6c90bf-26ee-4ab2-a091-ba91e0610513 tempest-TestStampPattern-656958745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.984s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:57:16 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [req-35530919-e017-4885-9849-5b04d18b1346 req-dc6c90bf-26ee-4ab2-a091-ba91e0610513 tempest-TestStampPattern-656958745 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17', 'name': 'volume-8fe5bef5-2586-484c-93c0-6604c1e3a220', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '841be988-a936-413e-b2e5-1d542d02152c', 'enforce_multipath': True} {{(pid=87134) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:57:17 devstack cinder-volume[87134]: INFO cinder.volume.manager [req-35530919-e017-4885-9849-5b04d18b1346 req-dc6c90bf-26ee-4ab2-a091-ba91e0610513 tempest-TestStampPattern-656958745 None] attachment_update completed successfully. Jul 08 01:57:17 devstack sudo[101077]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ffd4a54a-a58d-4bc7-8a5f-e5d89da41397 tempest-VolumesExtendTest-460006720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d85f0fe5-8496-4fc8-ab6c-110323b36076_0ee1yv3d" returned: 1 in 0.827s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ffd4a54a-a58d-4bc7-8a5f-e5d89da41397 tempest-VolumesExtendTest-460006720 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d85f0fe5-8496-4fc8-ab6c-110323b36076_0ee1yv3d' failed. Not Retrying. {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:57:17 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[d93e943a-078c-4db0-a4b3-c45d695eed04]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:57:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ffd4a54a-a58d-4bc7-8a5f-e5d89da41397 tempest-VolumesExtendTest-460006720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d85f0fe5-8496-4fc8-ab6c-110323b36076_an_0iv0mdevstack@QuobyteHD {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:17 devstack sudo[101084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d85f0fe5-8496-4fc8-ab6c-110323b36076_an_0iv0mdevstack@QuobyteHD Jul 08 01:57:17 devstack sudo[101084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:18 devstack sudo[101084]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ffd4a54a-a58d-4bc7-8a5f-e5d89da41397 tempest-VolumesExtendTest-460006720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d85f0fe5-8496-4fc8-ab6c-110323b36076_an_0iv0mdevstack@QuobyteHD" returned: 0 in 0.990s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:18 devstack cinder-volume[87134]: DEBUG cinder.image.image_utils [None req-ffd4a54a-a58d-4bc7-8a5f-e5d89da41397 tempest-VolumesExtendTest-460006720 None] d85f0fe5-8496-4fc8-ab6c-110323b36076 was qcow2, converting to raw {{(pid=87134) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 01:57:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ffd4a54a-a58d-4bc7-8a5f-e5d89da41397 tempest-VolumesExtendTest-460006720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d85f0fe5-8496-4fc8-ab6c-110323b36076_an_0iv0mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-896ae2d8-1a31-44bd-8985-f5697ab46a0c {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:18 devstack sudo[101471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d85f0fe5-8496-4fc8-ab6c-110323b36076_an_0iv0mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-896ae2d8-1a31-44bd-8985-f5697ab46a0c Jul 08 01:57:18 devstack sudo[101471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:20 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0fe76dc-baa6-4c79-857b-283ac1ef941a tempest-TestShelveInstance-426081337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:57:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e0fe76dc-baa6-4c79-857b-283ac1ef941a tempest-TestShelveInstance-426081337 None] Flow 'volume_create_manager' (57b79df6-3612-44f0-a74e-27f3533dc6fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:57:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e0fe76dc-baa6-4c79-857b-283ac1ef941a tempest-TestShelveInstance-426081337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75fb79f3-eea3-4827-b946-5643de80f326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e0fe76dc-baa6-4c79-857b-283ac1ef941a tempest-TestShelveInstance-426081337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75fb79f3-eea3-4827-b946-5643de80f326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:57:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-551548288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d15d46a-ee04-4123-97dc-6f823378d269,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bb7016326d946849ee5b91796b3fe08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:57:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:57:21Z,use_quota=True,user_id='4595e3034fb0476f9434d09b826b7652',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e0fe76dc-baa6-4c79-857b-283ac1ef941a tempest-TestShelveInstance-426081337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2eb5562-4c06-449d-a32d-540318875295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e0fe76dc-baa6-4c79-857b-283ac1ef941a tempest-TestShelveInstance-426081337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2eb5562-4c06-449d-a32d-540318875295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e0fe76dc-baa6-4c79-857b-283ac1ef941a tempest-TestShelveInstance-426081337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4fd075f-d1e5-4a5f-834f-371946c08a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:20 devstack cinder-volume[87134]: DEBUG cinder.image.glance [None req-e0fe76dc-baa6-4c79-857b-283ac1ef941a tempest-TestShelveInstance-426081337 None] Creating Keystone auth plugin from conf {{(pid=87134) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 01:57:20 devstack sudo[101471]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ffd4a54a-a58d-4bc7-8a5f-e5d89da41397 tempest-VolumesExtendTest-460006720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d85f0fe5-8496-4fc8-ab6c-110323b36076_an_0iv0mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-896ae2d8-1a31-44bd-8985-f5697ab46a0c" returned: 0 in 2.397s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:20 devstack cinder-volume[87134]: DEBUG cinder.image.image_utils [None req-ffd4a54a-a58d-4bc7-8a5f-e5d89da41397 tempest-VolumesExtendTest-460006720 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d85f0fe5-8496-4fc8-ab6c-110323b36076_an_0iv0mdevstack@QuobyteHD, size 112.00 MB, duration 2.40 sec, destination /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-896ae2d8-1a31-44bd-8985-f5697ab46a0c {{(pid=87134) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:57:20 devstack cinder-volume[87134]: INFO cinder.image.image_utils [None req-ffd4a54a-a58d-4bc7-8a5f-e5d89da41397 tempest-VolumesExtendTest-460006720 None] Converted 112.00 MB image at 46.69 MB/s Jul 08 01:57:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ffd4a54a-a58d-4bc7-8a5f-e5d89da41397 tempest-VolumesExtendTest-460006720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-896ae2d8-1a31-44bd-8985-f5697ab46a0c 1G {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:20 devstack sudo[101480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-896ae2d8-1a31-44bd-8985-f5697ab46a0c 1G Jul 08 01:57:20 devstack sudo[101480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:20 devstack cinder-volume[87134]: DEBUG oslo_service.periodic_task [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87134) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:57:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:57:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:57:20 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:57:20 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:57:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:57:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:20 devstack sudo[101482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:57:20 devstack sudo[101482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e0fe76dc-baa6-4c79-857b-283ac1ef941a tempest-TestShelveInstance-426081337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4fd075f-d1e5-4a5f-834f-371946c08a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1d15d46a-ee04-4123-97dc-6f823378d269', 'volume_name': 'volume-1d15d46a-ee04-4123-97dc-6f823378d269', 'volume_size': 1, 'image_id': 'd85f0fe5-8496-4fc8-ab6c-110323b36076', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d85f0fe5-8496-4fc8-ab6c-110323b36076', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '44fe2859624d49239062555b2318d354', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd85f0fe5-8496-4fc8-ab6c-110323b36076', 'created_at': datetime.datetime(2026, 7, 7, 23, 34, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 34, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d85f0fe5-8496-4fc8-ab6c-110323b36076/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e0fe76dc-baa6-4c79-857b-283ac1ef941a tempest-TestShelveInstance-426081337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb1a7bc9-af48-44b4-8557-3f72c0aa1761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e0fe76dc-baa6-4c79-857b-283ac1ef941a tempest-TestShelveInstance-426081337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb1a7bc9-af48-44b4-8557-3f72c0aa1761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e0fe76dc-baa6-4c79-857b-283ac1ef941a tempest-TestShelveInstance-426081337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c0158f6-be9c-4599-b769-f985241bec2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:21 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-e0fe76dc-baa6-4c79-857b-283ac1ef941a tempest-TestShelveInstance-426081337 None] Volume 1d15d46a-ee04-4123-97dc-6f823378d269: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1d15d46a-ee04-4123-97dc-6f823378d269', 'volume_size': 1, 'image_id': 'd85f0fe5-8496-4fc8-ab6c-110323b36076', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d85f0fe5-8496-4fc8-ab6c-110323b36076', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '44fe2859624d49239062555b2318d354', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd85f0fe5-8496-4fc8-ab6c-110323b36076', 'created_at': datetime.datetime(2026, 7, 7, 23, 34, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 34, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d85f0fe5-8496-4fc8-ab6c-110323b36076/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 08 01:57:21 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0fe76dc-baa6-4c79-857b-283ac1ef941a tempest-TestShelveInstance-426081337 None] Trying to clone 1d15d46a-ee04-4123-97dc-6f823378d269 from image d85f0fe5-8496-4fc8-ab6c-110323b36076 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d85f0fe5-8496-4fc8-ab6c-110323b36076', 'metadata': {}}]). {{(pid=87134) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 01:57:21 devstack cinder-volume[87134]: DEBUG cinder.image.image_utils [None req-e0fe76dc-baa6-4c79-857b-283ac1ef941a tempest-TestShelveInstance-426081337 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d85f0fe5-8496-4fc8-ab6c-110323b36076_rovsduxbdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87134) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 01:57:21 devstack cinder-volume[87134]: INFO cinder.image.image_utils [None req-e0fe76dc-baa6-4c79-857b-283ac1ef941a tempest-TestShelveInstance-426081337 None] Image download 20.69 MB at 20.69 MB/s Jul 08 01:57:21 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[2145e3ee-c7bb-4ca7-9731-1f24ac5f34cd]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:57:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e0fe76dc-baa6-4c79-857b-283ac1ef941a tempest-TestShelveInstance-426081337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d85f0fe5-8496-4fc8-ab6c-110323b36076_rovsduxbdevstack@QuobyteHD {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:21 devstack sudo[101502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d85f0fe5-8496-4fc8-ab6c-110323b36076_rovsduxbdevstack@QuobyteHD Jul 08 01:57:21 devstack sudo[101502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:21 devstack sudo[101480]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ffd4a54a-a58d-4bc7-8a5f-e5d89da41397 tempest-VolumesExtendTest-460006720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-896ae2d8-1a31-44bd-8985-f5697ab46a0c 1G" returned: 0 in 0.976s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:21 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[0003161f-200f-4763-8639-c7cd45817af6]: (4, 'raw') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:57:21 devstack sudo[101482]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ffd4a54a-a58d-4bc7-8a5f-e5d89da41397 tempest-VolumesExtendTest-460006720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-896ae2d8-1a31-44bd-8985-f5697ab46a0c {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.886s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:21 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:57:21 devstack cinder-volume[87134]: DEBUG oslo_service.periodic_task [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running periodic task VolumeManager._thread_info {{(pid=87134) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:57:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] thread count: 28 {{(pid=87134) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:57:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] thread info: [<_MainThread(MainThread, started 129378964615296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87134) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:57:21 devstack sudo[101507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-896ae2d8-1a31-44bd-8985-f5697ab46a0c Jul 08 01:57:21 devstack sudo[101507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:22 devstack sudo[101502]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e0fe76dc-baa6-4c79-857b-283ac1ef941a tempest-TestShelveInstance-426081337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d85f0fe5-8496-4fc8-ab6c-110323b36076_rovsduxbdevstack@QuobyteHD" returned: 0 in 0.844s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:22 devstack cinder-volume[87134]: DEBUG cinder.image.image_utils [None req-e0fe76dc-baa6-4c79-857b-283ac1ef941a tempest-TestShelveInstance-426081337 None] Temporary image d85f0fe5-8496-4fc8-ab6c-110323b36076 is fetched for user 4595e3034fb0476f9434d09b826b7652. {{(pid=87134) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 01:57:22 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[0796a07d-573c-4189-b77c-0534b9b41abe]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:57:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e0fe76dc-baa6-4c79-857b-283ac1ef941a tempest-TestShelveInstance-426081337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d85f0fe5-8496-4fc8-ab6c-110323b36076_rovsduxbdevstack@QuobyteHD {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:22 devstack sudo[101507]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ffd4a54a-a58d-4bc7-8a5f-e5d89da41397 tempest-VolumesExtendTest-460006720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-896ae2d8-1a31-44bd-8985-f5697ab46a0c" returned: 0 in 0.805s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ffd4a54a-a58d-4bc7-8a5f-e5d89da41397 tempest-VolumesExtendTest-460006720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-896ae2d8-1a31-44bd-8985-f5697ab46a0c {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:22 devstack sudo[101514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d85f0fe5-8496-4fc8-ab6c-110323b36076_rovsduxbdevstack@QuobyteHD Jul 08 01:57:22 devstack sudo[101514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:22 devstack sudo[101515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-896ae2d8-1a31-44bd-8985-f5697ab46a0c Jul 08 01:57:22 devstack sudo[101515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:23 devstack sudo[101514]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:23 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e0fe76dc-baa6-4c79-857b-283ac1ef941a tempest-TestShelveInstance-426081337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d85f0fe5-8496-4fc8-ab6c-110323b36076_rovsduxbdevstack@QuobyteHD" returned: 0 in 0.810s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:23 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e0fe76dc-baa6-4c79-857b-283ac1ef941a tempest-TestShelveInstance-426081337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:57:23 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e0fe76dc-baa6-4c79-857b-283ac1ef941a tempest-TestShelveInstance-426081337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:57:23 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-e0fe76dc-baa6-4c79-857b-283ac1ef941a tempest-TestShelveInstance-426081337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:57:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-551548288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d15d46a-ee04-4123-97dc-6f823378d269,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bb7016326d946849ee5b91796b3fe08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:57:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:57:21Z,use_quota=True,user_id='4595e3034fb0476f9434d09b826b7652',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:57:23 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-e0fe76dc-baa6-4c79-857b-283ac1ef941a tempest-TestShelveInstance-426081337 None] Creating volume 1d15d46a-ee04-4123-97dc-6f823378d269 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:57:23 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e0fe76dc-baa6-4c79-857b-283ac1ef941a tempest-TestShelveInstance-426081337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:57:23 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e0fe76dc-baa6-4c79-857b-283ac1ef941a tempest-TestShelveInstance-426081337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:57:23 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-e0fe76dc-baa6-4c79-857b-283ac1ef941a tempest-TestShelveInstance-426081337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:57:23 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-e0fe76dc-baa6-4c79-857b-283ac1ef941a tempest-TestShelveInstance-426081337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:57:23 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e0fe76dc-baa6-4c79-857b-283ac1ef941a tempest-TestShelveInstance-426081337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:57:23 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-e0fe76dc-baa6-4c79-857b-283ac1ef941a tempest-TestShelveInstance-426081337 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:57:23 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-e0fe76dc-baa6-4c79-857b-283ac1ef941a tempest-TestShelveInstance-426081337 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:57:23 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e0fe76dc-baa6-4c79-857b-283ac1ef941a tempest-TestShelveInstance-426081337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1d15d46a-ee04-4123-97dc-6f823378d269 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:23 devstack sudo[101551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1d15d46a-ee04-4123-97dc-6f823378d269 1073741824 Jul 08 01:57:23 devstack sudo[101551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:23 devstack cinder-volume[87134]: INFO cinder.volume.manager [req-5435b70d-9c35-45d2-ab64-347ba91fd417 req-56aebbfb-d00f-43ea-994b-a1bc7df89859 tempest-TestStampPattern-656958745 None] Terminate volume connection completed successfully. Jul 08 01:57:23 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [req-5435b70d-9c35-45d2-ab64-347ba91fd417 req-56aebbfb-d00f-43ea-994b-a1bc7df89859 tempest-TestStampPattern-656958745 None] Deleting attachment 841be988-a936-413e-b2e5-1d542d02152c. {{(pid=87134) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:57:23 devstack sudo[101515]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:23 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ffd4a54a-a58d-4bc7-8a5f-e5d89da41397 tempest-VolumesExtendTest-460006720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-896ae2d8-1a31-44bd-8985-f5697ab46a0c" returned: 1 in 0.878s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:23 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ffd4a54a-a58d-4bc7-8a5f-e5d89da41397 tempest-VolumesExtendTest-460006720 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-896ae2d8-1a31-44bd-8985-f5697ab46a0c' failed. Not Retrying. {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:57:23 devstack cinder-volume[87134]: DEBUG cinder.volume.volume_utils [None req-ffd4a54a-a58d-4bc7-8a5f-e5d89da41397 tempest-VolumesExtendTest-460006720 None] Downloaded image d85f0fe5-8496-4fc8-ab6c-110323b36076 ((None, [{'url': 'file:///opt/stack/data/glance/images/d85f0fe5-8496-4fc8-ab6c-110323b36076', 'metadata': {}}])) to volume 896ae2d8-1a31-44bd-8985-f5697ab46a0c successfully. {{(pid=87134) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 01:57:23 devstack cinder-volume[87134]: DEBUG cinder.image.image_utils [None req-ffd4a54a-a58d-4bc7-8a5f-e5d89da41397 tempest-VolumesExtendTest-460006720 None] Temporary image d85f0fe5-8496-4fc8-ab6c-110323b36076 for user dc7b44b8dd1d45f6acedb8b0fb2881a1 is deleted. {{(pid=87134) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 01:57:23 devstack cinder-volume[87134]: DEBUG cinder.volume.volume_utils [None req-ffd4a54a-a58d-4bc7-8a5f-e5d89da41397 tempest-VolumesExtendTest-460006720 None] Marking volume 896ae2d8-1a31-44bd-8985-f5697ab46a0c as bootable. {{(pid=87134) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 01:57:23 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffd4a54a-a58d-4bc7-8a5f-e5d89da41397 tempest-VolumesExtendTest-460006720 None] Copying metadata from image d85f0fe5-8496-4fc8-ab6c-110323b36076 to 896ae2d8-1a31-44bd-8985-f5697ab46a0c. {{(pid=87134) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 01:57:23 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffd4a54a-a58d-4bc7-8a5f-e5d89da41397 tempest-VolumesExtendTest-460006720 None] Creating volume glance metadata for volume 896ae2d8-1a31-44bd-8985-f5697ab46a0c backed by image d85f0fe5-8496-4fc8-ab6c-110323b36076 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd85f0fe5-8496-4fc8-ab6c-110323b36076', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87134) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 01:57:23 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ffd4a54a-a58d-4bc7-8a5f-e5d89da41397 tempest-VolumesExtendTest-460006720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e916e73-061d-49ec-b33b-f6fab6d3c4e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-896ae2d8-1a31-44bd-8985-f5697ab46a0c', 'volume_size': 1, 'image_id': 'd85f0fe5-8496-4fc8-ab6c-110323b36076', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d85f0fe5-8496-4fc8-ab6c-110323b36076', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '44fe2859624d49239062555b2318d354', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd85f0fe5-8496-4fc8-ab6c-110323b36076', 'created_at': datetime.datetime(2026, 7, 7, 23, 34, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 34, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d85f0fe5-8496-4fc8-ab6c-110323b36076/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:23 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ffd4a54a-a58d-4bc7-8a5f-e5d89da41397 tempest-VolumesExtendTest-460006720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d87a3771-a7ae-49cf-98db-cf77271fd42b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:23 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-ffd4a54a-a58d-4bc7-8a5f-e5d89da41397 tempest-VolumesExtendTest-460006720 None] Volume volume-896ae2d8-1a31-44bd-8985-f5697ab46a0c (896ae2d8-1a31-44bd-8985-f5697ab46a0c): created successfully Jul 08 01:57:23 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ffd4a54a-a58d-4bc7-8a5f-e5d89da41397 tempest-VolumesExtendTest-460006720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d87a3771-a7ae-49cf-98db-cf77271fd42b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:23 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ffd4a54a-a58d-4bc7-8a5f-e5d89da41397 tempest-VolumesExtendTest-460006720 None] Flow 'volume_create_manager' (75004e75-b13e-44e5-ad85-ad6066dcf7c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:57:23 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-ffd4a54a-a58d-4bc7-8a5f-e5d89da41397 tempest-VolumesExtendTest-460006720 None] Created volume successfully. Jul 08 01:57:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-61282eeb-4a09-4763-b2b1-8f78d0172c6b tempest-VolumesExtendTest-460006720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:57:24 devstack sudo[101551]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e0fe76dc-baa6-4c79-857b-283ac1ef941a tempest-TestShelveInstance-426081337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1d15d46a-ee04-4123-97dc-6f823378d269 1073741824" returned: 0 in 0.946s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e0fe76dc-baa6-4c79-857b-283ac1ef941a tempest-TestShelveInstance-426081337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1d15d46a-ee04-4123-97dc-6f823378d269 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:24 devstack sudo[101557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1d15d46a-ee04-4123-97dc-6f823378d269 Jul 08 01:57:24 devstack sudo[101557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:24 devstack sudo[101557]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e0fe76dc-baa6-4c79-857b-283ac1ef941a tempest-TestShelveInstance-426081337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1d15d46a-ee04-4123-97dc-6f823378d269" returned: 0 in 0.659s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:24 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-e0fe76dc-baa6-4c79-857b-283ac1ef941a tempest-TestShelveInstance-426081337 None] <== create_volume: return (1651ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:57:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e0fe76dc-baa6-4c79-857b-283ac1ef941a tempest-TestShelveInstance-426081337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.654s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:57:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-61282eeb-4a09-4763-b2b1-8f78d0172c6b tempest-VolumesExtendTest-460006720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.983s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:57:25 devstack cinder-volume[87134]: DEBUG cinder.volume.volume_utils [None req-e0fe76dc-baa6-4c79-857b-283ac1ef941a tempest-TestShelveInstance-426081337 None] Attempting download of d85f0fe5-8496-4fc8-ab6c-110323b36076 ((None, [{'url': 'file:///opt/stack/data/glance/images/d85f0fe5-8496-4fc8-ab6c-110323b36076', 'metadata': {}}])) to volume 1d15d46a-ee04-4123-97dc-6f823378d269. {{(pid=87134) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 01:57:25 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[35baac73-8db9-4b81-9021-dc4f19107e31]: (4, 'raw') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:57:25 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-61282eeb-4a09-4763-b2b1-8f78d0172c6b tempest-VolumesExtendTest-460006720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-896ae2d8-1a31-44bd-8985-f5697ab46a0c {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:25 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee473e8-15cd-4151-81d0-246fb24193c2]: (4, 'raw') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:57:25 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e0fe76dc-baa6-4c79-857b-283ac1ef941a tempest-TestShelveInstance-426081337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d85f0fe5-8496-4fc8-ab6c-110323b36076_t8hp9mgy {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:25 devstack sudo[101560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-896ae2d8-1a31-44bd-8985-f5697ab46a0c Jul 08 01:57:25 devstack sudo[101560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:25 devstack sudo[101561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d85f0fe5-8496-4fc8-ab6c-110323b36076_t8hp9mgy Jul 08 01:57:25 devstack sudo[101561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:25 devstack sudo[101560]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:25 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-61282eeb-4a09-4763-b2b1-8f78d0172c6b tempest-VolumesExtendTest-460006720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-896ae2d8-1a31-44bd-8985-f5697ab46a0c" returned: 0 in 0.885s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:25 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-61282eeb-4a09-4763-b2b1-8f78d0172c6b tempest-VolumesExtendTest-460006720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-896ae2d8-1a31-44bd-8985-f5697ab46a0c {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:25 devstack sudo[101561]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:25 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e0fe76dc-baa6-4c79-857b-283ac1ef941a tempest-TestShelveInstance-426081337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d85f0fe5-8496-4fc8-ab6c-110323b36076_t8hp9mgy" returned: 0 in 0.836s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:25 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e0fe76dc-baa6-4c79-857b-283ac1ef941a tempest-TestShelveInstance-426081337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d85f0fe5-8496-4fc8-ab6c-110323b36076_t8hp9mgy {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:26 devstack sudo[101569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-896ae2d8-1a31-44bd-8985-f5697ab46a0c Jul 08 01:57:26 devstack sudo[101569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:26 devstack sudo[101570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d85f0fe5-8496-4fc8-ab6c-110323b36076_t8hp9mgy Jul 08 01:57:26 devstack sudo[101570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:26 devstack sudo[101570]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:26 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e0fe76dc-baa6-4c79-857b-283ac1ef941a tempest-TestShelveInstance-426081337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d85f0fe5-8496-4fc8-ab6c-110323b36076_t8hp9mgy" returned: 1 in 0.873s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:26 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e0fe76dc-baa6-4c79-857b-283ac1ef941a tempest-TestShelveInstance-426081337 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d85f0fe5-8496-4fc8-ab6c-110323b36076_t8hp9mgy' failed. Not Retrying. {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:57:26 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d9c8a9-38a2-47f5-846b-1cecc1be8e15]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:57:26 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e0fe76dc-baa6-4c79-857b-283ac1ef941a tempest-TestShelveInstance-426081337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d85f0fe5-8496-4fc8-ab6c-110323b36076_rovsduxbdevstack@QuobyteHD {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:26 devstack sudo[101569]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:26 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-61282eeb-4a09-4763-b2b1-8f78d0172c6b tempest-VolumesExtendTest-460006720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-896ae2d8-1a31-44bd-8985-f5697ab46a0c" returned: 1 in 0.958s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:26 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-61282eeb-4a09-4763-b2b1-8f78d0172c6b tempest-VolumesExtendTest-460006720 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-896ae2d8-1a31-44bd-8985-f5697ab46a0c' failed. Not Retrying. {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:57:26 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-61282eeb-4a09-4763-b2b1-8f78d0172c6b tempest-VolumesExtendTest-460006720 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-896ae2d8-1a31-44bd-8985-f5697ab46a0c 2G {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:26 devstack sudo[101580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d85f0fe5-8496-4fc8-ab6c-110323b36076_rovsduxbdevstack@QuobyteHD Jul 08 01:57:26 devstack sudo[101580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:26 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-61282eeb-4a09-4763-b2b1-8f78d0172c6b tempest-VolumesExtendTest-460006720 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-896ae2d8-1a31-44bd-8985-f5697ab46a0c 2G" returned: 0 in 0.100s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:26 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-61282eeb-4a09-4763-b2b1-8f78d0172c6b tempest-VolumesExtendTest-460006720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:57:27 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-61282eeb-4a09-4763-b2b1-8f78d0172c6b tempest-VolumesExtendTest-460006720 None] Extend volume completed successfully. Jul 08 01:57:27 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-1f1ec489-5852-4bc0-a08d-654388b3f6d2 tempest-VolumesExtendTest-460006720 None] Acquiring lock "cinder-896ae2d8-1a31-44bd-8985-f5697ab46a0c-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:57:27 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-1f1ec489-5852-4bc0-a08d-654388b3f6d2 tempest-VolumesExtendTest-460006720 None] Lock "cinder-896ae2d8-1a31-44bd-8985-f5697ab46a0c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:57:27 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-1f1ec489-5852-4bc0-a08d-654388b3f6d2 tempest-VolumesExtendTest-460006720 None] Acquiring lock "cinder-quobyte-896ae2d8-1a31-44bd-8985-f5697ab46a0c" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:57:27 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-1f1ec489-5852-4bc0-a08d-654388b3f6d2 tempest-VolumesExtendTest-460006720 None] Lock "cinder-quobyte-896ae2d8-1a31-44bd-8985-f5697ab46a0c" acquired by "delete_volume" :: waited 0.026s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:57:27 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ba6fd7-1418-4801-bff6-4cb71d923f6b]: (4, 'raw') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:57:27 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1f1ec489-5852-4bc0-a08d-654388b3f6d2 tempest-VolumesExtendTest-460006720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-896ae2d8-1a31-44bd-8985-f5697ab46a0c {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:27 devstack sudo[101580]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:27 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e0fe76dc-baa6-4c79-857b-283ac1ef941a tempest-TestShelveInstance-426081337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d85f0fe5-8496-4fc8-ab6c-110323b36076_rovsduxbdevstack@QuobyteHD" returned: 0 in 0.951s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:27 devstack cinder-volume[87134]: DEBUG cinder.image.image_utils [None req-e0fe76dc-baa6-4c79-857b-283ac1ef941a tempest-TestShelveInstance-426081337 None] d85f0fe5-8496-4fc8-ab6c-110323b36076 was qcow2, converting to raw {{(pid=87134) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 01:57:27 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e0fe76dc-baa6-4c79-857b-283ac1ef941a tempest-TestShelveInstance-426081337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d85f0fe5-8496-4fc8-ab6c-110323b36076_rovsduxbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1d15d46a-ee04-4123-97dc-6f823378d269 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:27 devstack sudo[101594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d85f0fe5-8496-4fc8-ab6c-110323b36076_rovsduxbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1d15d46a-ee04-4123-97dc-6f823378d269 Jul 08 01:57:27 devstack sudo[101594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:27 devstack sudo[101593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-896ae2d8-1a31-44bd-8985-f5697ab46a0c Jul 08 01:57:27 devstack sudo[101593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:28 devstack sudo[101593]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:28 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1f1ec489-5852-4bc0-a08d-654388b3f6d2 tempest-VolumesExtendTest-460006720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-896ae2d8-1a31-44bd-8985-f5697ab46a0c" returned: 0 in 0.952s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:28 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1f1ec489-5852-4bc0-a08d-654388b3f6d2 tempest-VolumesExtendTest-460006720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-896ae2d8-1a31-44bd-8985-f5697ab46a0c {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:28 devstack sudo[101622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-896ae2d8-1a31-44bd-8985-f5697ab46a0c Jul 08 01:57:28 devstack sudo[101622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:29 devstack sudo[101622]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1f1ec489-5852-4bc0-a08d-654388b3f6d2 tempest-VolumesExtendTest-460006720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-896ae2d8-1a31-44bd-8985-f5697ab46a0c" returned: 1 in 0.847s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1f1ec489-5852-4bc0-a08d-654388b3f6d2 tempest-VolumesExtendTest-460006720 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-896ae2d8-1a31-44bd-8985-f5697ab46a0c' failed. Not Retrying. {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:57:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1f1ec489-5852-4bc0-a08d-654388b3f6d2 tempest-VolumesExtendTest-460006720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-896ae2d8-1a31-44bd-8985-f5697ab46a0c {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:29 devstack sudo[101631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-896ae2d8-1a31-44bd-8985-f5697ab46a0c Jul 08 01:57:29 devstack sudo[101631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:30 devstack sudo[101594]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e0fe76dc-baa6-4c79-857b-283ac1ef941a tempest-TestShelveInstance-426081337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d85f0fe5-8496-4fc8-ab6c-110323b36076_rovsduxbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1d15d46a-ee04-4123-97dc-6f823378d269" returned: 0 in 2.423s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:30 devstack cinder-volume[87134]: DEBUG cinder.image.image_utils [None req-e0fe76dc-baa6-4c79-857b-283ac1ef941a tempest-TestShelveInstance-426081337 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d85f0fe5-8496-4fc8-ab6c-110323b36076_rovsduxbdevstack@QuobyteHD, size 112.00 MB, duration 2.42 sec, destination /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1d15d46a-ee04-4123-97dc-6f823378d269 {{(pid=87134) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:57:30 devstack cinder-volume[87134]: INFO cinder.image.image_utils [None req-e0fe76dc-baa6-4c79-857b-283ac1ef941a tempest-TestShelveInstance-426081337 None] Converted 112.00 MB image at 46.19 MB/s Jul 08 01:57:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e0fe76dc-baa6-4c79-857b-283ac1ef941a tempest-TestShelveInstance-426081337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1d15d46a-ee04-4123-97dc-6f823378d269 1G {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:30 devstack sudo[101667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1d15d46a-ee04-4123-97dc-6f823378d269 1G Jul 08 01:57:30 devstack sudo[101667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:30 devstack sudo[101631]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1f1ec489-5852-4bc0-a08d-654388b3f6d2 tempest-VolumesExtendTest-460006720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-896ae2d8-1a31-44bd-8985-f5697ab46a0c" returned: 0 in 0.814s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:30 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-1f1ec489-5852-4bc0-a08d-654388b3f6d2 tempest-VolumesExtendTest-460006720 None] Lock "cinder-quobyte-896ae2d8-1a31-44bd-8985-f5697ab46a0c" released by "delete_volume" :: held 2.707s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:57:30 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-1f1ec489-5852-4bc0-a08d-654388b3f6d2 tempest-VolumesExtendTest-460006720 None] Created reservations ['72970762-d796-4f8f-b752-c1e29a82cb91', 'dea0bd58-6772-469e-88fe-e1e5dc7a4167', 'ee75d20b-de21-44ae-bc79-232b944810a9', 'fd3923bc-fc0b-49b8-ae57-59195b8f2668'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:57:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-1f1ec489-5852-4bc0-a08d-654388b3f6d2 tempest-VolumesExtendTest-460006720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:57:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-1f1ec489-5852-4bc0-a08d-654388b3f6d2 tempest-VolumesExtendTest-460006720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:57:30 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-1f1ec489-5852-4bc0-a08d-654388b3f6d2 tempest-VolumesExtendTest-460006720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:57:30 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-1f1ec489-5852-4bc0-a08d-654388b3f6d2 tempest-VolumesExtendTest-460006720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:57:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-1f1ec489-5852-4bc0-a08d-654388b3f6d2 tempest-VolumesExtendTest-460006720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:57:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1f1ec489-5852-4bc0-a08d-654388b3f6d2 tempest-VolumesExtendTest-460006720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:30 devstack sudo[101672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:57:30 devstack sudo[101672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:31 devstack sudo[101667]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e0fe76dc-baa6-4c79-857b-283ac1ef941a tempest-TestShelveInstance-426081337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1d15d46a-ee04-4123-97dc-6f823378d269 1G" returned: 0 in 0.818s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:31 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[0261f99a-4755-4734-807d-d0da6679f710]: (4, 'raw') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:57:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e0fe76dc-baa6-4c79-857b-283ac1ef941a tempest-TestShelveInstance-426081337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1d15d46a-ee04-4123-97dc-6f823378d269 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:31 devstack sudo[101683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1d15d46a-ee04-4123-97dc-6f823378d269 Jul 08 01:57:31 devstack sudo[101683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:31 devstack sudo[101672]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1f1ec489-5852-4bc0-a08d-654388b3f6d2 tempest-VolumesExtendTest-460006720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.835s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:31 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-1f1ec489-5852-4bc0-a08d-654388b3f6d2 tempest-VolumesExtendTest-460006720 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:57:31 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-1f1ec489-5852-4bc0-a08d-654388b3f6d2 tempest-VolumesExtendTest-460006720 None] Deleted volume successfully. Jul 08 01:57:31 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-1f1ec489-5852-4bc0-a08d-654388b3f6d2 tempest-VolumesExtendTest-460006720 None] Lock "cinder-896ae2d8-1a31-44bd-8985-f5697ab46a0c-delete_volume" released by "delete_volume" :: held 3.849s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:57:31 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e5ad604-af54-4c80-b660-322d4b37f4d5 tempest-VolumesExtendTest-460006720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:57:31 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-4e5ad604-af54-4c80-b660-322d4b37f4d5 tempest-VolumesExtendTest-460006720 None] Flow 'volume_create_manager' (c67149f5-5bc3-4c90-b49f-31c1f88fbffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:57:31 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-4e5ad604-af54-4c80-b660-322d4b37f4d5 tempest-VolumesExtendTest-460006720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a563dae1-82a6-490c-b0d0-c458f7598efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:31 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-4e5ad604-af54-4c80-b660-322d4b37f4d5 tempest-VolumesExtendTest-460006720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a563dae1-82a6-490c-b0d0-c458f7598efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:57:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1578729783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f119f71b-81b4-4516-bc51-caca10dfb272,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25d4b5a375834020b518e48e4ddc9471',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:57:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:57:31Z,use_quota=True,user_id='dc7b44b8dd1d45f6acedb8b0fb2881a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:31 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-4e5ad604-af54-4c80-b660-322d4b37f4d5 tempest-VolumesExtendTest-460006720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37f16003-0c4b-4415-98de-a136a852273d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:31 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-4e5ad604-af54-4c80-b660-322d4b37f4d5 tempest-VolumesExtendTest-460006720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37f16003-0c4b-4415-98de-a136a852273d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:31 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-4e5ad604-af54-4c80-b660-322d4b37f4d5 tempest-VolumesExtendTest-460006720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e5d0e8e-f193-44fa-acdf-e2cff36baebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:31 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-4e5ad604-af54-4c80-b660-322d4b37f4d5 tempest-VolumesExtendTest-460006720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e5d0e8e-f193-44fa-acdf-e2cff36baebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f119f71b-81b4-4516-bc51-caca10dfb272', 'volume_name': 'volume-f119f71b-81b4-4516-bc51-caca10dfb272', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:31 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-4e5ad604-af54-4c80-b660-322d4b37f4d5 tempest-VolumesExtendTest-460006720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fae55a78-3809-4c0c-b485-1c1b91ec6a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:31 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-4e5ad604-af54-4c80-b660-322d4b37f4d5 tempest-VolumesExtendTest-460006720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fae55a78-3809-4c0c-b485-1c1b91ec6a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:31 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-4e5ad604-af54-4c80-b660-322d4b37f4d5 tempest-VolumesExtendTest-460006720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76cc1f40-876f-4aa9-b0ab-6ea5a84f0043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:31 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-4e5ad604-af54-4c80-b660-322d4b37f4d5 tempest-VolumesExtendTest-460006720 None] Volume f119f71b-81b4-4516-bc51-caca10dfb272: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f119f71b-81b4-4516-bc51-caca10dfb272', 'volume_size': 1} Jul 08 01:57:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-4e5ad604-af54-4c80-b660-322d4b37f4d5 tempest-VolumesExtendTest-460006720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:57:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-4e5ad604-af54-4c80-b660-322d4b37f4d5 tempest-VolumesExtendTest-460006720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:57:31 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-4e5ad604-af54-4c80-b660-322d4b37f4d5 tempest-VolumesExtendTest-460006720 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:57:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1578729783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f119f71b-81b4-4516-bc51-caca10dfb272,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25d4b5a375834020b518e48e4ddc9471',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:57:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:57:31Z,use_quota=True,user_id='dc7b44b8dd1d45f6acedb8b0fb2881a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:57:31 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-4e5ad604-af54-4c80-b660-322d4b37f4d5 tempest-VolumesExtendTest-460006720 None] Creating volume f119f71b-81b4-4516-bc51-caca10dfb272 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:57:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-4e5ad604-af54-4c80-b660-322d4b37f4d5 tempest-VolumesExtendTest-460006720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:57:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-4e5ad604-af54-4c80-b660-322d4b37f4d5 tempest-VolumesExtendTest-460006720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:57:31 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-4e5ad604-af54-4c80-b660-322d4b37f4d5 tempest-VolumesExtendTest-460006720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:57:31 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-4e5ad604-af54-4c80-b660-322d4b37f4d5 tempest-VolumesExtendTest-460006720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:57:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-4e5ad604-af54-4c80-b660-322d4b37f4d5 tempest-VolumesExtendTest-460006720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:57:31 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-4e5ad604-af54-4c80-b660-322d4b37f4d5 tempest-VolumesExtendTest-460006720 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:57:31 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-4e5ad604-af54-4c80-b660-322d4b37f4d5 tempest-VolumesExtendTest-460006720 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:57:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4e5ad604-af54-4c80-b660-322d4b37f4d5 tempest-VolumesExtendTest-460006720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f119f71b-81b4-4516-bc51-caca10dfb272 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:31 devstack sudo[101686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f119f71b-81b4-4516-bc51-caca10dfb272 1073741824 Jul 08 01:57:31 devstack sudo[101686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:32 devstack sudo[101683]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e0fe76dc-baa6-4c79-857b-283ac1ef941a tempest-TestShelveInstance-426081337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1d15d46a-ee04-4123-97dc-6f823378d269" returned: 0 in 0.966s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e0fe76dc-baa6-4c79-857b-283ac1ef941a tempest-TestShelveInstance-426081337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1d15d46a-ee04-4123-97dc-6f823378d269 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:32 devstack sudo[101690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1d15d46a-ee04-4123-97dc-6f823378d269 Jul 08 01:57:32 devstack sudo[101690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:32 devstack sudo[101686]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4e5ad604-af54-4c80-b660-322d4b37f4d5 tempest-VolumesExtendTest-460006720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f119f71b-81b4-4516-bc51-caca10dfb272 1073741824" returned: 0 in 0.942s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4e5ad604-af54-4c80-b660-322d4b37f4d5 tempest-VolumesExtendTest-460006720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f119f71b-81b4-4516-bc51-caca10dfb272 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:32 devstack sudo[101696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f119f71b-81b4-4516-bc51-caca10dfb272 Jul 08 01:57:32 devstack sudo[101696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:33 devstack sudo[101690]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e0fe76dc-baa6-4c79-857b-283ac1ef941a tempest-TestShelveInstance-426081337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1d15d46a-ee04-4123-97dc-6f823378d269" returned: 1 in 0.983s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e0fe76dc-baa6-4c79-857b-283ac1ef941a tempest-TestShelveInstance-426081337 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1d15d46a-ee04-4123-97dc-6f823378d269' failed. Not Retrying. {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:57:33 devstack cinder-volume[87134]: DEBUG cinder.volume.volume_utils [None req-e0fe76dc-baa6-4c79-857b-283ac1ef941a tempest-TestShelveInstance-426081337 None] Downloaded image d85f0fe5-8496-4fc8-ab6c-110323b36076 ((None, [{'url': 'file:///opt/stack/data/glance/images/d85f0fe5-8496-4fc8-ab6c-110323b36076', 'metadata': {}}])) to volume 1d15d46a-ee04-4123-97dc-6f823378d269 successfully. {{(pid=87134) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 01:57:33 devstack cinder-volume[87134]: DEBUG cinder.image.image_utils [None req-e0fe76dc-baa6-4c79-857b-283ac1ef941a tempest-TestShelveInstance-426081337 None] Temporary image d85f0fe5-8496-4fc8-ab6c-110323b36076 for user 4595e3034fb0476f9434d09b826b7652 is deleted. {{(pid=87134) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 01:57:33 devstack cinder-volume[87134]: DEBUG cinder.volume.volume_utils [None req-e0fe76dc-baa6-4c79-857b-283ac1ef941a tempest-TestShelveInstance-426081337 None] Marking volume 1d15d46a-ee04-4123-97dc-6f823378d269 as bootable. {{(pid=87134) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 01:57:33 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0fe76dc-baa6-4c79-857b-283ac1ef941a tempest-TestShelveInstance-426081337 None] Copying metadata from image d85f0fe5-8496-4fc8-ab6c-110323b36076 to 1d15d46a-ee04-4123-97dc-6f823378d269. {{(pid=87134) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 01:57:33 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0fe76dc-baa6-4c79-857b-283ac1ef941a tempest-TestShelveInstance-426081337 None] Creating volume glance metadata for volume 1d15d46a-ee04-4123-97dc-6f823378d269 backed by image d85f0fe5-8496-4fc8-ab6c-110323b36076 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd85f0fe5-8496-4fc8-ab6c-110323b36076', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87134) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 01:57:33 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e0fe76dc-baa6-4c79-857b-283ac1ef941a tempest-TestShelveInstance-426081337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c0158f6-be9c-4599-b769-f985241bec2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d15d46a-ee04-4123-97dc-6f823378d269', 'volume_size': 1, 'image_id': 'd85f0fe5-8496-4fc8-ab6c-110323b36076', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d85f0fe5-8496-4fc8-ab6c-110323b36076', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '44fe2859624d49239062555b2318d354', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd85f0fe5-8496-4fc8-ab6c-110323b36076', 'created_at': datetime.datetime(2026, 7, 7, 23, 34, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 34, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d85f0fe5-8496-4fc8-ab6c-110323b36076/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:33 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e0fe76dc-baa6-4c79-857b-283ac1ef941a tempest-TestShelveInstance-426081337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d72986a3-625a-4859-bc05-04140fc2d3ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:33 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-e0fe76dc-baa6-4c79-857b-283ac1ef941a tempest-TestShelveInstance-426081337 None] Volume volume-1d15d46a-ee04-4123-97dc-6f823378d269 (1d15d46a-ee04-4123-97dc-6f823378d269): created successfully Jul 08 01:57:33 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e0fe76dc-baa6-4c79-857b-283ac1ef941a tempest-TestShelveInstance-426081337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d72986a3-625a-4859-bc05-04140fc2d3ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:33 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e0fe76dc-baa6-4c79-857b-283ac1ef941a tempest-TestShelveInstance-426081337 None] Flow 'volume_create_manager' (57b79df6-3612-44f0-a74e-27f3533dc6fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:57:33 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-e0fe76dc-baa6-4c79-857b-283ac1ef941a tempest-TestShelveInstance-426081337 None] Created volume successfully. Jul 08 01:57:33 devstack sudo[101696]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4e5ad604-af54-4c80-b660-322d4b37f4d5 tempest-VolumesExtendTest-460006720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f119f71b-81b4-4516-bc51-caca10dfb272" returned: 0 in 0.725s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:33 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-4e5ad604-af54-4c80-b660-322d4b37f4d5 tempest-VolumesExtendTest-460006720 None] <== create_volume: return (1710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:57:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-4e5ad604-af54-4c80-b660-322d4b37f4d5 tempest-VolumesExtendTest-460006720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.713s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:57:33 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-4e5ad604-af54-4c80-b660-322d4b37f4d5 tempest-VolumesExtendTest-460006720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76cc1f40-876f-4aa9-b0ab-6ea5a84f0043) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f119f71b-81b4-4516-bc51-caca10dfb272', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:33 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-4e5ad604-af54-4c80-b660-322d4b37f4d5 tempest-VolumesExtendTest-460006720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5db191a6-d8f8-406b-bbb6-e8e0d7383f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:33 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-4e5ad604-af54-4c80-b660-322d4b37f4d5 tempest-VolumesExtendTest-460006720 None] Volume volume-f119f71b-81b4-4516-bc51-caca10dfb272 (f119f71b-81b4-4516-bc51-caca10dfb272): created successfully Jul 08 01:57:33 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-4e5ad604-af54-4c80-b660-322d4b37f4d5 tempest-VolumesExtendTest-460006720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5db191a6-d8f8-406b-bbb6-e8e0d7383f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:33 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-4e5ad604-af54-4c80-b660-322d4b37f4d5 tempest-VolumesExtendTest-460006720 None] Flow 'volume_create_manager' (c67149f5-5bc3-4c90-b49f-31c1f88fbffc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:57:33 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-4e5ad604-af54-4c80-b660-322d4b37f4d5 tempest-VolumesExtendTest-460006720 None] Created volume successfully. Jul 08 01:57:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-a9bb99a1-bf17-4a21-aa3a-4d0c72528060 tempest-VolumesExtendTest-460006720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:57:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-a9bb99a1-bf17-4a21-aa3a-4d0c72528060 tempest-VolumesExtendTest-460006720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:57:33 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-a9bb99a1-bf17-4a21-aa3a-4d0c72528060 tempest-VolumesExtendTest-460006720 None] Creating offline snapshot 2c83c649-7ef0-4fe5-879a-33e7b862bdb3 of volume f119f71b-81b4-4516-bc51-caca10dfb272 {{(pid=87134) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:57:33 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[2801b750-1298-4f83-ac65-229c70c2eb27]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:57:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a9bb99a1-bf17-4a21-aa3a-4d0c72528060 tempest-VolumesExtendTest-460006720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f119f71b-81b4-4516-bc51-caca10dfb272 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:33 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-70323725-7485-4c4a-94d4-07be78b9e3df tempest-TestStampPattern-656958745 None] Acquiring lock "cinder-8fe5bef5-2586-484c-93c0-6604c1e3a220-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:57:33 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-70323725-7485-4c4a-94d4-07be78b9e3df tempest-TestStampPattern-656958745 None] Lock "cinder-8fe5bef5-2586-484c-93c0-6604c1e3a220-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:57:34 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-70323725-7485-4c4a-94d4-07be78b9e3df tempest-TestStampPattern-656958745 None] Acquiring lock "cinder-quobyte-8fe5bef5-2586-484c-93c0-6604c1e3a220" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:57:34 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-70323725-7485-4c4a-94d4-07be78b9e3df tempest-TestStampPattern-656958745 None] Lock "cinder-quobyte-8fe5bef5-2586-484c-93c0-6604c1e3a220" acquired by "delete_volume" :: waited 0.019s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:57:34 devstack sudo[101703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f119f71b-81b4-4516-bc51-caca10dfb272 Jul 08 01:57:34 devstack sudo[101703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:34 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a14ea72-7d07-4ac6-bc1b-bd812f4c0875]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:57:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-70323725-7485-4c4a-94d4-07be78b9e3df tempest-TestStampPattern-656958745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8fe5bef5-2586-484c-93c0-6604c1e3a220 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:34 devstack sudo[101705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8fe5bef5-2586-484c-93c0-6604c1e3a220 Jul 08 01:57:34 devstack sudo[101705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:34 devstack sudo[101703]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a9bb99a1-bf17-4a21-aa3a-4d0c72528060 tempest-VolumesExtendTest-460006720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f119f71b-81b4-4516-bc51-caca10dfb272" returned: 0 in 1.000s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a9bb99a1-bf17-4a21-aa3a-4d0c72528060 tempest-VolumesExtendTest-460006720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f119f71b-81b4-4516-bc51-caca10dfb272,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f119f71b-81b4-4516-bc51-caca10dfb272.2c83c649-7ef0-4fe5-879a-33e7b862bdb3 1G {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:34 devstack sudo[101715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f119f71b-81b4-4516-bc51-caca10dfb272,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f119f71b-81b4-4516-bc51-caca10dfb272.2c83c649-7ef0-4fe5-879a-33e7b862bdb3 1G Jul 08 01:57:34 devstack sudo[101715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:35 devstack sudo[101705]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-70323725-7485-4c4a-94d4-07be78b9e3df tempest-TestStampPattern-656958745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8fe5bef5-2586-484c-93c0-6604c1e3a220" returned: 0 in 1.002s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-70323725-7485-4c4a-94d4-07be78b9e3df tempest-TestStampPattern-656958745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8fe5bef5-2586-484c-93c0-6604c1e3a220 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:35 devstack sudo[101718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8fe5bef5-2586-484c-93c0-6604c1e3a220 Jul 08 01:57:35 devstack sudo[101718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:35 devstack sudo[101715]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a9bb99a1-bf17-4a21-aa3a-4d0c72528060 tempest-VolumesExtendTest-460006720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f119f71b-81b4-4516-bc51-caca10dfb272,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f119f71b-81b4-4516-bc51-caca10dfb272.2c83c649-7ef0-4fe5-879a-33e7b862bdb3 1G" returned: 0 in 0.950s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a9bb99a1-bf17-4a21-aa3a-4d0c72528060 tempest-VolumesExtendTest-460006720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f119f71b-81b4-4516-bc51-caca10dfb272 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f119f71b-81b4-4516-bc51-caca10dfb272.2c83c649-7ef0-4fe5-879a-33e7b862bdb3 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:35 devstack sudo[101718]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-70323725-7485-4c4a-94d4-07be78b9e3df tempest-TestStampPattern-656958745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8fe5bef5-2586-484c-93c0-6604c1e3a220" returned: 0 in 0.776s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:35 devstack sudo[101725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f119f71b-81b4-4516-bc51-caca10dfb272 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f119f71b-81b4-4516-bc51-caca10dfb272.2c83c649-7ef0-4fe5-879a-33e7b862bdb3 Jul 08 01:57:35 devstack sudo[101725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:35 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-70323725-7485-4c4a-94d4-07be78b9e3df tempest-TestStampPattern-656958745 None] Lock "cinder-quobyte-8fe5bef5-2586-484c-93c0-6604c1e3a220" released by "delete_volume" :: held 1.844s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:57:35 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-70323725-7485-4c4a-94d4-07be78b9e3df tempest-TestStampPattern-656958745 None] Created reservations ['b02c5907-3ad0-42e5-b491-840b27c2b80a', 'b93b8303-876a-4c34-a5c2-35a3c16f4805', 'bef8bd76-bb12-4820-a3af-c05593d5c92b', 'e055cce8-3911-426e-b990-14bc0db2b6d3'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:57:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-70323725-7485-4c4a-94d4-07be78b9e3df tempest-TestStampPattern-656958745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:57:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-70323725-7485-4c4a-94d4-07be78b9e3df tempest-TestStampPattern-656958745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:57:36 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-70323725-7485-4c4a-94d4-07be78b9e3df tempest-TestStampPattern-656958745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:57:36 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-70323725-7485-4c4a-94d4-07be78b9e3df tempest-TestStampPattern-656958745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:57:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-70323725-7485-4c4a-94d4-07be78b9e3df tempest-TestStampPattern-656958745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:57:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-70323725-7485-4c4a-94d4-07be78b9e3df tempest-TestStampPattern-656958745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:36 devstack sudo[101727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:57:36 devstack sudo[101727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:36 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-142b8604-b5fc-46be-802a-b516118b8e9e tempest-TestStampPattern-656958745 None] Acquiring lock "cinder-75b26816-905f-4743-acd3-4e9f4b095dd3-delete_snapshot" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:57:36 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-142b8604-b5fc-46be-802a-b516118b8e9e tempest-TestStampPattern-656958745 None] Lock "cinder-75b26816-905f-4743-acd3-4e9f4b095dd3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:57:36 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-142b8604-b5fc-46be-802a-b516118b8e9e tempest-TestStampPattern-656958745 None] Acquiring lock "cinder-quobyte-773e60c8-acd6-407d-afee-1c1a06403187" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:57:36 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-142b8604-b5fc-46be-802a-b516118b8e9e tempest-TestStampPattern-656958745 None] Lock "cinder-quobyte-773e60c8-acd6-407d-afee-1c1a06403187" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:57:36 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-142b8604-b5fc-46be-802a-b516118b8e9e tempest-TestStampPattern-656958745 None] Acquiring lock "cinder-quobyte-75b26816-905f-4743-acd3-4e9f4b095dd3" by "_delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:57:36 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-142b8604-b5fc-46be-802a-b516118b8e9e tempest-TestStampPattern-656958745 None] Lock "cinder-quobyte-75b26816-905f-4743-acd3-4e9f4b095dd3" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:57:36 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-142b8604-b5fc-46be-802a-b516118b8e9e tempest-TestStampPattern-656958745 None] Deleting offline snapshot 75b26816-905f-4743-acd3-4e9f4b095dd3 of volume 773e60c8-acd6-407d-afee-1c1a06403187 {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:57:36 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-142b8604-b5fc-46be-802a-b516118b8e9e tempest-TestStampPattern-656958745 None] snapshot_file for this snap is: volume-773e60c8-acd6-407d-afee-1c1a06403187.75b26816-905f-4743-acd3-4e9f4b095dd3 {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:57:36 devstack sudo[101725]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a9bb99a1-bf17-4a21-aa3a-4d0c72528060 tempest-VolumesExtendTest-460006720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f119f71b-81b4-4516-bc51-caca10dfb272 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f119f71b-81b4-4516-bc51-caca10dfb272.2c83c649-7ef0-4fe5-879a-33e7b862bdb3" returned: 0 in 0.848s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:36 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-a9bb99a1-bf17-4a21-aa3a-4d0c72528060 tempest-VolumesExtendTest-460006720 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f119f71b-81b4-4516-bc51-caca10dfb272.2c83c649-7ef0-4fe5-879a-33e7b862bdb3 is being set with open permissions: ugo+rw Jul 08 01:57:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a9bb99a1-bf17-4a21-aa3a-4d0c72528060 tempest-VolumesExtendTest-460006720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f119f71b-81b4-4516-bc51-caca10dfb272.2c83c649-7ef0-4fe5-879a-33e7b862bdb3 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:36 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f8f82c-97c4-4579-90b4-c31de4f3947a]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:57:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-142b8604-b5fc-46be-802a-b516118b8e9e tempest-TestStampPattern-656958745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-773e60c8-acd6-407d-afee-1c1a06403187.75b26816-905f-4743-acd3-4e9f4b095dd3 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:36 devstack sudo[101734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f119f71b-81b4-4516-bc51-caca10dfb272.2c83c649-7ef0-4fe5-879a-33e7b862bdb3 Jul 08 01:57:36 devstack sudo[101734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:36 devstack sudo[101727]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-70323725-7485-4c4a-94d4-07be78b9e3df tempest-TestStampPattern-656958745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.749s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:36 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-70323725-7485-4c4a-94d4-07be78b9e3df tempest-TestStampPattern-656958745 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:57:36 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-70323725-7485-4c4a-94d4-07be78b9e3df tempest-TestStampPattern-656958745 None] Deleted volume successfully. Jul 08 01:57:36 devstack sudo[101735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-773e60c8-acd6-407d-afee-1c1a06403187.75b26816-905f-4743-acd3-4e9f4b095dd3 Jul 08 01:57:36 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-70323725-7485-4c4a-94d4-07be78b9e3df tempest-TestStampPattern-656958745 None] Lock "cinder-8fe5bef5-2586-484c-93c0-6604c1e3a220-delete_volume" released by "delete_volume" :: held 2.871s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:57:36 devstack sudo[101735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:37 devstack sudo[101734]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a9bb99a1-bf17-4a21-aa3a-4d0c72528060 tempest-VolumesExtendTest-460006720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f119f71b-81b4-4516-bc51-caca10dfb272.2c83c649-7ef0-4fe5-879a-33e7b862bdb3" returned: 0 in 0.673s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a9bb99a1-bf17-4a21-aa3a-4d0c72528060 tempest-VolumesExtendTest-460006720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f119f71b-81b4-4516-bc51-caca10dfb272.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:37 devstack sudo[101742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f119f71b-81b4-4516-bc51-caca10dfb272.info Jul 08 01:57:37 devstack sudo[101742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:37 devstack sudo[101735]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-142b8604-b5fc-46be-802a-b516118b8e9e tempest-TestStampPattern-656958745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-773e60c8-acd6-407d-afee-1c1a06403187.75b26816-905f-4743-acd3-4e9f4b095dd3" returned: 0 in 0.806s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:37 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-142b8604-b5fc-46be-802a-b516118b8e9e tempest-TestStampPattern-656958745 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-773e60c8-acd6-407d-afee-1c1a06403187(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:57:37 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75c4900-d152-4961-aa09-2f73b313c2cf]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:57:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-142b8604-b5fc-46be-802a-b516118b8e9e tempest-TestStampPattern-656958745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-773e60c8-acd6-407d-afee-1c1a06403187 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:37 devstack sudo[101744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-773e60c8-acd6-407d-afee-1c1a06403187 Jul 08 01:57:37 devstack sudo[101744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:38 devstack sudo[101742]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a9bb99a1-bf17-4a21-aa3a-4d0c72528060 tempest-VolumesExtendTest-460006720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f119f71b-81b4-4516-bc51-caca10dfb272.info" returned: 0 in 0.669s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:38 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-a9bb99a1-bf17-4a21-aa3a-4d0c72528060 tempest-VolumesExtendTest-460006720 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f119f71b-81b4-4516-bc51-caca10dfb272.info is being set with open permissions: ugo+rw Jul 08 01:57:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a9bb99a1-bf17-4a21-aa3a-4d0c72528060 tempest-VolumesExtendTest-460006720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f119f71b-81b4-4516-bc51-caca10dfb272.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:38 devstack sudo[101747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f119f71b-81b4-4516-bc51-caca10dfb272.info Jul 08 01:57:38 devstack sudo[101747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:38 devstack sudo[101744]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-142b8604-b5fc-46be-802a-b516118b8e9e tempest-TestStampPattern-656958745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-773e60c8-acd6-407d-afee-1c1a06403187" returned: 0 in 0.799s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-142b8604-b5fc-46be-802a-b516118b8e9e tempest-TestStampPattern-656958745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-773e60c8-acd6-407d-afee-1c1a06403187.75b26816-905f-4743-acd3-4e9f4b095dd3 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:38 devstack sudo[101752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-773e60c8-acd6-407d-afee-1c1a06403187.75b26816-905f-4743-acd3-4e9f4b095dd3 Jul 08 01:57:38 devstack sudo[101752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:38 devstack sudo[101747]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a9bb99a1-bf17-4a21-aa3a-4d0c72528060 tempest-VolumesExtendTest-460006720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f119f71b-81b4-4516-bc51-caca10dfb272.info" returned: 0 in 0.697s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-a9bb99a1-bf17-4a21-aa3a-4d0c72528060 tempest-VolumesExtendTest-460006720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.957s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:57:38 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-a9bb99a1-bf17-4a21-aa3a-4d0c72528060 tempest-VolumesExtendTest-460006720 None] Create snapshot completed successfully Jul 08 01:57:39 devstack sudo[101752]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-142b8604-b5fc-46be-802a-b516118b8e9e tempest-TestStampPattern-656958745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-773e60c8-acd6-407d-afee-1c1a06403187.75b26816-905f-4743-acd3-4e9f4b095dd3" returned: 0 in 0.785s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-142b8604-b5fc-46be-802a-b516118b8e9e tempest-TestStampPattern-656958745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-773e60c8-acd6-407d-afee-1c1a06403187.75b26816-905f-4743-acd3-4e9f4b095dd3 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:39 devstack sudo[101759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-773e60c8-acd6-407d-afee-1c1a06403187.75b26816-905f-4743-acd3-4e9f4b095dd3 Jul 08 01:57:39 devstack sudo[101759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-1ac20cbd-85d8-487c-9ffb-7b979c981f6f tempest-VolumesExtendTest-460006720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:57:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-1ac20cbd-85d8-487c-9ffb-7b979c981f6f tempest-VolumesExtendTest-460006720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.004s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:57:39 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[303f9bc1-c667-4fc9-9c09-062da4e4c867]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:57:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1ac20cbd-85d8-487c-9ffb-7b979c981f6f tempest-VolumesExtendTest-460006720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f119f71b-81b4-4516-bc51-caca10dfb272 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:39 devstack sudo[101761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f119f71b-81b4-4516-bc51-caca10dfb272 Jul 08 01:57:39 devstack sudo[101761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:39 devstack sudo[101759]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-142b8604-b5fc-46be-802a-b516118b8e9e tempest-TestStampPattern-656958745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-773e60c8-acd6-407d-afee-1c1a06403187.75b26816-905f-4743-acd3-4e9f4b095dd3" returned: 0 in 0.800s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:40 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-142b8604-b5fc-46be-802a-b516118b8e9e tempest-TestStampPattern-656958745 None] Lock "cinder-quobyte-75b26816-905f-4743-acd3-4e9f4b095dd3" released by "_delete_snapshot" :: held 3.323s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:57:40 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-142b8604-b5fc-46be-802a-b516118b8e9e tempest-TestStampPattern-656958745 None] Lock "cinder-quobyte-773e60c8-acd6-407d-afee-1c1a06403187" released by "delete_snapshot" :: held 3.354s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:57:40 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-142b8604-b5fc-46be-802a-b516118b8e9e tempest-TestStampPattern-656958745 None] Created reservations ['f85afa37-90df-44d7-9df7-aa7e0e97ba2a', '681d22e0-c96e-48bf-a5e8-7b50919231ef', 'ad0b58e1-d3b9-4cac-9efd-38a37c747aac', '76db95df-f99d-470c-b7cc-e0780d54984c'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:57:40 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-142b8604-b5fc-46be-802a-b516118b8e9e tempest-TestStampPattern-656958745 None] Delete snapshot completed successfully. Jul 08 01:57:40 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-142b8604-b5fc-46be-802a-b516118b8e9e tempest-TestStampPattern-656958745 None] Lock "cinder-75b26816-905f-4743-acd3-4e9f4b095dd3-delete_snapshot" released by "delete_snapshot" :: held 3.533s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:57:40 devstack sudo[101761]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1ac20cbd-85d8-487c-9ffb-7b979c981f6f tempest-VolumesExtendTest-460006720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f119f71b-81b4-4516-bc51-caca10dfb272" returned: 0 in 0.998s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1ac20cbd-85d8-487c-9ffb-7b979c981f6f tempest-VolumesExtendTest-460006720 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f119f71b-81b4-4516-bc51-caca10dfb272.2c83c649-7ef0-4fe5-879a-33e7b862bdb3 2G {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1ac20cbd-85d8-487c-9ffb-7b979c981f6f tempest-VolumesExtendTest-460006720 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f119f71b-81b4-4516-bc51-caca10dfb272.2c83c649-7ef0-4fe5-879a-33e7b862bdb3 2G" returned: 0 in 0.226s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-1ac20cbd-85d8-487c-9ffb-7b979c981f6f tempest-VolumesExtendTest-460006720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.319s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:57:40 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-1ac20cbd-85d8-487c-9ffb-7b979c981f6f tempest-VolumesExtendTest-460006720 None] Extend volume completed successfully. Jul 08 01:57:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-4576181c-26ea-4f3f-91bb-eb73a0872806 req-f2bd4423-99cc-4d76-b17d-10d913f327d1 tempest-TestShelveInstance-426081337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:57:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-4576181c-26ea-4f3f-91bb-eb73a0872806 req-f2bd4423-99cc-4d76-b17d-10d913f327d1 tempest-TestShelveInstance-426081337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:57:41 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac30292-9278-4789-9089-137a434c1929]: (4, 'raw') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:57:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-4576181c-26ea-4f3f-91bb-eb73a0872806 req-f2bd4423-99cc-4d76-b17d-10d913f327d1 tempest-TestShelveInstance-426081337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1d15d46a-ee04-4123-97dc-6f823378d269 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:41 devstack sudo[101779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1d15d46a-ee04-4123-97dc-6f823378d269 Jul 08 01:57:41 devstack sudo[101779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:41 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-892c6209-74f9-4311-98bc-ba845f1e5d6e tempest-VolumesExtendTest-460006720 None] Acquiring lock "cinder-2c83c649-7ef0-4fe5-879a-33e7b862bdb3-delete_snapshot" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:57:41 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-892c6209-74f9-4311-98bc-ba845f1e5d6e tempest-VolumesExtendTest-460006720 None] Lock "cinder-2c83c649-7ef0-4fe5-879a-33e7b862bdb3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:57:41 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-892c6209-74f9-4311-98bc-ba845f1e5d6e tempest-VolumesExtendTest-460006720 None] Acquiring lock "cinder-quobyte-f119f71b-81b4-4516-bc51-caca10dfb272" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:57:41 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-892c6209-74f9-4311-98bc-ba845f1e5d6e tempest-VolumesExtendTest-460006720 None] Lock "cinder-quobyte-f119f71b-81b4-4516-bc51-caca10dfb272" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:57:41 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-892c6209-74f9-4311-98bc-ba845f1e5d6e tempest-VolumesExtendTest-460006720 None] Acquiring lock "cinder-quobyte-2c83c649-7ef0-4fe5-879a-33e7b862bdb3" by "_delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:57:41 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-892c6209-74f9-4311-98bc-ba845f1e5d6e tempest-VolumesExtendTest-460006720 None] Lock "cinder-quobyte-2c83c649-7ef0-4fe5-879a-33e7b862bdb3" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:57:41 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-892c6209-74f9-4311-98bc-ba845f1e5d6e tempest-VolumesExtendTest-460006720 None] Deleting offline snapshot 2c83c649-7ef0-4fe5-879a-33e7b862bdb3 of volume f119f71b-81b4-4516-bc51-caca10dfb272 {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:57:41 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-892c6209-74f9-4311-98bc-ba845f1e5d6e tempest-VolumesExtendTest-460006720 None] snapshot_file for this snap is: volume-f119f71b-81b4-4516-bc51-caca10dfb272.2c83c649-7ef0-4fe5-879a-33e7b862bdb3 {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:57:41 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1af356-87be-4306-894b-36f28b2c80ef]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:57:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-892c6209-74f9-4311-98bc-ba845f1e5d6e tempest-VolumesExtendTest-460006720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f119f71b-81b4-4516-bc51-caca10dfb272.2c83c649-7ef0-4fe5-879a-33e7b862bdb3 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:42 devstack sudo[101783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f119f71b-81b4-4516-bc51-caca10dfb272.2c83c649-7ef0-4fe5-879a-33e7b862bdb3 Jul 08 01:57:42 devstack sudo[101783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:42 devstack sudo[101779]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-4576181c-26ea-4f3f-91bb-eb73a0872806 req-f2bd4423-99cc-4d76-b17d-10d913f327d1 tempest-TestShelveInstance-426081337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1d15d46a-ee04-4123-97dc-6f823378d269" returned: 0 in 1.070s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-4576181c-26ea-4f3f-91bb-eb73a0872806 req-f2bd4423-99cc-4d76-b17d-10d913f327d1 tempest-TestShelveInstance-426081337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1d15d46a-ee04-4123-97dc-6f823378d269 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:42 devstack sudo[101788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1d15d46a-ee04-4123-97dc-6f823378d269 Jul 08 01:57:42 devstack sudo[101788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:42 devstack sudo[101783]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-892c6209-74f9-4311-98bc-ba845f1e5d6e tempest-VolumesExtendTest-460006720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f119f71b-81b4-4516-bc51-caca10dfb272.2c83c649-7ef0-4fe5-879a-33e7b862bdb3" returned: 0 in 0.966s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:42 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-892c6209-74f9-4311-98bc-ba845f1e5d6e tempest-VolumesExtendTest-460006720 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f119f71b-81b4-4516-bc51-caca10dfb272(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:57:42 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[013c5ba6-ff93-45b3-bc7d-5da7f2c8daf0]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:57:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-892c6209-74f9-4311-98bc-ba845f1e5d6e tempest-VolumesExtendTest-460006720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f119f71b-81b4-4516-bc51-caca10dfb272 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:42 devstack sudo[101795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f119f71b-81b4-4516-bc51-caca10dfb272 Jul 08 01:57:42 devstack sudo[101795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:43 devstack sudo[101788]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-4576181c-26ea-4f3f-91bb-eb73a0872806 req-f2bd4423-99cc-4d76-b17d-10d913f327d1 tempest-TestShelveInstance-426081337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1d15d46a-ee04-4123-97dc-6f823378d269" returned: 1 in 0.881s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-4576181c-26ea-4f3f-91bb-eb73a0872806 req-f2bd4423-99cc-4d76-b17d-10d913f327d1 tempest-TestShelveInstance-426081337 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1d15d46a-ee04-4123-97dc-6f823378d269' failed. Not Retrying. {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:57:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-4576181c-26ea-4f3f-91bb-eb73a0872806 req-f2bd4423-99cc-4d76-b17d-10d913f327d1 tempest-TestShelveInstance-426081337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.988s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:57:43 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [req-4576181c-26ea-4f3f-91bb-eb73a0872806 req-f2bd4423-99cc-4d76-b17d-10d913f327d1 tempest-TestShelveInstance-426081337 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17', 'name': 'volume-1d15d46a-ee04-4123-97dc-6f823378d269', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6d6b3a82-d1df-4a4e-8cbc-4eaa71bb28d3', 'enforce_multipath': True} {{(pid=87134) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:57:43 devstack cinder-volume[87134]: INFO cinder.volume.manager [req-4576181c-26ea-4f3f-91bb-eb73a0872806 req-f2bd4423-99cc-4d76-b17d-10d913f327d1 tempest-TestShelveInstance-426081337 None] attachment_update completed successfully. Jul 08 01:57:43 devstack sudo[101795]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-892c6209-74f9-4311-98bc-ba845f1e5d6e tempest-VolumesExtendTest-460006720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f119f71b-81b4-4516-bc51-caca10dfb272" returned: 0 in 0.936s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-892c6209-74f9-4311-98bc-ba845f1e5d6e tempest-VolumesExtendTest-460006720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f119f71b-81b4-4516-bc51-caca10dfb272.2c83c649-7ef0-4fe5-879a-33e7b862bdb3 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:43 devstack sudo[101810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f119f71b-81b4-4516-bc51-caca10dfb272.2c83c649-7ef0-4fe5-879a-33e7b862bdb3 Jul 08 01:57:43 devstack sudo[101810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:44 devstack sudo[101810]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-892c6209-74f9-4311-98bc-ba845f1e5d6e tempest-VolumesExtendTest-460006720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f119f71b-81b4-4516-bc51-caca10dfb272.2c83c649-7ef0-4fe5-879a-33e7b862bdb3" returned: 0 in 1.115s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-892c6209-74f9-4311-98bc-ba845f1e5d6e tempest-VolumesExtendTest-460006720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f119f71b-81b4-4516-bc51-caca10dfb272.2c83c649-7ef0-4fe5-879a-33e7b862bdb3 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:44 devstack sudo[101833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f119f71b-81b4-4516-bc51-caca10dfb272.2c83c649-7ef0-4fe5-879a-33e7b862bdb3 Jul 08 01:57:44 devstack sudo[101833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:45 devstack sudo[101833]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-892c6209-74f9-4311-98bc-ba845f1e5d6e tempest-VolumesExtendTest-460006720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f119f71b-81b4-4516-bc51-caca10dfb272.2c83c649-7ef0-4fe5-879a-33e7b862bdb3" returned: 0 in 0.765s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:45 devstack cinder-volume[87134]: DEBUG dbcounter [-] [87134] Writing DB stats cinder:UPDATE=80,cinder:SELECT=67,cinder:INSERT=26,cinder:DELETE=5 {{(pid=87134) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:57:45 devstack cinder-volume[87134]: DEBUG dbcounter [-] [87134] Writing DB stats cinder:SELECT=91,cinder:UPDATE=74,cinder:DELETE=6,cinder:INSERT=33 {{(pid=87134) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:57:45 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-892c6209-74f9-4311-98bc-ba845f1e5d6e tempest-VolumesExtendTest-460006720 None] Lock "cinder-quobyte-2c83c649-7ef0-4fe5-879a-33e7b862bdb3" released by "_delete_snapshot" :: held 3.958s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:57:45 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-892c6209-74f9-4311-98bc-ba845f1e5d6e tempest-VolumesExtendTest-460006720 None] Lock "cinder-quobyte-f119f71b-81b4-4516-bc51-caca10dfb272" released by "delete_snapshot" :: held 4.010s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:57:45 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-892c6209-74f9-4311-98bc-ba845f1e5d6e tempest-VolumesExtendTest-460006720 None] Created reservations ['37d9981c-936c-4878-b83a-79f098c71f6e', '49e96c1e-e3bb-4425-a40b-31087e8d2dd3', 'b3db3c99-9452-4deb-8671-418694fa8d04', 'a082b21a-2b93-4a61-99e5-d59678f19483'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:57:45 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-892c6209-74f9-4311-98bc-ba845f1e5d6e tempest-VolumesExtendTest-460006720 None] Delete snapshot completed successfully. Jul 08 01:57:45 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-892c6209-74f9-4311-98bc-ba845f1e5d6e tempest-VolumesExtendTest-460006720 None] Lock "cinder-2c83c649-7ef0-4fe5-879a-33e7b862bdb3-delete_snapshot" released by "delete_snapshot" :: held 4.235s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:57:46 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7bf4aedd-26b2-4af6-8981-1d65691b178c tempest-VolumesExtendTest-460006720 None] Acquiring lock "cinder-f119f71b-81b4-4516-bc51-caca10dfb272-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:57:46 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7bf4aedd-26b2-4af6-8981-1d65691b178c tempest-VolumesExtendTest-460006720 None] Lock "cinder-f119f71b-81b4-4516-bc51-caca10dfb272-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:57:46 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7bf4aedd-26b2-4af6-8981-1d65691b178c tempest-VolumesExtendTest-460006720 None] Acquiring lock "cinder-quobyte-f119f71b-81b4-4516-bc51-caca10dfb272" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:57:46 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7bf4aedd-26b2-4af6-8981-1d65691b178c tempest-VolumesExtendTest-460006720 None] Lock "cinder-quobyte-f119f71b-81b4-4516-bc51-caca10dfb272" acquired by "delete_volume" :: waited 0.024s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:57:46 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b96254-105e-4724-8856-572af491691d]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:57:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7bf4aedd-26b2-4af6-8981-1d65691b178c tempest-VolumesExtendTest-460006720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f119f71b-81b4-4516-bc51-caca10dfb272 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:46 devstack sudo[101903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f119f71b-81b4-4516-bc51-caca10dfb272 Jul 08 01:57:46 devstack sudo[101903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:47 devstack sudo[101903]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7bf4aedd-26b2-4af6-8981-1d65691b178c tempest-VolumesExtendTest-460006720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f119f71b-81b4-4516-bc51-caca10dfb272" returned: 0 in 1.129s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7bf4aedd-26b2-4af6-8981-1d65691b178c tempest-VolumesExtendTest-460006720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f119f71b-81b4-4516-bc51-caca10dfb272 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:47 devstack sudo[101944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f119f71b-81b4-4516-bc51-caca10dfb272 Jul 08 01:57:47 devstack sudo[101944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:48 devstack sudo[101944]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7bf4aedd-26b2-4af6-8981-1d65691b178c tempest-VolumesExtendTest-460006720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f119f71b-81b4-4516-bc51-caca10dfb272" returned: 0 in 0.844s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:48 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7bf4aedd-26b2-4af6-8981-1d65691b178c tempest-VolumesExtendTest-460006720 None] Lock "cinder-quobyte-f119f71b-81b4-4516-bc51-caca10dfb272" released by "delete_volume" :: held 2.054s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:57:48 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-7bf4aedd-26b2-4af6-8981-1d65691b178c tempest-VolumesExtendTest-460006720 None] Created reservations ['e9d1ebd5-baba-4824-85d6-8d9ae72baefd', 'de4425fa-5718-4800-81e5-0d72ceb9f30b', '524b5c46-7527-4c3c-80ad-112945928f20', '28384458-6c99-4170-bca0-a3f1ba520412'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:57:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7bf4aedd-26b2-4af6-8981-1d65691b178c tempest-VolumesExtendTest-460006720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:57:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7bf4aedd-26b2-4af6-8981-1d65691b178c tempest-VolumesExtendTest-460006720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:57:48 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-7bf4aedd-26b2-4af6-8981-1d65691b178c tempest-VolumesExtendTest-460006720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:57:48 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-7bf4aedd-26b2-4af6-8981-1d65691b178c tempest-VolumesExtendTest-460006720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:57:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7bf4aedd-26b2-4af6-8981-1d65691b178c tempest-VolumesExtendTest-460006720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:57:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7bf4aedd-26b2-4af6-8981-1d65691b178c tempest-VolumesExtendTest-460006720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:48 devstack sudo[101956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:57:48 devstack sudo[101956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:48 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-e68d4cc3-53b3-4208-9e31-5a19e9bebfba tempest-TestStampPattern-656958745 None] Acquiring lock "cinder-773e60c8-acd6-407d-afee-1c1a06403187-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:57:48 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-e68d4cc3-53b3-4208-9e31-5a19e9bebfba tempest-TestStampPattern-656958745 None] Lock "cinder-773e60c8-acd6-407d-afee-1c1a06403187-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:57:48 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-e68d4cc3-53b3-4208-9e31-5a19e9bebfba tempest-TestStampPattern-656958745 None] Acquiring lock "cinder-quobyte-773e60c8-acd6-407d-afee-1c1a06403187" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:57:49 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-e68d4cc3-53b3-4208-9e31-5a19e9bebfba tempest-TestStampPattern-656958745 None] Lock "cinder-quobyte-773e60c8-acd6-407d-afee-1c1a06403187" acquired by "delete_volume" :: waited 0.022s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:57:49 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[865b7885-0cff-4137-a48f-40fee4ac7814]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:57:49 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e68d4cc3-53b3-4208-9e31-5a19e9bebfba tempest-TestStampPattern-656958745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-773e60c8-acd6-407d-afee-1c1a06403187 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:49 devstack sudo[101956]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:49 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7bf4aedd-26b2-4af6-8981-1d65691b178c tempest-VolumesExtendTest-460006720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.835s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:49 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-7bf4aedd-26b2-4af6-8981-1d65691b178c tempest-VolumesExtendTest-460006720 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:57:49 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-7bf4aedd-26b2-4af6-8981-1d65691b178c tempest-VolumesExtendTest-460006720 None] Deleted volume successfully. Jul 08 01:57:49 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7bf4aedd-26b2-4af6-8981-1d65691b178c tempest-VolumesExtendTest-460006720 None] Lock "cinder-f119f71b-81b4-4516-bc51-caca10dfb272-delete_volume" released by "delete_volume" :: held 3.130s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:57:49 devstack sudo[102290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-773e60c8-acd6-407d-afee-1c1a06403187 Jul 08 01:57:49 devstack sudo[102290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:50 devstack sudo[102290]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:50 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e68d4cc3-53b3-4208-9e31-5a19e9bebfba tempest-TestStampPattern-656958745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-773e60c8-acd6-407d-afee-1c1a06403187" returned: 0 in 0.989s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:50 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e68d4cc3-53b3-4208-9e31-5a19e9bebfba tempest-TestStampPattern-656958745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-773e60c8-acd6-407d-afee-1c1a06403187 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:50 devstack sudo[102298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-773e60c8-acd6-407d-afee-1c1a06403187 Jul 08 01:57:50 devstack sudo[102298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:50 devstack sudo[102298]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:50 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e68d4cc3-53b3-4208-9e31-5a19e9bebfba tempest-TestStampPattern-656958745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-773e60c8-acd6-407d-afee-1c1a06403187" returned: 0 in 0.857s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:50 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-e68d4cc3-53b3-4208-9e31-5a19e9bebfba tempest-TestStampPattern-656958745 None] Lock "cinder-quobyte-773e60c8-acd6-407d-afee-1c1a06403187" released by "delete_volume" :: held 1.961s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:57:51 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-e68d4cc3-53b3-4208-9e31-5a19e9bebfba tempest-TestStampPattern-656958745 None] Created reservations ['cc10a456-1839-41d7-a1ce-c66ebcb1a195', '03d00484-1649-4f0b-93ac-efb0853709c7', '5122ea37-e164-49dc-9e0f-01cf976c11cf', 'a2f17788-df89-4970-af7d-35ce47ad435b'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:57:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e68d4cc3-53b3-4208-9e31-5a19e9bebfba tempest-TestStampPattern-656958745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:57:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e68d4cc3-53b3-4208-9e31-5a19e9bebfba tempest-TestStampPattern-656958745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:57:51 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-e68d4cc3-53b3-4208-9e31-5a19e9bebfba tempest-TestStampPattern-656958745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:57:51 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-e68d4cc3-53b3-4208-9e31-5a19e9bebfba tempest-TestStampPattern-656958745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:57:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e68d4cc3-53b3-4208-9e31-5a19e9bebfba tempest-TestStampPattern-656958745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:57:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e68d4cc3-53b3-4208-9e31-5a19e9bebfba tempest-TestStampPattern-656958745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:51 devstack sudo[102301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:57:51 devstack sudo[102301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:52 devstack sudo[102301]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:52 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e68d4cc3-53b3-4208-9e31-5a19e9bebfba tempest-TestStampPattern-656958745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 1.227s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:52 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-e68d4cc3-53b3-4208-9e31-5a19e9bebfba tempest-TestStampPattern-656958745 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:57:52 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-e68d4cc3-53b3-4208-9e31-5a19e9bebfba tempest-TestStampPattern-656958745 None] Deleted volume successfully. Jul 08 01:57:52 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-e68d4cc3-53b3-4208-9e31-5a19e9bebfba tempest-TestStampPattern-656958745 None] Lock "cinder-773e60c8-acd6-407d-afee-1c1a06403187-delete_volume" released by "delete_volume" :: held 3.542s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:57:54 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-62c02d4a-58fb-46fc-8ea3-1e1c14dbf46b tempest-VolumesGetTest-1407621467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:57:54 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-62c02d4a-58fb-46fc-8ea3-1e1c14dbf46b tempest-VolumesGetTest-1407621467 None] Flow 'volume_create_manager' (f62fe223-c137-4474-bab3-793bc9d702f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:57:54 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-62c02d4a-58fb-46fc-8ea3-1e1c14dbf46b tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c667aaac-910a-4a5f-a9a5-0cd915c9bf8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:54 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-62c02d4a-58fb-46fc-8ea3-1e1c14dbf46b tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c667aaac-910a-4a5f-a9a5-0cd915c9bf8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:57:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1347869563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89e3a823-24dc-43c8-b44c-5cb05633c4ff,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='bb44ecb9700c48c39aa9210cf1e798e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:57:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:57:54Z,use_quota=True,user_id='925ed36452c74af79400cbb0f3a38c86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:54 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-62c02d4a-58fb-46fc-8ea3-1e1c14dbf46b tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24791081-4ef2-4558-9aec-0ba3ee561ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:54 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-62c02d4a-58fb-46fc-8ea3-1e1c14dbf46b tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24791081-4ef2-4558-9aec-0ba3ee561ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:54 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-62c02d4a-58fb-46fc-8ea3-1e1c14dbf46b tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (615980bb-6452-415d-8c26-d15e587ba804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:54 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-62c02d4a-58fb-46fc-8ea3-1e1c14dbf46b tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (615980bb-6452-415d-8c26-d15e587ba804) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89e3a823-24dc-43c8-b44c-5cb05633c4ff', 'volume_name': 'volume-89e3a823-24dc-43c8-b44c-5cb05633c4ff', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:54 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-62c02d4a-58fb-46fc-8ea3-1e1c14dbf46b tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf5d595b-d2ba-4e73-8718-83ff0fe39501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:54 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-62c02d4a-58fb-46fc-8ea3-1e1c14dbf46b tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf5d595b-d2ba-4e73-8718-83ff0fe39501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:54 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-62c02d4a-58fb-46fc-8ea3-1e1c14dbf46b tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e6304f4-ba5a-4c89-a0b9-ad130f113edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:54 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-62c02d4a-58fb-46fc-8ea3-1e1c14dbf46b tempest-VolumesGetTest-1407621467 None] Volume 89e3a823-24dc-43c8-b44c-5cb05633c4ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89e3a823-24dc-43c8-b44c-5cb05633c4ff', 'volume_size': 1} Jul 08 01:57:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-62c02d4a-58fb-46fc-8ea3-1e1c14dbf46b tempest-VolumesGetTest-1407621467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:57:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-62c02d4a-58fb-46fc-8ea3-1e1c14dbf46b tempest-VolumesGetTest-1407621467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:57:54 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-62c02d4a-58fb-46fc-8ea3-1e1c14dbf46b tempest-VolumesGetTest-1407621467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:57:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1347869563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89e3a823-24dc-43c8-b44c-5cb05633c4ff,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='bb44ecb9700c48c39aa9210cf1e798e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:57:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:57:54Z,use_quota=True,user_id='925ed36452c74af79400cbb0f3a38c86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:57:54 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-62c02d4a-58fb-46fc-8ea3-1e1c14dbf46b tempest-VolumesGetTest-1407621467 None] Creating volume 89e3a823-24dc-43c8-b44c-5cb05633c4ff {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:57:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-62c02d4a-58fb-46fc-8ea3-1e1c14dbf46b tempest-VolumesGetTest-1407621467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:57:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-62c02d4a-58fb-46fc-8ea3-1e1c14dbf46b tempest-VolumesGetTest-1407621467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:57:54 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-62c02d4a-58fb-46fc-8ea3-1e1c14dbf46b tempest-VolumesGetTest-1407621467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:57:54 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-62c02d4a-58fb-46fc-8ea3-1e1c14dbf46b tempest-VolumesGetTest-1407621467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:57:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-62c02d4a-58fb-46fc-8ea3-1e1c14dbf46b tempest-VolumesGetTest-1407621467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:57:54 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-62c02d4a-58fb-46fc-8ea3-1e1c14dbf46b tempest-VolumesGetTest-1407621467 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:57:54 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-62c02d4a-58fb-46fc-8ea3-1e1c14dbf46b tempest-VolumesGetTest-1407621467 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:57:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-62c02d4a-58fb-46fc-8ea3-1e1c14dbf46b tempest-VolumesGetTest-1407621467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-89e3a823-24dc-43c8-b44c-5cb05633c4ff 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:54 devstack sudo[102306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-89e3a823-24dc-43c8-b44c-5cb05633c4ff 1073741824 Jul 08 01:57:54 devstack sudo[102306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:55 devstack sudo[102306]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:55 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-62c02d4a-58fb-46fc-8ea3-1e1c14dbf46b tempest-VolumesGetTest-1407621467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-89e3a823-24dc-43c8-b44c-5cb05633c4ff 1073741824" returned: 0 in 1.347s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:55 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-62c02d4a-58fb-46fc-8ea3-1e1c14dbf46b tempest-VolumesGetTest-1407621467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-89e3a823-24dc-43c8-b44c-5cb05633c4ff {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:55 devstack sudo[102313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-89e3a823-24dc-43c8-b44c-5cb05633c4ff Jul 08 01:57:55 devstack sudo[102313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:56 devstack sudo[102313]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:56 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-62c02d4a-58fb-46fc-8ea3-1e1c14dbf46b tempest-VolumesGetTest-1407621467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-89e3a823-24dc-43c8-b44c-5cb05633c4ff" returned: 0 in 0.962s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:56 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-62c02d4a-58fb-46fc-8ea3-1e1c14dbf46b tempest-VolumesGetTest-1407621467 None] <== create_volume: return (2389ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:57:56 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-62c02d4a-58fb-46fc-8ea3-1e1c14dbf46b tempest-VolumesGetTest-1407621467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.393s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:57:56 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-62c02d4a-58fb-46fc-8ea3-1e1c14dbf46b tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e6304f4-ba5a-4c89-a0b9-ad130f113edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89e3a823-24dc-43c8-b44c-5cb05633c4ff', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:56 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-62c02d4a-58fb-46fc-8ea3-1e1c14dbf46b tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e1300c1-d3d2-4306-a895-7af1b320094f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:56 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-62c02d4a-58fb-46fc-8ea3-1e1c14dbf46b tempest-VolumesGetTest-1407621467 None] Volume volume-89e3a823-24dc-43c8-b44c-5cb05633c4ff (89e3a823-24dc-43c8-b44c-5cb05633c4ff): created successfully Jul 08 01:57:56 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-62c02d4a-58fb-46fc-8ea3-1e1c14dbf46b tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e1300c1-d3d2-4306-a895-7af1b320094f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:56 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-62c02d4a-58fb-46fc-8ea3-1e1c14dbf46b tempest-VolumesGetTest-1407621467 None] Flow 'volume_create_manager' (f62fe223-c137-4474-bab3-793bc9d702f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:57:56 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-62c02d4a-58fb-46fc-8ea3-1e1c14dbf46b tempest-VolumesGetTest-1407621467 None] Created volume successfully. Jul 08 01:57:58 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0446fb0-5546-4d22-8319-fc93b8cbfd2b tempest-VolumesGetTest-1407621467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:57:58 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f0446fb0-5546-4d22-8319-fc93b8cbfd2b tempest-VolumesGetTest-1407621467 None] Flow 'volume_create_manager' (18ec3212-3d8d-4cae-8c8f-e03804572643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:57:58 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f0446fb0-5546-4d22-8319-fc93b8cbfd2b tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea8de60e-98a4-4756-8231-b4638925eaae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:58 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f0446fb0-5546-4d22-8319-fc93b8cbfd2b tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea8de60e-98a4-4756-8231-b4638925eaae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:57:58Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-892286971',display_name='tempest-VolumesGetTest-Volume-119779314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42b12181-e641-4646-8760-de8c5933c445,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb44ecb9700c48c39aa9210cf1e798e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:57:58Z,use_quota=True,user_id='925ed36452c74af79400cbb0f3a38c86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:58 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f0446fb0-5546-4d22-8319-fc93b8cbfd2b tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01c0fafc-8398-47d4-b8b5-94bfd1c54c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:58 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f0446fb0-5546-4d22-8319-fc93b8cbfd2b tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01c0fafc-8398-47d4-b8b5-94bfd1c54c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:58 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f0446fb0-5546-4d22-8319-fc93b8cbfd2b tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (023860bb-d1d0-456d-943f-d955d36f068c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:58 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f0446fb0-5546-4d22-8319-fc93b8cbfd2b tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (023860bb-d1d0-456d-943f-d955d36f068c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42b12181-e641-4646-8760-de8c5933c445', 'volume_name': 'volume-42b12181-e641-4646-8760-de8c5933c445', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:58 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f0446fb0-5546-4d22-8319-fc93b8cbfd2b tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e0a7704-14fc-45de-8b48-ace49d0c9505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:58 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f0446fb0-5546-4d22-8319-fc93b8cbfd2b tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e0a7704-14fc-45de-8b48-ace49d0c9505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:57:58 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f0446fb0-5546-4d22-8319-fc93b8cbfd2b tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ee093be-d131-457f-85ee-7f71eb4d47c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:57:58 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-f0446fb0-5546-4d22-8319-fc93b8cbfd2b tempest-VolumesGetTest-1407621467 None] Volume 42b12181-e641-4646-8760-de8c5933c445: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42b12181-e641-4646-8760-de8c5933c445', 'volume_size': 1} Jul 08 01:57:58 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-f0446fb0-5546-4d22-8319-fc93b8cbfd2b tempest-VolumesGetTest-1407621467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:57:58 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-f0446fb0-5546-4d22-8319-fc93b8cbfd2b tempest-VolumesGetTest-1407621467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:57:58 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-f0446fb0-5546-4d22-8319-fc93b8cbfd2b tempest-VolumesGetTest-1407621467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:57:58Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-892286971',display_name='tempest-VolumesGetTest-Volume-119779314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42b12181-e641-4646-8760-de8c5933c445,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb44ecb9700c48c39aa9210cf1e798e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:57:58Z,use_quota=True,user_id='925ed36452c74af79400cbb0f3a38c86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:57:58 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-f0446fb0-5546-4d22-8319-fc93b8cbfd2b tempest-VolumesGetTest-1407621467 None] Creating volume 42b12181-e641-4646-8760-de8c5933c445 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:57:58 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-f0446fb0-5546-4d22-8319-fc93b8cbfd2b tempest-VolumesGetTest-1407621467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:57:58 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-f0446fb0-5546-4d22-8319-fc93b8cbfd2b tempest-VolumesGetTest-1407621467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:57:58 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-f0446fb0-5546-4d22-8319-fc93b8cbfd2b tempest-VolumesGetTest-1407621467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:57:58 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-f0446fb0-5546-4d22-8319-fc93b8cbfd2b tempest-VolumesGetTest-1407621467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:57:58 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-f0446fb0-5546-4d22-8319-fc93b8cbfd2b tempest-VolumesGetTest-1407621467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:57:58 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-f0446fb0-5546-4d22-8319-fc93b8cbfd2b tempest-VolumesGetTest-1407621467 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:57:58 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-f0446fb0-5546-4d22-8319-fc93b8cbfd2b tempest-VolumesGetTest-1407621467 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:57:58 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f0446fb0-5546-4d22-8319-fc93b8cbfd2b tempest-VolumesGetTest-1407621467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-42b12181-e641-4646-8760-de8c5933c445 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:58 devstack sudo[102318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-42b12181-e641-4646-8760-de8c5933c445 1073741824 Jul 08 01:57:58 devstack sudo[102318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:57:59 devstack sudo[102318]: pam_unix(sudo:session): session closed for user root Jul 08 01:57:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f0446fb0-5546-4d22-8319-fc93b8cbfd2b tempest-VolumesGetTest-1407621467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-42b12181-e641-4646-8760-de8c5933c445 1073741824" returned: 0 in 1.061s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:57:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f0446fb0-5546-4d22-8319-fc93b8cbfd2b tempest-VolumesGetTest-1407621467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-42b12181-e641-4646-8760-de8c5933c445 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:57:59 devstack sudo[102325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-42b12181-e641-4646-8760-de8c5933c445 Jul 08 01:57:59 devstack sudo[102325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:00 devstack sudo[102325]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f0446fb0-5546-4d22-8319-fc93b8cbfd2b tempest-VolumesGetTest-1407621467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-42b12181-e641-4646-8760-de8c5933c445" returned: 0 in 0.729s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:00 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-f0446fb0-5546-4d22-8319-fc93b8cbfd2b tempest-VolumesGetTest-1407621467 None] <== create_volume: return (1882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:58:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-f0446fb0-5546-4d22-8319-fc93b8cbfd2b tempest-VolumesGetTest-1407621467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.885s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:58:00 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f0446fb0-5546-4d22-8319-fc93b8cbfd2b tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ee093be-d131-457f-85ee-7f71eb4d47c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42b12181-e641-4646-8760-de8c5933c445', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:00 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f0446fb0-5546-4d22-8319-fc93b8cbfd2b tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (501146b4-26de-4b4b-ad00-85d620e7bbc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:00 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-f0446fb0-5546-4d22-8319-fc93b8cbfd2b tempest-VolumesGetTest-1407621467 None] Volume volume-42b12181-e641-4646-8760-de8c5933c445 (42b12181-e641-4646-8760-de8c5933c445): created successfully Jul 08 01:58:00 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f0446fb0-5546-4d22-8319-fc93b8cbfd2b tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (501146b4-26de-4b4b-ad00-85d620e7bbc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:00 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f0446fb0-5546-4d22-8319-fc93b8cbfd2b tempest-VolumesGetTest-1407621467 None] Flow 'volume_create_manager' (18ec3212-3d8d-4cae-8c8f-e03804572643) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:58:00 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-f0446fb0-5546-4d22-8319-fc93b8cbfd2b tempest-VolumesGetTest-1407621467 None] Created volume successfully. Jul 08 01:58:01 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-20d9bd51-e29f-4b40-bed2-a6e7ecb3ac44 tempest-VolumesGetTest-1407621467 None] Acquiring lock "cinder-42b12181-e641-4646-8760-de8c5933c445-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:58:01 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-20d9bd51-e29f-4b40-bed2-a6e7ecb3ac44 tempest-VolumesGetTest-1407621467 None] Lock "cinder-42b12181-e641-4646-8760-de8c5933c445-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:58:01 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-20d9bd51-e29f-4b40-bed2-a6e7ecb3ac44 tempest-VolumesGetTest-1407621467 None] Acquiring lock "cinder-quobyte-42b12181-e641-4646-8760-de8c5933c445" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:58:01 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-20d9bd51-e29f-4b40-bed2-a6e7ecb3ac44 tempest-VolumesGetTest-1407621467 None] Lock "cinder-quobyte-42b12181-e641-4646-8760-de8c5933c445" acquired by "delete_volume" :: waited 0.023s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:58:01 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c3839d-477e-4d21-83b6-471e93b466bf]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:58:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-20d9bd51-e29f-4b40-bed2-a6e7ecb3ac44 tempest-VolumesGetTest-1407621467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-42b12181-e641-4646-8760-de8c5933c445 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:02 devstack sudo[102328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-42b12181-e641-4646-8760-de8c5933c445 Jul 08 01:58:02 devstack sudo[102328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:02 devstack sudo[102328]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-20d9bd51-e29f-4b40-bed2-a6e7ecb3ac44 tempest-VolumesGetTest-1407621467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-42b12181-e641-4646-8760-de8c5933c445" returned: 0 in 0.903s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-20d9bd51-e29f-4b40-bed2-a6e7ecb3ac44 tempest-VolumesGetTest-1407621467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-42b12181-e641-4646-8760-de8c5933c445 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:02 devstack sudo[102335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-42b12181-e641-4646-8760-de8c5933c445 Jul 08 01:58:02 devstack sudo[102335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:03 devstack sudo[102335]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:03 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-20d9bd51-e29f-4b40-bed2-a6e7ecb3ac44 tempest-VolumesGetTest-1407621467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-42b12181-e641-4646-8760-de8c5933c445" returned: 0 in 0.747s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:03 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-20d9bd51-e29f-4b40-bed2-a6e7ecb3ac44 tempest-VolumesGetTest-1407621467 None] Lock "cinder-quobyte-42b12181-e641-4646-8760-de8c5933c445" released by "delete_volume" :: held 1.699s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:58:03 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-20d9bd51-e29f-4b40-bed2-a6e7ecb3ac44 tempest-VolumesGetTest-1407621467 None] Created reservations ['cca02aea-d8ba-4001-b5d8-8837ded7de51', '1a4bf533-58ca-4e54-ab07-6bbf56c9ba27', 'ccc57da0-72de-4530-ab4e-9bfe5065eab2', '7e216e2a-7b57-4d02-b007-3bd2f4f93806'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:58:03 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-20d9bd51-e29f-4b40-bed2-a6e7ecb3ac44 tempest-VolumesGetTest-1407621467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:58:03 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-20d9bd51-e29f-4b40-bed2-a6e7ecb3ac44 tempest-VolumesGetTest-1407621467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:58:03 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-20d9bd51-e29f-4b40-bed2-a6e7ecb3ac44 tempest-VolumesGetTest-1407621467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:58:03 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-20d9bd51-e29f-4b40-bed2-a6e7ecb3ac44 tempest-VolumesGetTest-1407621467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:58:03 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-20d9bd51-e29f-4b40-bed2-a6e7ecb3ac44 tempest-VolumesGetTest-1407621467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:58:03 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-20d9bd51-e29f-4b40-bed2-a6e7ecb3ac44 tempest-VolumesGetTest-1407621467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:03 devstack sudo[102338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:58:03 devstack sudo[102338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:04 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-241970a8-35a9-4e7d-8b96-973e37a9877a tempest-VolumesGetTest-1407621467 None] Acquiring lock "cinder-89e3a823-24dc-43c8-b44c-5cb05633c4ff-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:58:04 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-241970a8-35a9-4e7d-8b96-973e37a9877a tempest-VolumesGetTest-1407621467 None] Lock "cinder-89e3a823-24dc-43c8-b44c-5cb05633c4ff-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:58:04 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-241970a8-35a9-4e7d-8b96-973e37a9877a tempest-VolumesGetTest-1407621467 None] Acquiring lock "cinder-quobyte-89e3a823-24dc-43c8-b44c-5cb05633c4ff" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:58:04 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-241970a8-35a9-4e7d-8b96-973e37a9877a tempest-VolumesGetTest-1407621467 None] Lock "cinder-quobyte-89e3a823-24dc-43c8-b44c-5cb05633c4ff" acquired by "delete_volume" :: waited 0.024s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:58:04 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe88919-6131-476b-93ce-34e989afad20]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:58:04 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-241970a8-35a9-4e7d-8b96-973e37a9877a tempest-VolumesGetTest-1407621467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-89e3a823-24dc-43c8-b44c-5cb05633c4ff {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:04 devstack sudo[102340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-89e3a823-24dc-43c8-b44c-5cb05633c4ff Jul 08 01:58:04 devstack sudo[102340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:04 devstack sudo[102338]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:04 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-20d9bd51-e29f-4b40-bed2-a6e7ecb3ac44 tempest-VolumesGetTest-1407621467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 1.070s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:04 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-20d9bd51-e29f-4b40-bed2-a6e7ecb3ac44 tempest-VolumesGetTest-1407621467 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:58:04 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-20d9bd51-e29f-4b40-bed2-a6e7ecb3ac44 tempest-VolumesGetTest-1407621467 None] Deleted volume successfully. Jul 08 01:58:04 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-20d9bd51-e29f-4b40-bed2-a6e7ecb3ac44 tempest-VolumesGetTest-1407621467 None] Lock "cinder-42b12181-e641-4646-8760-de8c5933c445-delete_volume" released by "delete_volume" :: held 3.091s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:58:05 devstack sudo[102340]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:05 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-241970a8-35a9-4e7d-8b96-973e37a9877a tempest-VolumesGetTest-1407621467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-89e3a823-24dc-43c8-b44c-5cb05633c4ff" returned: 0 in 0.992s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:05 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-241970a8-35a9-4e7d-8b96-973e37a9877a tempest-VolumesGetTest-1407621467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-89e3a823-24dc-43c8-b44c-5cb05633c4ff {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:05 devstack sudo[102347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-89e3a823-24dc-43c8-b44c-5cb05633c4ff Jul 08 01:58:05 devstack sudo[102347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:06 devstack sudo[102347]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:06 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-241970a8-35a9-4e7d-8b96-973e37a9877a tempest-VolumesGetTest-1407621467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-89e3a823-24dc-43c8-b44c-5cb05633c4ff" returned: 0 in 0.823s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:06 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-241970a8-35a9-4e7d-8b96-973e37a9877a tempest-VolumesGetTest-1407621467 None] Lock "cinder-quobyte-89e3a823-24dc-43c8-b44c-5cb05633c4ff" released by "delete_volume" :: held 1.893s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:58:06 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-241970a8-35a9-4e7d-8b96-973e37a9877a tempest-VolumesGetTest-1407621467 None] Created reservations ['c2fa36b1-6898-4b20-8e7f-ea2c658f693d', '7cc51ecf-1125-4e23-9a31-5b6713ab3842', 'd15a5449-63f9-4777-9a98-a83fb33f059b', 'a5d4b127-5f0e-4b4e-8bca-68ded87125a8'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:58:06 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-241970a8-35a9-4e7d-8b96-973e37a9877a tempest-VolumesGetTest-1407621467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:58:06 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-241970a8-35a9-4e7d-8b96-973e37a9877a tempest-VolumesGetTest-1407621467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:58:06 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-241970a8-35a9-4e7d-8b96-973e37a9877a tempest-VolumesGetTest-1407621467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:58:06 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-241970a8-35a9-4e7d-8b96-973e37a9877a tempest-VolumesGetTest-1407621467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:58:06 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-241970a8-35a9-4e7d-8b96-973e37a9877a tempest-VolumesGetTest-1407621467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:58:06 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-241970a8-35a9-4e7d-8b96-973e37a9877a tempest-VolumesGetTest-1407621467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:06 devstack sudo[102438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:58:06 devstack sudo[102438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:06 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec61f309-df49-4de5-8cfc-4d6f743561ba tempest-CreateVolumesFromSnapshotTest-1085348611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:58:06 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ec61f309-df49-4de5-8cfc-4d6f743561ba tempest-CreateVolumesFromSnapshotTest-1085348611 None] Flow 'volume_create_manager' (f91188e8-8037-48e2-8b55-0093f4cba812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:58:06 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ec61f309-df49-4de5-8cfc-4d6f743561ba tempest-CreateVolumesFromSnapshotTest-1085348611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2e3fc80-49b8-48b5-abfd-239ba5d91c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:06 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ec61f309-df49-4de5-8cfc-4d6f743561ba tempest-CreateVolumesFromSnapshotTest-1085348611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2e3fc80-49b8-48b5-abfd-239ba5d91c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:58:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1315936026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49abc5a7-a5d5-4586-8c83-1cf917a91ade,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6610d2bff4845f39c6f7738e6df4111',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:58:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:58:07Z,use_quota=True,user_id='6864a1cdffa44b608d610dde17fc2d2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:06 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ec61f309-df49-4de5-8cfc-4d6f743561ba tempest-CreateVolumesFromSnapshotTest-1085348611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4feecb67-43c9-475f-a71d-cc48f298cc07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:06 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ec61f309-df49-4de5-8cfc-4d6f743561ba tempest-CreateVolumesFromSnapshotTest-1085348611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4feecb67-43c9-475f-a71d-cc48f298cc07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:06 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ec61f309-df49-4de5-8cfc-4d6f743561ba tempest-CreateVolumesFromSnapshotTest-1085348611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee7f4a0d-2ea6-4af1-8028-9e9232f45754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:06 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ec61f309-df49-4de5-8cfc-4d6f743561ba tempest-CreateVolumesFromSnapshotTest-1085348611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee7f4a0d-2ea6-4af1-8028-9e9232f45754) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49abc5a7-a5d5-4586-8c83-1cf917a91ade', 'volume_name': 'volume-49abc5a7-a5d5-4586-8c83-1cf917a91ade', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:06 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ec61f309-df49-4de5-8cfc-4d6f743561ba tempest-CreateVolumesFromSnapshotTest-1085348611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a453840-195b-4b82-9074-90317dc88ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:07 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ec61f309-df49-4de5-8cfc-4d6f743561ba tempest-CreateVolumesFromSnapshotTest-1085348611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a453840-195b-4b82-9074-90317dc88ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:07 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ec61f309-df49-4de5-8cfc-4d6f743561ba tempest-CreateVolumesFromSnapshotTest-1085348611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20a78b02-52ab-4b5f-8859-05d553783c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:07 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-ec61f309-df49-4de5-8cfc-4d6f743561ba tempest-CreateVolumesFromSnapshotTest-1085348611 None] Volume 49abc5a7-a5d5-4586-8c83-1cf917a91ade: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49abc5a7-a5d5-4586-8c83-1cf917a91ade', 'volume_size': 1} Jul 08 01:58:07 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-ec61f309-df49-4de5-8cfc-4d6f743561ba tempest-CreateVolumesFromSnapshotTest-1085348611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:58:07 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-ec61f309-df49-4de5-8cfc-4d6f743561ba tempest-CreateVolumesFromSnapshotTest-1085348611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:58:07 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-ec61f309-df49-4de5-8cfc-4d6f743561ba tempest-CreateVolumesFromSnapshotTest-1085348611 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:58:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1315936026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49abc5a7-a5d5-4586-8c83-1cf917a91ade,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6610d2bff4845f39c6f7738e6df4111',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:58:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:58:07Z,use_quota=True,user_id='6864a1cdffa44b608d610dde17fc2d2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:58:07 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-ec61f309-df49-4de5-8cfc-4d6f743561ba tempest-CreateVolumesFromSnapshotTest-1085348611 None] Creating volume 49abc5a7-a5d5-4586-8c83-1cf917a91ade {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:58:07 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-ec61f309-df49-4de5-8cfc-4d6f743561ba tempest-CreateVolumesFromSnapshotTest-1085348611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:58:07 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-ec61f309-df49-4de5-8cfc-4d6f743561ba tempest-CreateVolumesFromSnapshotTest-1085348611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:58:07 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-ec61f309-df49-4de5-8cfc-4d6f743561ba tempest-CreateVolumesFromSnapshotTest-1085348611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:58:07 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-ec61f309-df49-4de5-8cfc-4d6f743561ba tempest-CreateVolumesFromSnapshotTest-1085348611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:58:07 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-ec61f309-df49-4de5-8cfc-4d6f743561ba tempest-CreateVolumesFromSnapshotTest-1085348611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:58:07 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-ec61f309-df49-4de5-8cfc-4d6f743561ba tempest-CreateVolumesFromSnapshotTest-1085348611 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:58:07 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-ec61f309-df49-4de5-8cfc-4d6f743561ba tempest-CreateVolumesFromSnapshotTest-1085348611 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:58:07 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ec61f309-df49-4de5-8cfc-4d6f743561ba tempest-CreateVolumesFromSnapshotTest-1085348611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-49abc5a7-a5d5-4586-8c83-1cf917a91ade 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:07 devstack sudo[102440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-49abc5a7-a5d5-4586-8c83-1cf917a91ade 1073741824 Jul 08 01:58:07 devstack sudo[102440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:07 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a54e9e7-0c1c-483d-9165-15fa859651c9 tempest-VolumesGetTest-1407621467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:58:07 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-3a54e9e7-0c1c-483d-9165-15fa859651c9 tempest-VolumesGetTest-1407621467 None] Flow 'volume_create_manager' (e24c3011-a333-4522-873f-d88a99558949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:58:07 devstack sudo[102438]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:07 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-3a54e9e7-0c1c-483d-9165-15fa859651c9 tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb949a3b-ac44-440c-ae53-357f064d3603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:07 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-241970a8-35a9-4e7d-8b96-973e37a9877a tempest-VolumesGetTest-1407621467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.940s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:07 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-241970a8-35a9-4e7d-8b96-973e37a9877a tempest-VolumesGetTest-1407621467 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:58:07 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-241970a8-35a9-4e7d-8b96-973e37a9877a tempest-VolumesGetTest-1407621467 None] Deleted volume successfully. Jul 08 01:58:07 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-3a54e9e7-0c1c-483d-9165-15fa859651c9 tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb949a3b-ac44-440c-ae53-357f064d3603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:58:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-271182495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4b3a853-ee33-42f8-a52c-d36900ac0d80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb44ecb9700c48c39aa9210cf1e798e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:58:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:58:07Z,use_quota=True,user_id='925ed36452c74af79400cbb0f3a38c86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:07 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-3a54e9e7-0c1c-483d-9165-15fa859651c9 tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (789a8576-4b00-4951-9631-8e54a8594da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:07 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-3a54e9e7-0c1c-483d-9165-15fa859651c9 tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (789a8576-4b00-4951-9631-8e54a8594da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:07 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-3a54e9e7-0c1c-483d-9165-15fa859651c9 tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ecd5661-2978-4ccf-9099-4e37711f3d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:07 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-3a54e9e7-0c1c-483d-9165-15fa859651c9 tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ecd5661-2978-4ccf-9099-4e37711f3d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4b3a853-ee33-42f8-a52c-d36900ac0d80', 'volume_name': 'volume-c4b3a853-ee33-42f8-a52c-d36900ac0d80', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:07 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-3a54e9e7-0c1c-483d-9165-15fa859651c9 tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14eb5ca6-f547-4f44-837a-c38e87a018a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:07 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-3a54e9e7-0c1c-483d-9165-15fa859651c9 tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14eb5ca6-f547-4f44-837a-c38e87a018a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:07 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-3a54e9e7-0c1c-483d-9165-15fa859651c9 tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef1760ec-157b-4d2a-ab7f-ef9ae0587325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:07 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-3a54e9e7-0c1c-483d-9165-15fa859651c9 tempest-VolumesGetTest-1407621467 None] Volume c4b3a853-ee33-42f8-a52c-d36900ac0d80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4b3a853-ee33-42f8-a52c-d36900ac0d80', 'volume_size': 1} Jul 08 01:58:07 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-3a54e9e7-0c1c-483d-9165-15fa859651c9 tempest-VolumesGetTest-1407621467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:58:07 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-241970a8-35a9-4e7d-8b96-973e37a9877a tempest-VolumesGetTest-1407621467 None] Lock "cinder-89e3a823-24dc-43c8-b44c-5cb05633c4ff-delete_volume" released by "delete_volume" :: held 3.226s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:58:08 devstack sudo[102440]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:08 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ec61f309-df49-4de5-8cfc-4d6f743561ba tempest-CreateVolumesFromSnapshotTest-1085348611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-49abc5a7-a5d5-4586-8c83-1cf917a91ade 1073741824" returned: 0 in 1.034s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:08 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ec61f309-df49-4de5-8cfc-4d6f743561ba tempest-CreateVolumesFromSnapshotTest-1085348611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-49abc5a7-a5d5-4586-8c83-1cf917a91ade {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:08 devstack sudo[102447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-49abc5a7-a5d5-4586-8c83-1cf917a91ade Jul 08 01:58:08 devstack sudo[102447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:08 devstack sudo[102447]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:08 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ec61f309-df49-4de5-8cfc-4d6f743561ba tempest-CreateVolumesFromSnapshotTest-1085348611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-49abc5a7-a5d5-4586-8c83-1cf917a91ade" returned: 0 in 0.702s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:08 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-ec61f309-df49-4de5-8cfc-4d6f743561ba tempest-CreateVolumesFromSnapshotTest-1085348611 None] <== create_volume: return (1778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:58:08 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-ec61f309-df49-4de5-8cfc-4d6f743561ba tempest-CreateVolumesFromSnapshotTest-1085348611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.783s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:58:08 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-3a54e9e7-0c1c-483d-9165-15fa859651c9 tempest-VolumesGetTest-1407621467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.336s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:58:08 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-3a54e9e7-0c1c-483d-9165-15fa859651c9 tempest-VolumesGetTest-1407621467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:58:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-271182495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4b3a853-ee33-42f8-a52c-d36900ac0d80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb44ecb9700c48c39aa9210cf1e798e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:58:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:58:07Z,use_quota=True,user_id='925ed36452c74af79400cbb0f3a38c86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:58:08 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-3a54e9e7-0c1c-483d-9165-15fa859651c9 tempest-VolumesGetTest-1407621467 None] Creating volume c4b3a853-ee33-42f8-a52c-d36900ac0d80 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:58:08 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-3a54e9e7-0c1c-483d-9165-15fa859651c9 tempest-VolumesGetTest-1407621467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:58:08 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-3a54e9e7-0c1c-483d-9165-15fa859651c9 tempest-VolumesGetTest-1407621467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:58:08 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-3a54e9e7-0c1c-483d-9165-15fa859651c9 tempest-VolumesGetTest-1407621467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:58:08 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-3a54e9e7-0c1c-483d-9165-15fa859651c9 tempest-VolumesGetTest-1407621467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:58:08 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-3a54e9e7-0c1c-483d-9165-15fa859651c9 tempest-VolumesGetTest-1407621467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:58:08 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-3a54e9e7-0c1c-483d-9165-15fa859651c9 tempest-VolumesGetTest-1407621467 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:58:08 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-3a54e9e7-0c1c-483d-9165-15fa859651c9 tempest-VolumesGetTest-1407621467 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:58:08 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-3a54e9e7-0c1c-483d-9165-15fa859651c9 tempest-VolumesGetTest-1407621467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c4b3a853-ee33-42f8-a52c-d36900ac0d80 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:08 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ec61f309-df49-4de5-8cfc-4d6f743561ba tempest-CreateVolumesFromSnapshotTest-1085348611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20a78b02-52ab-4b5f-8859-05d553783c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49abc5a7-a5d5-4586-8c83-1cf917a91ade', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:08 devstack sudo[102451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c4b3a853-ee33-42f8-a52c-d36900ac0d80 1073741824 Jul 08 01:58:08 devstack sudo[102451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:08 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ec61f309-df49-4de5-8cfc-4d6f743561ba tempest-CreateVolumesFromSnapshotTest-1085348611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d67b3a1-bb86-4e00-b0d8-5a15be171395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:08 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-ec61f309-df49-4de5-8cfc-4d6f743561ba tempest-CreateVolumesFromSnapshotTest-1085348611 None] Volume volume-49abc5a7-a5d5-4586-8c83-1cf917a91ade (49abc5a7-a5d5-4586-8c83-1cf917a91ade): created successfully Jul 08 01:58:08 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ec61f309-df49-4de5-8cfc-4d6f743561ba tempest-CreateVolumesFromSnapshotTest-1085348611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d67b3a1-bb86-4e00-b0d8-5a15be171395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:08 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ec61f309-df49-4de5-8cfc-4d6f743561ba tempest-CreateVolumesFromSnapshotTest-1085348611 None] Flow 'volume_create_manager' (f91188e8-8037-48e2-8b55-0093f4cba812) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:58:08 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-ec61f309-df49-4de5-8cfc-4d6f743561ba tempest-CreateVolumesFromSnapshotTest-1085348611 None] Created volume successfully. Jul 08 01:58:09 devstack sudo[102451]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:09 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-3a54e9e7-0c1c-483d-9165-15fa859651c9 tempest-VolumesGetTest-1407621467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c4b3a853-ee33-42f8-a52c-d36900ac0d80 1073741824" returned: 0 in 1.001s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:09 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-3a54e9e7-0c1c-483d-9165-15fa859651c9 tempest-VolumesGetTest-1407621467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c4b3a853-ee33-42f8-a52c-d36900ac0d80 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:09 devstack sudo[102458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c4b3a853-ee33-42f8-a52c-d36900ac0d80 Jul 08 01:58:09 devstack sudo[102458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:10 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-8dc93952-fb16-442e-ad5d-f28db5dd54a0 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:58:10 devstack sudo[102458]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:10 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-3a54e9e7-0c1c-483d-9165-15fa859651c9 tempest-VolumesGetTest-1407621467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c4b3a853-ee33-42f8-a52c-d36900ac0d80" returned: 0 in 0.687s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:10 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-3a54e9e7-0c1c-483d-9165-15fa859651c9 tempest-VolumesGetTest-1407621467 None] <== create_volume: return (1737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:58:10 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-3a54e9e7-0c1c-483d-9165-15fa859651c9 tempest-VolumesGetTest-1407621467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.740s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:58:10 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-8dc93952-fb16-442e-ad5d-f28db5dd54a0 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.325s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:58:10 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-3a54e9e7-0c1c-483d-9165-15fa859651c9 tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef1760ec-157b-4d2a-ab7f-ef9ae0587325) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4b3a853-ee33-42f8-a52c-d36900ac0d80', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:10 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-3a54e9e7-0c1c-483d-9165-15fa859651c9 tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beb3aaa8-b36e-4bf9-aa3c-e954ed0bedeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:10 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-8dc93952-fb16-442e-ad5d-f28db5dd54a0 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Creating offline snapshot adcdbd33-7af1-4e78-a35a-717312034dc0 of volume 49abc5a7-a5d5-4586-8c83-1cf917a91ade {{(pid=87134) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:58:10 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-3a54e9e7-0c1c-483d-9165-15fa859651c9 tempest-VolumesGetTest-1407621467 None] Volume volume-c4b3a853-ee33-42f8-a52c-d36900ac0d80 (c4b3a853-ee33-42f8-a52c-d36900ac0d80): created successfully Jul 08 01:58:10 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-3a54e9e7-0c1c-483d-9165-15fa859651c9 tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beb3aaa8-b36e-4bf9-aa3c-e954ed0bedeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:10 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-3a54e9e7-0c1c-483d-9165-15fa859651c9 tempest-VolumesGetTest-1407621467 None] Flow 'volume_create_manager' (e24c3011-a333-4522-873f-d88a99558949) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:58:10 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d132905-a726-4326-9318-f0a23c12e3ec]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:58:10 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8dc93952-fb16-442e-ad5d-f28db5dd54a0 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-49abc5a7-a5d5-4586-8c83-1cf917a91ade {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:10 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-3a54e9e7-0c1c-483d-9165-15fa859651c9 tempest-VolumesGetTest-1407621467 None] Created volume successfully. Jul 08 01:58:10 devstack sudo[102462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-49abc5a7-a5d5-4586-8c83-1cf917a91ade Jul 08 01:58:10 devstack sudo[102462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:11 devstack sudo[102462]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:11 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8dc93952-fb16-442e-ad5d-f28db5dd54a0 tempest-CreateVolumesFromSnapshotTest-1085348611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-49abc5a7-a5d5-4586-8c83-1cf917a91ade" returned: 0 in 0.806s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:11 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8dc93952-fb16-442e-ad5d-f28db5dd54a0 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-49abc5a7-a5d5-4586-8c83-1cf917a91ade,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-49abc5a7-a5d5-4586-8c83-1cf917a91ade.adcdbd33-7af1-4e78-a35a-717312034dc0 1G {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:11 devstack sudo[102469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-49abc5a7-a5d5-4586-8c83-1cf917a91ade,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-49abc5a7-a5d5-4586-8c83-1cf917a91ade.adcdbd33-7af1-4e78-a35a-717312034dc0 1G Jul 08 01:58:11 devstack sudo[102469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:12 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-b46309b3-c7c7-47c5-bf9e-26578c4c833f tempest-VolumesGetTest-1407621467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:58:12 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b46309b3-c7c7-47c5-bf9e-26578c4c833f tempest-VolumesGetTest-1407621467 None] Flow 'volume_create_manager' (e75a8383-639f-4d88-b4bf-409d78ebe3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:58:12 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b46309b3-c7c7-47c5-bf9e-26578c4c833f tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dfb2262-0d35-4f0a-8ec1-3ddcf8c03c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:12 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b46309b3-c7c7-47c5-bf9e-26578c4c833f tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dfb2262-0d35-4f0a-8ec1-3ddcf8c03c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:58:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2014276322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d41e3af-3397-43d7-8800-b51828e8b30c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='bb44ecb9700c48c39aa9210cf1e798e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:58:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=c4b3a853-ee33-42f8-a52c-d36900ac0d80,status='creating',terminated_at=None,updated_at=2026-07-07T23:58:12Z,use_quota=True,user_id='925ed36452c74af79400cbb0f3a38c86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:12 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b46309b3-c7c7-47c5-bf9e-26578c4c833f tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb6d6570-1fe3-4c64-bb6f-e5d76229e05c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:12 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b46309b3-c7c7-47c5-bf9e-26578c4c833f tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb6d6570-1fe3-4c64-bb6f-e5d76229e05c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:12 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b46309b3-c7c7-47c5-bf9e-26578c4c833f tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08a64ec9-3a25-4cda-bd65-b8bd5faa70ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:12 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b46309b3-c7c7-47c5-bf9e-26578c4c833f tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08a64ec9-3a25-4cda-bd65-b8bd5faa70ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '8d41e3af-3397-43d7-8800-b51828e8b30c', 'volume_name': 'volume-8d41e3af-3397-43d7-8800-b51828e8b30c', 'volume_size': 1, 'source_volid': 'c4b3a853-ee33-42f8-a52c-d36900ac0d80', 'source_volstatus': 'available'}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:12 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b46309b3-c7c7-47c5-bf9e-26578c4c833f tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0211b177-4fee-450a-b8c6-a9fd005a1ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:12 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b46309b3-c7c7-47c5-bf9e-26578c4c833f tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0211b177-4fee-450a-b8c6-a9fd005a1ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:12 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b46309b3-c7c7-47c5-bf9e-26578c4c833f tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52512975-3e78-4841-ba27-96e22f317b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:12 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-b46309b3-c7c7-47c5-bf9e-26578c4c833f tempest-VolumesGetTest-1407621467 None] Volume 8d41e3af-3397-43d7-8800-b51828e8b30c: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-8d41e3af-3397-43d7-8800-b51828e8b30c', 'volume_size': 1, 'source_volid': 'c4b3a853-ee33-42f8-a52c-d36900ac0d80', 'source_volstatus': 'available'} Jul 08 01:58:12 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b46309b3-c7c7-47c5-bf9e-26578c4c833f tempest-VolumesGetTest-1407621467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:58:12 devstack sudo[102469]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:12 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8dc93952-fb16-442e-ad5d-f28db5dd54a0 tempest-CreateVolumesFromSnapshotTest-1085348611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-49abc5a7-a5d5-4586-8c83-1cf917a91ade,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-49abc5a7-a5d5-4586-8c83-1cf917a91ade.adcdbd33-7af1-4e78-a35a-717312034dc0 1G" returned: 0 in 0.926s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:12 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8dc93952-fb16-442e-ad5d-f28db5dd54a0 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49abc5a7-a5d5-4586-8c83-1cf917a91ade -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-49abc5a7-a5d5-4586-8c83-1cf917a91ade.adcdbd33-7af1-4e78-a35a-717312034dc0 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:12 devstack sudo[102475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49abc5a7-a5d5-4586-8c83-1cf917a91ade -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-49abc5a7-a5d5-4586-8c83-1cf917a91ade.adcdbd33-7af1-4e78-a35a-717312034dc0 Jul 08 01:58:12 devstack sudo[102475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:13 devstack sudo[102475]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8dc93952-fb16-442e-ad5d-f28db5dd54a0 tempest-CreateVolumesFromSnapshotTest-1085348611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49abc5a7-a5d5-4586-8c83-1cf917a91ade -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-49abc5a7-a5d5-4586-8c83-1cf917a91ade.adcdbd33-7af1-4e78-a35a-717312034dc0" returned: 0 in 0.733s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:13 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-8dc93952-fb16-442e-ad5d-f28db5dd54a0 tempest-CreateVolumesFromSnapshotTest-1085348611 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-49abc5a7-a5d5-4586-8c83-1cf917a91ade.adcdbd33-7af1-4e78-a35a-717312034dc0 is being set with open permissions: ugo+rw Jul 08 01:58:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8dc93952-fb16-442e-ad5d-f28db5dd54a0 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-49abc5a7-a5d5-4586-8c83-1cf917a91ade.adcdbd33-7af1-4e78-a35a-717312034dc0 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:13 devstack sudo[102481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-49abc5a7-a5d5-4586-8c83-1cf917a91ade.adcdbd33-7af1-4e78-a35a-717312034dc0 Jul 08 01:58:13 devstack sudo[102481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:13 devstack sudo[102481]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8dc93952-fb16-442e-ad5d-f28db5dd54a0 tempest-CreateVolumesFromSnapshotTest-1085348611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-49abc5a7-a5d5-4586-8c83-1cf917a91ade.adcdbd33-7af1-4e78-a35a-717312034dc0" returned: 0 in 0.670s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8dc93952-fb16-442e-ad5d-f28db5dd54a0 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-49abc5a7-a5d5-4586-8c83-1cf917a91ade.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:13 devstack sudo[102484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-49abc5a7-a5d5-4586-8c83-1cf917a91ade.info Jul 08 01:58:13 devstack sudo[102484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:14 devstack sudo[102484]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:14 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8dc93952-fb16-442e-ad5d-f28db5dd54a0 tempest-CreateVolumesFromSnapshotTest-1085348611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-49abc5a7-a5d5-4586-8c83-1cf917a91ade.info" returned: 0 in 0.774s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:14 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-8dc93952-fb16-442e-ad5d-f28db5dd54a0 tempest-CreateVolumesFromSnapshotTest-1085348611 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-49abc5a7-a5d5-4586-8c83-1cf917a91ade.info is being set with open permissions: ugo+rw Jul 08 01:58:14 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8dc93952-fb16-442e-ad5d-f28db5dd54a0 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-49abc5a7-a5d5-4586-8c83-1cf917a91ade.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:14 devstack sudo[102487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-49abc5a7-a5d5-4586-8c83-1cf917a91ade.info Jul 08 01:58:14 devstack sudo[102487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:15 devstack sudo[102487]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8dc93952-fb16-442e-ad5d-f28db5dd54a0 tempest-CreateVolumesFromSnapshotTest-1085348611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-49abc5a7-a5d5-4586-8c83-1cf917a91ade.info" returned: 0 in 0.732s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-8dc93952-fb16-442e-ad5d-f28db5dd54a0 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.771s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:58:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b46309b3-c7c7-47c5-bf9e-26578c4c833f tempest-VolumesGetTest-1407621467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 3.048s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:58:15 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-b46309b3-c7c7-47c5-bf9e-26578c4c833f tempest-VolumesGetTest-1407621467 None] Cloning volume c4b3a853-ee33-42f8-a52c-d36900ac0d80 to volume 8d41e3af-3397-43d7-8800-b51828e8b30c Jul 08 01:58:15 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-8dc93952-fb16-442e-ad5d-f28db5dd54a0 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Create snapshot completed successfully Jul 08 01:58:15 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-b46309b3-c7c7-47c5-bf9e-26578c4c833f tempest-VolumesGetTest-1407621467 None] Creating offline snapshot d37179f1-aebc-4ec7-a6bb-f31ba602c1c8 of volume c4b3a853-ee33-42f8-a52c-d36900ac0d80 {{(pid=87134) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:58:15 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[2015f7db-f42c-4939-83b2-6902b8cb4bbd]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:58:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b46309b3-c7c7-47c5-bf9e-26578c4c833f tempest-VolumesGetTest-1407621467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c4b3a853-ee33-42f8-a52c-d36900ac0d80 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:15 devstack sudo[102490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c4b3a853-ee33-42f8-a52c-d36900ac0d80 Jul 08 01:58:15 devstack sudo[102490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:16 devstack sudo[102490]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b46309b3-c7c7-47c5-bf9e-26578c4c833f tempest-VolumesGetTest-1407621467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c4b3a853-ee33-42f8-a52c-d36900ac0d80" returned: 0 in 0.914s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b46309b3-c7c7-47c5-bf9e-26578c4c833f tempest-VolumesGetTest-1407621467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c4b3a853-ee33-42f8-a52c-d36900ac0d80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c4b3a853-ee33-42f8-a52c-d36900ac0d80.d37179f1-aebc-4ec7-a6bb-f31ba602c1c8 1G {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:16 devstack sudo[102495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c4b3a853-ee33-42f8-a52c-d36900ac0d80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c4b3a853-ee33-42f8-a52c-d36900ac0d80.d37179f1-aebc-4ec7-a6bb-f31ba602c1c8 1G Jul 08 01:58:16 devstack sudo[102495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:17 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ab08112-c520-4414-b830-4889edcd78a4 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:58:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-7ab08112-c520-4414-b830-4889edcd78a4 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Flow 'volume_create_manager' (641f31f8-5b09-4fd9-883a-a0eaec3a338c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:58:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-7ab08112-c520-4414-b830-4889edcd78a4 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75406d58-27c1-45f8-b774-fbf508b4f8b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-7ab08112-c520-4414-b830-4889edcd78a4 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75406d58-27c1-45f8-b774-fbf508b4f8b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:58:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1381646465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ddaf936-d12e-4a7c-ad13-fbd297bf623f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6610d2bff4845f39c6f7738e6df4111',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:58:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:58:17Z,use_quota=True,user_id='6864a1cdffa44b608d610dde17fc2d2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-7ab08112-c520-4414-b830-4889edcd78a4 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09750b34-f5e0-4671-8a56-9a9647fd3f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-7ab08112-c520-4414-b830-4889edcd78a4 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09750b34-f5e0-4671-8a56-9a9647fd3f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-7ab08112-c520-4414-b830-4889edcd78a4 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbaf49aa-0b95-4c39-ba2f-2515ea6ca7e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-7ab08112-c520-4414-b830-4889edcd78a4 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbaf49aa-0b95-4c39-ba2f-2515ea6ca7e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ddaf936-d12e-4a7c-ad13-fbd297bf623f', 'volume_name': 'volume-9ddaf936-d12e-4a7c-ad13-fbd297bf623f', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-7ab08112-c520-4414-b830-4889edcd78a4 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f368037-43f8-4c97-b5eb-d391b57a7eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-7ab08112-c520-4414-b830-4889edcd78a4 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f368037-43f8-4c97-b5eb-d391b57a7eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-7ab08112-c520-4414-b830-4889edcd78a4 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8892b1f0-af36-461d-8fe2-8fb6a985c115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:17 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-7ab08112-c520-4414-b830-4889edcd78a4 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Volume 9ddaf936-d12e-4a7c-ad13-fbd297bf623f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ddaf936-d12e-4a7c-ad13-fbd297bf623f', 'volume_size': 1} Jul 08 01:58:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7ab08112-c520-4414-b830-4889edcd78a4 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:58:17 devstack sudo[102495]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b46309b3-c7c7-47c5-bf9e-26578c4c833f tempest-VolumesGetTest-1407621467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c4b3a853-ee33-42f8-a52c-d36900ac0d80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c4b3a853-ee33-42f8-a52c-d36900ac0d80.d37179f1-aebc-4ec7-a6bb-f31ba602c1c8 1G" returned: 0 in 1.033s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b46309b3-c7c7-47c5-bf9e-26578c4c833f tempest-VolumesGetTest-1407621467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4b3a853-ee33-42f8-a52c-d36900ac0d80 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c4b3a853-ee33-42f8-a52c-d36900ac0d80.d37179f1-aebc-4ec7-a6bb-f31ba602c1c8 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:17 devstack sudo[102501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4b3a853-ee33-42f8-a52c-d36900ac0d80 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c4b3a853-ee33-42f8-a52c-d36900ac0d80.d37179f1-aebc-4ec7-a6bb-f31ba602c1c8 Jul 08 01:58:17 devstack sudo[102501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:17 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc1898e3-25e6-4a48-9728-bb20c9b6e676 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:58:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-fc1898e3-25e6-4a48-9728-bb20c9b6e676 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Flow 'volume_create_manager' (dbea8f02-5f5c-41ae-85bc-b822afdb62cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:58:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-fc1898e3-25e6-4a48-9728-bb20c9b6e676 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dce1f392-2324-4c1b-9793-41078fa5ecff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-fc1898e3-25e6-4a48-9728-bb20c9b6e676 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dce1f392-2324-4c1b-9793-41078fa5ecff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:58:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1145963627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25082018-c954-41a7-9f73-bd2d2db97725,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6610d2bff4845f39c6f7738e6df4111',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:58:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:58:17Z,use_quota=True,user_id='6864a1cdffa44b608d610dde17fc2d2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-fc1898e3-25e6-4a48-9728-bb20c9b6e676 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b09a5099-60b3-48a7-bcd8-a6632f6d4b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-fc1898e3-25e6-4a48-9728-bb20c9b6e676 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b09a5099-60b3-48a7-bcd8-a6632f6d4b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-fc1898e3-25e6-4a48-9728-bb20c9b6e676 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a30f11db-69bb-4418-b4c3-75436931ebc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-fc1898e3-25e6-4a48-9728-bb20c9b6e676 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a30f11db-69bb-4418-b4c3-75436931ebc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25082018-c954-41a7-9f73-bd2d2db97725', 'volume_name': 'volume-25082018-c954-41a7-9f73-bd2d2db97725', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-fc1898e3-25e6-4a48-9728-bb20c9b6e676 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53adaaf2-3fd9-4924-bcec-73c81c85ecd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-fc1898e3-25e6-4a48-9728-bb20c9b6e676 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53adaaf2-3fd9-4924-bcec-73c81c85ecd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-fc1898e3-25e6-4a48-9728-bb20c9b6e676 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dc77dbd-0ebd-42c6-a7d0-72d7163b1683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:17 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-fc1898e3-25e6-4a48-9728-bb20c9b6e676 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Volume 25082018-c954-41a7-9f73-bd2d2db97725: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25082018-c954-41a7-9f73-bd2d2db97725', 'volume_size': 1} Jul 08 01:58:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-fc1898e3-25e6-4a48-9728-bb20c9b6e676 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:58:17 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9dc3a86-637e-42ce-8951-854556349404 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:58:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f9dc3a86-637e-42ce-8951-854556349404 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Flow 'volume_create_manager' (45f8ddac-c684-4571-820b-a43ccc6fbc9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:58:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f9dc3a86-637e-42ce-8951-854556349404 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35970b2f-8fd6-40cd-b6cd-5a87a99ae8ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f9dc3a86-637e-42ce-8951-854556349404 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35970b2f-8fd6-40cd-b6cd-5a87a99ae8ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:58:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1339109432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcb032b9-77d2-41c8-a545-6344defdf796,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6610d2bff4845f39c6f7738e6df4111',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:58:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:58:18Z,use_quota=True,user_id='6864a1cdffa44b608d610dde17fc2d2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f9dc3a86-637e-42ce-8951-854556349404 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea1d8ccc-0190-4863-931e-4714470247dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f9dc3a86-637e-42ce-8951-854556349404 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea1d8ccc-0190-4863-931e-4714470247dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f9dc3a86-637e-42ce-8951-854556349404 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7520608f-afea-4d82-b8b8-6ea11bcf54b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:18 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f9dc3a86-637e-42ce-8951-854556349404 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7520608f-afea-4d82-b8b8-6ea11bcf54b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcb032b9-77d2-41c8-a545-6344defdf796', 'volume_name': 'volume-dcb032b9-77d2-41c8-a545-6344defdf796', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:18 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f9dc3a86-637e-42ce-8951-854556349404 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c10d093-8799-4ec8-8e57-f299fa7ea097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:18 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f9dc3a86-637e-42ce-8951-854556349404 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c10d093-8799-4ec8-8e57-f299fa7ea097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:18 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f9dc3a86-637e-42ce-8951-854556349404 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04103389-2a7d-4af6-a5ae-56c9292c30d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:18 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-f9dc3a86-637e-42ce-8951-854556349404 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Volume dcb032b9-77d2-41c8-a545-6344defdf796: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcb032b9-77d2-41c8-a545-6344defdf796', 'volume_size': 1} Jul 08 01:58:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-f9dc3a86-637e-42ce-8951-854556349404 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:58:18 devstack sudo[102501]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b46309b3-c7c7-47c5-bf9e-26578c4c833f tempest-VolumesGetTest-1407621467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4b3a853-ee33-42f8-a52c-d36900ac0d80 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c4b3a853-ee33-42f8-a52c-d36900ac0d80.d37179f1-aebc-4ec7-a6bb-f31ba602c1c8" returned: 0 in 0.838s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:18 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-b46309b3-c7c7-47c5-bf9e-26578c4c833f tempest-VolumesGetTest-1407621467 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c4b3a853-ee33-42f8-a52c-d36900ac0d80.d37179f1-aebc-4ec7-a6bb-f31ba602c1c8 is being set with open permissions: ugo+rw Jul 08 01:58:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b46309b3-c7c7-47c5-bf9e-26578c4c833f tempest-VolumesGetTest-1407621467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c4b3a853-ee33-42f8-a52c-d36900ac0d80.d37179f1-aebc-4ec7-a6bb-f31ba602c1c8 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:18 devstack sudo[102508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c4b3a853-ee33-42f8-a52c-d36900ac0d80.d37179f1-aebc-4ec7-a6bb-f31ba602c1c8 Jul 08 01:58:18 devstack sudo[102508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:18 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-cce18583-73e4-4eac-a2f6-6bdddd023765 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:58:18 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-cce18583-73e4-4eac-a2f6-6bdddd023765 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Flow 'volume_create_manager' (d58ba0e7-3a04-4707-a9d7-6d29486c5795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:58:18 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-cce18583-73e4-4eac-a2f6-6bdddd023765 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c448855-546b-48bf-bc72-6df27dd1825e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:18 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-cce18583-73e4-4eac-a2f6-6bdddd023765 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c448855-546b-48bf-bc72-6df27dd1825e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:58:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1504030208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96766693-3b45-4ff9-b6d8-fcbdff16e81c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6610d2bff4845f39c6f7738e6df4111',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:58:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:58:18Z,use_quota=True,user_id='6864a1cdffa44b608d610dde17fc2d2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:18 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-cce18583-73e4-4eac-a2f6-6bdddd023765 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4230e8c2-7ec0-4324-acee-6326240fad37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:18 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-cce18583-73e4-4eac-a2f6-6bdddd023765 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4230e8c2-7ec0-4324-acee-6326240fad37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:18 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-cce18583-73e4-4eac-a2f6-6bdddd023765 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2347eccb-0622-4130-b601-01080da025a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:18 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-cce18583-73e4-4eac-a2f6-6bdddd023765 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2347eccb-0622-4130-b601-01080da025a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96766693-3b45-4ff9-b6d8-fcbdff16e81c', 'volume_name': 'volume-96766693-3b45-4ff9-b6d8-fcbdff16e81c', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:18 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-cce18583-73e4-4eac-a2f6-6bdddd023765 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3afda9c-c823-4437-98ce-f85e9ee8bef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:18 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-cce18583-73e4-4eac-a2f6-6bdddd023765 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3afda9c-c823-4437-98ce-f85e9ee8bef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:18 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-cce18583-73e4-4eac-a2f6-6bdddd023765 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (261b99ec-a973-499f-a2e6-23e0ed66eeed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:18 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-cce18583-73e4-4eac-a2f6-6bdddd023765 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Volume 96766693-3b45-4ff9-b6d8-fcbdff16e81c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96766693-3b45-4ff9-b6d8-fcbdff16e81c', 'volume_size': 1} Jul 08 01:58:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-cce18583-73e4-4eac-a2f6-6bdddd023765 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:58:18 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-93e1e05e-235c-4cf1-96e8-091cb889ebff tempest-CreateVolumesFromSnapshotTest-1085348611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:58:18 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-93e1e05e-235c-4cf1-96e8-091cb889ebff tempest-CreateVolumesFromSnapshotTest-1085348611 None] Flow 'volume_create_manager' (e4408da6-211e-4c4e-b3e4-124b0fb8347e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:58:18 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-93e1e05e-235c-4cf1-96e8-091cb889ebff tempest-CreateVolumesFromSnapshotTest-1085348611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7db5abe3-c46d-4d3e-8bd5-f5eaa4bc61e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:18 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-93e1e05e-235c-4cf1-96e8-091cb889ebff tempest-CreateVolumesFromSnapshotTest-1085348611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7db5abe3-c46d-4d3e-8bd5-f5eaa4bc61e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:58:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2056017146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af94057c-8638-4c43-a555-6681026e332b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6610d2bff4845f39c6f7738e6df4111',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:58:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:58:19Z,use_quota=True,user_id='6864a1cdffa44b608d610dde17fc2d2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:18 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-93e1e05e-235c-4cf1-96e8-091cb889ebff tempest-CreateVolumesFromSnapshotTest-1085348611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7051c79c-2d61-4637-9829-914316ac5025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:18 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-93e1e05e-235c-4cf1-96e8-091cb889ebff tempest-CreateVolumesFromSnapshotTest-1085348611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7051c79c-2d61-4637-9829-914316ac5025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:18 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-93e1e05e-235c-4cf1-96e8-091cb889ebff tempest-CreateVolumesFromSnapshotTest-1085348611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e59be34-84fe-4db6-a395-934229d299e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:18 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-93e1e05e-235c-4cf1-96e8-091cb889ebff tempest-CreateVolumesFromSnapshotTest-1085348611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e59be34-84fe-4db6-a395-934229d299e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af94057c-8638-4c43-a555-6681026e332b', 'volume_name': 'volume-af94057c-8638-4c43-a555-6681026e332b', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:18 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-93e1e05e-235c-4cf1-96e8-091cb889ebff tempest-CreateVolumesFromSnapshotTest-1085348611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aee553ba-3097-4a3f-899d-a6aecbcab3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:18 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-93e1e05e-235c-4cf1-96e8-091cb889ebff tempest-CreateVolumesFromSnapshotTest-1085348611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aee553ba-3097-4a3f-899d-a6aecbcab3c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:18 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-93e1e05e-235c-4cf1-96e8-091cb889ebff tempest-CreateVolumesFromSnapshotTest-1085348611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b657fbb8-3b93-404b-b7cb-54cb78855948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:18 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-93e1e05e-235c-4cf1-96e8-091cb889ebff tempest-CreateVolumesFromSnapshotTest-1085348611 None] Volume af94057c-8638-4c43-a555-6681026e332b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af94057c-8638-4c43-a555-6681026e332b', 'volume_size': 1} Jul 08 01:58:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-93e1e05e-235c-4cf1-96e8-091cb889ebff tempest-CreateVolumesFromSnapshotTest-1085348611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:58:19 devstack sudo[102508]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b46309b3-c7c7-47c5-bf9e-26578c4c833f tempest-VolumesGetTest-1407621467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c4b3a853-ee33-42f8-a52c-d36900ac0d80.d37179f1-aebc-4ec7-a6bb-f31ba602c1c8" returned: 0 in 0.850s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b46309b3-c7c7-47c5-bf9e-26578c4c833f tempest-VolumesGetTest-1407621467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c4b3a853-ee33-42f8-a52c-d36900ac0d80.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:19 devstack sudo[102515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c4b3a853-ee33-42f8-a52c-d36900ac0d80.info Jul 08 01:58:19 devstack sudo[102515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:19 devstack sudo[102515]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b46309b3-c7c7-47c5-bf9e-26578c4c833f tempest-VolumesGetTest-1407621467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c4b3a853-ee33-42f8-a52c-d36900ac0d80.info" returned: 0 in 0.727s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:19 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-b46309b3-c7c7-47c5-bf9e-26578c4c833f tempest-VolumesGetTest-1407621467 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c4b3a853-ee33-42f8-a52c-d36900ac0d80.info is being set with open permissions: ugo+rw Jul 08 01:58:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b46309b3-c7c7-47c5-bf9e-26578c4c833f tempest-VolumesGetTest-1407621467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c4b3a853-ee33-42f8-a52c-d36900ac0d80.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:19 devstack sudo[102518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c4b3a853-ee33-42f8-a52c-d36900ac0d80.info Jul 08 01:58:19 devstack sudo[102518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:20 devstack sudo[102518]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b46309b3-c7c7-47c5-bf9e-26578c4c833f tempest-VolumesGetTest-1407621467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c4b3a853-ee33-42f8-a52c-d36900ac0d80.info" returned: 0 in 0.689s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:20 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-b46309b3-c7c7-47c5-bf9e-26578c4c833f tempest-VolumesGetTest-1407621467 None] Acquiring lock "cinder-quobyte-8d41e3af-3397-43d7-8800-b51828e8b30c" by "_copy_volume_from_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:58:20 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-b46309b3-c7c7-47c5-bf9e-26578c4c833f tempest-VolumesGetTest-1407621467 None] Lock "cinder-quobyte-8d41e3af-3397-43d7-8800-b51828e8b30c" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:58:20 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-b46309b3-c7c7-47c5-bf9e-26578c4c833f tempest-VolumesGetTest-1407621467 None] snapshot: d37179f1-aebc-4ec7-a6bb-f31ba602c1c8, volume: 8d41e3af-3397-43d7-8800-b51828e8b30c, {{(pid=87134) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 01:58:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b46309b3-c7c7-47c5-bf9e-26578c4c833f tempest-VolumesGetTest-1407621467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:58:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b46309b3-c7c7-47c5-bf9e-26578c4c833f tempest-VolumesGetTest-1407621467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:58:20 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-b46309b3-c7c7-47c5-bf9e-26578c4c833f tempest-VolumesGetTest-1407621467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:58:20 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-b46309b3-c7c7-47c5-bf9e-26578c4c833f tempest-VolumesGetTest-1407621467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:58:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b46309b3-c7c7-47c5-bf9e-26578c4c833f tempest-VolumesGetTest-1407621467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:58:20 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb229925-669c-4a1c-9b61-403166510d58]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:58:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b46309b3-c7c7-47c5-bf9e-26578c4c833f tempest-VolumesGetTest-1407621467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c4b3a853-ee33-42f8-a52c-d36900ac0d80.d37179f1-aebc-4ec7-a6bb-f31ba602c1c8 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:20 devstack sudo[102524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c4b3a853-ee33-42f8-a52c-d36900ac0d80.d37179f1-aebc-4ec7-a6bb-f31ba602c1c8 Jul 08 01:58:20 devstack sudo[102524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:20 devstack cinder-volume[87134]: DEBUG oslo_service.periodic_task [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87134) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:58:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:58:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:58:20 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:58:20 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:58:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:58:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:20 devstack sudo[102528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:58:20 devstack sudo[102528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:21 devstack sudo[102524]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b46309b3-c7c7-47c5-bf9e-26578c4c833f tempest-VolumesGetTest-1407621467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c4b3a853-ee33-42f8-a52c-d36900ac0d80.d37179f1-aebc-4ec7-a6bb-f31ba602c1c8" returned: 0 in 0.852s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:21 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-b46309b3-c7c7-47c5-bf9e-26578c4c833f tempest-VolumesGetTest-1407621467 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4b3a853-ee33-42f8-a52c-d36900ac0d80(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:58:21 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-b46309b3-c7c7-47c5-bf9e-26578c4c833f tempest-VolumesGetTest-1407621467 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c4b3a853-ee33-42f8-a52c-d36900ac0d80 {{(pid=87134) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 01:58:21 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-b46309b3-c7c7-47c5-bf9e-26578c4c833f tempest-VolumesGetTest-1407621467 None] Creating direct copy from snapshot {{(pid=87134) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 01:58:21 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a9159a-5426-4632-9095-80d1940f81b6]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:58:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b46309b3-c7c7-47c5-bf9e-26578c4c833f tempest-VolumesGetTest-1407621467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c4b3a853-ee33-42f8-a52c-d36900ac0d80 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:21 devstack sudo[102533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c4b3a853-ee33-42f8-a52c-d36900ac0d80 Jul 08 01:58:21 devstack sudo[102533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:21 devstack sudo[102528]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.727s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:21 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:58:21 devstack cinder-volume[87134]: DEBUG oslo_service.periodic_task [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running periodic task VolumeManager._thread_info {{(pid=87134) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:58:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] thread count: 28 {{(pid=87134) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:58:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] thread info: [<_MainThread(MainThread, started 129378964615296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87134) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:58:22 devstack sudo[102533]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b46309b3-c7c7-47c5-bf9e-26578c4c833f tempest-VolumesGetTest-1407621467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c4b3a853-ee33-42f8-a52c-d36900ac0d80" returned: 0 in 0.852s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:22 devstack cinder-volume[87134]: DEBUG cinder.utils [None req-b46309b3-c7c7-47c5-bf9e-26578c4c833f tempest-VolumesGetTest-1407621467 None] Path /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8d41e3af-3397-43d7-8800-b51828e8b30c not found in is_blk_device check {{(pid=87134) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 01:58:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b46309b3-c7c7-47c5-bf9e-26578c4c833f tempest-VolumesGetTest-1407621467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c4b3a853-ee33-42f8-a52c-d36900ac0d80 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8d41e3af-3397-43d7-8800-b51828e8b30c {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:22 devstack sudo[102540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c4b3a853-ee33-42f8-a52c-d36900ac0d80 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8d41e3af-3397-43d7-8800-b51828e8b30c Jul 08 01:58:22 devstack sudo[102540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:26 devstack cinder-volume[87134]: INFO cinder.volume.manager [req-f841cfe3-1d87-478a-8982-dfe95e7e2401 req-d8538aac-dc6f-4dc9-9e3f-93b268d0122c tempest-TestShelveInstance-426081337 None] Terminate volume connection completed successfully. Jul 08 01:58:26 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [req-f841cfe3-1d87-478a-8982-dfe95e7e2401 req-d8538aac-dc6f-4dc9-9e3f-93b268d0122c tempest-TestShelveInstance-426081337 None] Deleting attachment 6d6b3a82-d1df-4a4e-8cbc-4eaa71bb28d3. {{(pid=87134) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:58:28 devstack sudo[102540]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:28 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b46309b3-c7c7-47c5-bf9e-26578c4c833f tempest-VolumesGetTest-1407621467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c4b3a853-ee33-42f8-a52c-d36900ac0d80 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8d41e3af-3397-43d7-8800-b51828e8b30c" returned: 0 in 6.281s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:28 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[765bf18a-34cb-463f-bae1-4a4562a90b1c]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:58:28 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b46309b3-c7c7-47c5-bf9e-26578c4c833f tempest-VolumesGetTest-1407621467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c4b3a853-ee33-42f8-a52c-d36900ac0d80 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:28 devstack sudo[102575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c4b3a853-ee33-42f8-a52c-d36900ac0d80 Jul 08 01:58:28 devstack sudo[102575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:29 devstack sudo[102575]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b46309b3-c7c7-47c5-bf9e-26578c4c833f tempest-VolumesGetTest-1407621467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c4b3a853-ee33-42f8-a52c-d36900ac0d80" returned: 0 in 1.146s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:29 devstack cinder-volume[87134]: DEBUG cinder.image.image_utils [None req-b46309b3-c7c7-47c5-bf9e-26578c4c833f tempest-VolumesGetTest-1407621467 None] Image conversion details: src /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c4b3a853-ee33-42f8-a52c-d36900ac0d80, size 1024.00 MB, duration 6.28 sec, destination /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8d41e3af-3397-43d7-8800-b51828e8b30c {{(pid=87134) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:58:29 devstack cinder-volume[87134]: INFO cinder.image.image_utils [None req-b46309b3-c7c7-47c5-bf9e-26578c4c833f tempest-VolumesGetTest-1407621467 None] Converted 1024.00 MB image at 163.02 MB/s Jul 08 01:58:29 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-b46309b3-c7c7-47c5-bf9e-26578c4c833f tempest-VolumesGetTest-1407621467 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8d41e3af-3397-43d7-8800-b51828e8b30c is being set with open permissions: ugo+rw Jul 08 01:58:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b46309b3-c7c7-47c5-bf9e-26578c4c833f tempest-VolumesGetTest-1407621467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8d41e3af-3397-43d7-8800-b51828e8b30c {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:29 devstack sudo[102583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8d41e3af-3397-43d7-8800-b51828e8b30c Jul 08 01:58:29 devstack sudo[102583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:30 devstack sudo[102583]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b46309b3-c7c7-47c5-bf9e-26578c4c833f tempest-VolumesGetTest-1407621467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8d41e3af-3397-43d7-8800-b51828e8b30c" returned: 0 in 0.719s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:30 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-b46309b3-c7c7-47c5-bf9e-26578c4c833f tempest-VolumesGetTest-1407621467 None] Lock "cinder-quobyte-8d41e3af-3397-43d7-8800-b51828e8b30c" released by "_copy_volume_from_snapshot" :: held 9.948s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:58:30 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-b46309b3-c7c7-47c5-bf9e-26578c4c833f tempest-VolumesGetTest-1407621467 None] Acquiring lock "cinder-quobyte-d37179f1-aebc-4ec7-a6bb-f31ba602c1c8" by "_delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:58:30 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-b46309b3-c7c7-47c5-bf9e-26578c4c833f tempest-VolumesGetTest-1407621467 None] Lock "cinder-quobyte-d37179f1-aebc-4ec7-a6bb-f31ba602c1c8" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:58:30 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-b46309b3-c7c7-47c5-bf9e-26578c4c833f tempest-VolumesGetTest-1407621467 None] Deleting offline snapshot d37179f1-aebc-4ec7-a6bb-f31ba602c1c8 of volume c4b3a853-ee33-42f8-a52c-d36900ac0d80 {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:58:30 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-b46309b3-c7c7-47c5-bf9e-26578c4c833f tempest-VolumesGetTest-1407621467 None] snapshot_file for this snap is: volume-c4b3a853-ee33-42f8-a52c-d36900ac0d80.d37179f1-aebc-4ec7-a6bb-f31ba602c1c8 {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:58:30 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[d17135c6-765c-486c-b201-479b6557c81b]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:58:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b46309b3-c7c7-47c5-bf9e-26578c4c833f tempest-VolumesGetTest-1407621467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c4b3a853-ee33-42f8-a52c-d36900ac0d80.d37179f1-aebc-4ec7-a6bb-f31ba602c1c8 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:30 devstack sudo[102586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c4b3a853-ee33-42f8-a52c-d36900ac0d80.d37179f1-aebc-4ec7-a6bb-f31ba602c1c8 Jul 08 01:58:30 devstack sudo[102586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-cd57a1de-0bd0-47dc-a174-b1454881289c req-0ea68633-c0a7-4073-99a3-bce230fc4ff8 tempest-TestShelveInstance-426081337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:58:31 devstack sudo[102586]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b46309b3-c7c7-47c5-bf9e-26578c4c833f tempest-VolumesGetTest-1407621467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c4b3a853-ee33-42f8-a52c-d36900ac0d80.d37179f1-aebc-4ec7-a6bb-f31ba602c1c8" returned: 0 in 0.977s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:31 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-b46309b3-c7c7-47c5-bf9e-26578c4c833f tempest-VolumesGetTest-1407621467 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4b3a853-ee33-42f8-a52c-d36900ac0d80(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:58:31 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c3fd655-9375-4ebe-a2bd-4eb0486ba644]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:58:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b46309b3-c7c7-47c5-bf9e-26578c4c833f tempest-VolumesGetTest-1407621467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c4b3a853-ee33-42f8-a52c-d36900ac0d80 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:31 devstack sudo[102641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c4b3a853-ee33-42f8-a52c-d36900ac0d80 Jul 08 01:58:31 devstack sudo[102641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:32 devstack sudo[102641]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b46309b3-c7c7-47c5-bf9e-26578c4c833f tempest-VolumesGetTest-1407621467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c4b3a853-ee33-42f8-a52c-d36900ac0d80" returned: 0 in 0.804s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b46309b3-c7c7-47c5-bf9e-26578c4c833f tempest-VolumesGetTest-1407621467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c4b3a853-ee33-42f8-a52c-d36900ac0d80.d37179f1-aebc-4ec7-a6bb-f31ba602c1c8 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:32 devstack sudo[102646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c4b3a853-ee33-42f8-a52c-d36900ac0d80.d37179f1-aebc-4ec7-a6bb-f31ba602c1c8 Jul 08 01:58:32 devstack sudo[102646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:33 devstack sudo[102646]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b46309b3-c7c7-47c5-bf9e-26578c4c833f tempest-VolumesGetTest-1407621467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c4b3a853-ee33-42f8-a52c-d36900ac0d80.d37179f1-aebc-4ec7-a6bb-f31ba602c1c8" returned: 0 in 0.881s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b46309b3-c7c7-47c5-bf9e-26578c4c833f tempest-VolumesGetTest-1407621467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c4b3a853-ee33-42f8-a52c-d36900ac0d80.d37179f1-aebc-4ec7-a6bb-f31ba602c1c8 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:33 devstack sudo[102652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c4b3a853-ee33-42f8-a52c-d36900ac0d80.d37179f1-aebc-4ec7-a6bb-f31ba602c1c8 Jul 08 01:58:33 devstack sudo[102652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:33 devstack sudo[102652]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b46309b3-c7c7-47c5-bf9e-26578c4c833f tempest-VolumesGetTest-1407621467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c4b3a853-ee33-42f8-a52c-d36900ac0d80.d37179f1-aebc-4ec7-a6bb-f31ba602c1c8" returned: 0 in 0.705s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:33 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-b46309b3-c7c7-47c5-bf9e-26578c4c833f tempest-VolumesGetTest-1407621467 None] Lock "cinder-quobyte-d37179f1-aebc-4ec7-a6bb-f31ba602c1c8" released by "_delete_snapshot" :: held 3.459s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:58:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b46309b3-c7c7-47c5-bf9e-26578c4c833f tempest-VolumesGetTest-1407621467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.702s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:58:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7ab08112-c520-4414-b830-4889edcd78a4 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.718s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:58:34 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-7ab08112-c520-4414-b830-4889edcd78a4 tempest-CreateVolumesFromSnapshotTest-1085348611 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:58:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1381646465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ddaf936-d12e-4a7c-ad13-fbd297bf623f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6610d2bff4845f39c6f7738e6df4111',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:58:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:58:17Z,use_quota=True,user_id='6864a1cdffa44b608d610dde17fc2d2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:58:34 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-7ab08112-c520-4414-b830-4889edcd78a4 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Creating volume 9ddaf936-d12e-4a7c-ad13-fbd297bf623f {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:58:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7ab08112-c520-4414-b830-4889edcd78a4 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:58:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7ab08112-c520-4414-b830-4889edcd78a4 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:58:34 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-7ab08112-c520-4414-b830-4889edcd78a4 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:58:34 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-7ab08112-c520-4414-b830-4889edcd78a4 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:58:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7ab08112-c520-4414-b830-4889edcd78a4 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:58:34 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-7ab08112-c520-4414-b830-4889edcd78a4 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:58:34 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-7ab08112-c520-4414-b830-4889edcd78a4 tempest-CreateVolumesFromSnapshotTest-1085348611 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:58:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7ab08112-c520-4414-b830-4889edcd78a4 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9ddaf936-d12e-4a7c-ad13-fbd297bf623f 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:34 devstack sudo[102655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9ddaf936-d12e-4a7c-ad13-fbd297bf623f 1073741824 Jul 08 01:58:34 devstack sudo[102655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:34 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b46309b3-c7c7-47c5-bf9e-26578c4c833f tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52512975-3e78-4841-ba27-96e22f317b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d41e3af-3397-43d7-8800-b51828e8b30c', 'volume_size': 1, 'source_volid': 'c4b3a853-ee33-42f8-a52c-d36900ac0d80', 'source_volstatus': 'available'}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:34 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b46309b3-c7c7-47c5-bf9e-26578c4c833f tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f676c2e2-a9a2-4d57-98af-5805cffd07eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:34 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-b46309b3-c7c7-47c5-bf9e-26578c4c833f tempest-VolumesGetTest-1407621467 None] Volume volume-8d41e3af-3397-43d7-8800-b51828e8b30c (8d41e3af-3397-43d7-8800-b51828e8b30c): created successfully Jul 08 01:58:34 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b46309b3-c7c7-47c5-bf9e-26578c4c833f tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f676c2e2-a9a2-4d57-98af-5805cffd07eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:34 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b46309b3-c7c7-47c5-bf9e-26578c4c833f tempest-VolumesGetTest-1407621467 None] Flow 'volume_create_manager' (e75a8383-639f-4d88-b4bf-409d78ebe3fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:58:34 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-b46309b3-c7c7-47c5-bf9e-26578c4c833f tempest-VolumesGetTest-1407621467 None] Created volume successfully. Jul 08 01:58:34 devstack sudo[102655]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7ab08112-c520-4414-b830-4889edcd78a4 tempest-CreateVolumesFromSnapshotTest-1085348611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9ddaf936-d12e-4a7c-ad13-fbd297bf623f 1073741824" returned: 0 in 0.861s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7ab08112-c520-4414-b830-4889edcd78a4 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9ddaf936-d12e-4a7c-ad13-fbd297bf623f {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:34 devstack sudo[102661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9ddaf936-d12e-4a7c-ad13-fbd297bf623f Jul 08 01:58:34 devstack sudo[102661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:35 devstack sudo[102661]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7ab08112-c520-4414-b830-4889edcd78a4 tempest-CreateVolumesFromSnapshotTest-1085348611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9ddaf936-d12e-4a7c-ad13-fbd297bf623f" returned: 0 in 0.776s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:35 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-7ab08112-c520-4414-b830-4889edcd78a4 tempest-CreateVolumesFromSnapshotTest-1085348611 None] <== create_volume: return (1681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:58:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7ab08112-c520-4414-b830-4889edcd78a4 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.684s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:58:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-fc1898e3-25e6-4a48-9728-bb20c9b6e676 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.116s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:58:35 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-fc1898e3-25e6-4a48-9728-bb20c9b6e676 tempest-CreateVolumesFromSnapshotTest-1085348611 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:58:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1145963627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25082018-c954-41a7-9f73-bd2d2db97725,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6610d2bff4845f39c6f7738e6df4111',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:58:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:58:17Z,use_quota=True,user_id='6864a1cdffa44b608d610dde17fc2d2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:58:35 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-fc1898e3-25e6-4a48-9728-bb20c9b6e676 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Creating volume 25082018-c954-41a7-9f73-bd2d2db97725 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:58:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-fc1898e3-25e6-4a48-9728-bb20c9b6e676 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:58:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-fc1898e3-25e6-4a48-9728-bb20c9b6e676 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:58:35 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-fc1898e3-25e6-4a48-9728-bb20c9b6e676 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:58:35 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-fc1898e3-25e6-4a48-9728-bb20c9b6e676 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:58:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-fc1898e3-25e6-4a48-9728-bb20c9b6e676 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:58:35 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-fc1898e3-25e6-4a48-9728-bb20c9b6e676 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:58:35 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-fc1898e3-25e6-4a48-9728-bb20c9b6e676 tempest-CreateVolumesFromSnapshotTest-1085348611 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:58:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-fc1898e3-25e6-4a48-9728-bb20c9b6e676 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-25082018-c954-41a7-9f73-bd2d2db97725 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:35 devstack sudo[102664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-25082018-c954-41a7-9f73-bd2d2db97725 1073741824 Jul 08 01:58:35 devstack sudo[102664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:35 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-7ab08112-c520-4414-b830-4889edcd78a4 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8892b1f0-af36-461d-8fe2-8fb6a985c115) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ddaf936-d12e-4a7c-ad13-fbd297bf623f', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:35 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-7ab08112-c520-4414-b830-4889edcd78a4 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7260dfa-a221-4bac-a256-df07107e7be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:35 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-7ab08112-c520-4414-b830-4889edcd78a4 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Volume volume-9ddaf936-d12e-4a7c-ad13-fbd297bf623f (9ddaf936-d12e-4a7c-ad13-fbd297bf623f): created successfully Jul 08 01:58:35 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-7ab08112-c520-4414-b830-4889edcd78a4 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7260dfa-a221-4bac-a256-df07107e7be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:35 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-7ab08112-c520-4414-b830-4889edcd78a4 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Flow 'volume_create_manager' (641f31f8-5b09-4fd9-883a-a0eaec3a338c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:58:35 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-7ab08112-c520-4414-b830-4889edcd78a4 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Created volume successfully. Jul 08 01:58:35 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f420b61-1e5f-4207-9a17-1c4fb74652a9 tempest-VolumesGetTest-1407621467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:58:35 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8f420b61-1e5f-4207-9a17-1c4fb74652a9 tempest-VolumesGetTest-1407621467 None] Flow 'volume_create_manager' (d5c20174-d382-4060-98e2-bbf23f166f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:58:35 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8f420b61-1e5f-4207-9a17-1c4fb74652a9 tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e30f2f58-c0da-43bf-b968-c35463d897c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:36 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8f420b61-1e5f-4207-9a17-1c4fb74652a9 tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e30f2f58-c0da-43bf-b968-c35463d897c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:58:36Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-727069013',display_name='tempest-VolumesGetTest-Volume-945095781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5bc7223-b35d-45fa-898c-05e552950206,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb44ecb9700c48c39aa9210cf1e798e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:58:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:58:36Z,use_quota=True,user_id='925ed36452c74af79400cbb0f3a38c86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:36 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8f420b61-1e5f-4207-9a17-1c4fb74652a9 tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b776f7ec-ce5a-49d7-b46b-20cb98a584da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:36 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8f420b61-1e5f-4207-9a17-1c4fb74652a9 tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b776f7ec-ce5a-49d7-b46b-20cb98a584da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:36 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8f420b61-1e5f-4207-9a17-1c4fb74652a9 tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f08c2ddd-a4d3-4655-ac0b-e21b853b4fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:36 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8f420b61-1e5f-4207-9a17-1c4fb74652a9 tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f08c2ddd-a4d3-4655-ac0b-e21b853b4fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5bc7223-b35d-45fa-898c-05e552950206', 'volume_name': 'volume-f5bc7223-b35d-45fa-898c-05e552950206', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:36 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8f420b61-1e5f-4207-9a17-1c4fb74652a9 tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3cf275e-e35b-470c-bf32-f61e8da5b92d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:36 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8f420b61-1e5f-4207-9a17-1c4fb74652a9 tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3cf275e-e35b-470c-bf32-f61e8da5b92d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:36 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8f420b61-1e5f-4207-9a17-1c4fb74652a9 tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f03be779-77f9-42a9-8659-a7d3ff477e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:36 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-8f420b61-1e5f-4207-9a17-1c4fb74652a9 tempest-VolumesGetTest-1407621467 None] Volume f5bc7223-b35d-45fa-898c-05e552950206: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5bc7223-b35d-45fa-898c-05e552950206', 'volume_size': 1} Jul 08 01:58:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-8f420b61-1e5f-4207-9a17-1c4fb74652a9 tempest-VolumesGetTest-1407621467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:58:36 devstack sudo[102664]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-fc1898e3-25e6-4a48-9728-bb20c9b6e676 tempest-CreateVolumesFromSnapshotTest-1085348611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-25082018-c954-41a7-9f73-bd2d2db97725 1073741824" returned: 0 in 0.934s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-fc1898e3-25e6-4a48-9728-bb20c9b6e676 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-25082018-c954-41a7-9f73-bd2d2db97725 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:36 devstack sudo[102670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-25082018-c954-41a7-9f73-bd2d2db97725 Jul 08 01:58:36 devstack sudo[102670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:37 devstack sudo[102670]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-fc1898e3-25e6-4a48-9728-bb20c9b6e676 tempest-CreateVolumesFromSnapshotTest-1085348611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-25082018-c954-41a7-9f73-bd2d2db97725" returned: 0 in 0.661s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:37 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-fc1898e3-25e6-4a48-9728-bb20c9b6e676 tempest-CreateVolumesFromSnapshotTest-1085348611 None] <== create_volume: return (1641ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:58:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-fc1898e3-25e6-4a48-9728-bb20c9b6e676 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.644s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:58:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-f9dc3a86-637e-42ce-8951-854556349404 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.342s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:58:37 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-f9dc3a86-637e-42ce-8951-854556349404 tempest-CreateVolumesFromSnapshotTest-1085348611 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:58:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1339109432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcb032b9-77d2-41c8-a545-6344defdf796,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6610d2bff4845f39c6f7738e6df4111',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:58:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:58:18Z,use_quota=True,user_id='6864a1cdffa44b608d610dde17fc2d2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:58:37 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-f9dc3a86-637e-42ce-8951-854556349404 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Creating volume dcb032b9-77d2-41c8-a545-6344defdf796 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:58:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-f9dc3a86-637e-42ce-8951-854556349404 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:58:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-f9dc3a86-637e-42ce-8951-854556349404 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:58:37 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-f9dc3a86-637e-42ce-8951-854556349404 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:58:37 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-f9dc3a86-637e-42ce-8951-854556349404 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:58:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-f9dc3a86-637e-42ce-8951-854556349404 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:58:37 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-f9dc3a86-637e-42ce-8951-854556349404 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:58:37 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-f9dc3a86-637e-42ce-8951-854556349404 tempest-CreateVolumesFromSnapshotTest-1085348611 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:58:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f9dc3a86-637e-42ce-8951-854556349404 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-dcb032b9-77d2-41c8-a545-6344defdf796 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:37 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-fc1898e3-25e6-4a48-9728-bb20c9b6e676 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dc77dbd-0ebd-42c6-a7d0-72d7163b1683) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25082018-c954-41a7-9f73-bd2d2db97725', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:37 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-fc1898e3-25e6-4a48-9728-bb20c9b6e676 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7506ac5c-a904-4208-af27-c31baedff16b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:37 devstack sudo[102673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-dcb032b9-77d2-41c8-a545-6344defdf796 1073741824 Jul 08 01:58:37 devstack sudo[102673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:37 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-fc1898e3-25e6-4a48-9728-bb20c9b6e676 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Volume volume-25082018-c954-41a7-9f73-bd2d2db97725 (25082018-c954-41a7-9f73-bd2d2db97725): created successfully Jul 08 01:58:37 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-fc1898e3-25e6-4a48-9728-bb20c9b6e676 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7506ac5c-a904-4208-af27-c31baedff16b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:37 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-fc1898e3-25e6-4a48-9728-bb20c9b6e676 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Flow 'volume_create_manager' (dbea8f02-5f5c-41ae-85bc-b822afdb62cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:58:37 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-fc1898e3-25e6-4a48-9728-bb20c9b6e676 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Created volume successfully. Jul 08 01:58:38 devstack sudo[102673]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f9dc3a86-637e-42ce-8951-854556349404 tempest-CreateVolumesFromSnapshotTest-1085348611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-dcb032b9-77d2-41c8-a545-6344defdf796 1073741824" returned: 0 in 0.896s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f9dc3a86-637e-42ce-8951-854556349404 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-dcb032b9-77d2-41c8-a545-6344defdf796 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:38 devstack sudo[102678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-dcb032b9-77d2-41c8-a545-6344defdf796 Jul 08 01:58:38 devstack sudo[102678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:38 devstack sudo[102678]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f9dc3a86-637e-42ce-8951-854556349404 tempest-CreateVolumesFromSnapshotTest-1085348611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-dcb032b9-77d2-41c8-a545-6344defdf796" returned: 0 in 0.697s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:38 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-f9dc3a86-637e-42ce-8951-854556349404 tempest-CreateVolumesFromSnapshotTest-1085348611 None] <== create_volume: return (1634ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:58:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-f9dc3a86-637e-42ce-8951-854556349404 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.638s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:58:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-cce18583-73e4-4eac-a2f6-6bdddd023765 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.567s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:58:39 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-cce18583-73e4-4eac-a2f6-6bdddd023765 tempest-CreateVolumesFromSnapshotTest-1085348611 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:58:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1504030208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96766693-3b45-4ff9-b6d8-fcbdff16e81c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6610d2bff4845f39c6f7738e6df4111',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:58:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:58:18Z,use_quota=True,user_id='6864a1cdffa44b608d610dde17fc2d2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:58:39 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-cce18583-73e4-4eac-a2f6-6bdddd023765 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Creating volume 96766693-3b45-4ff9-b6d8-fcbdff16e81c {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:58:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-cce18583-73e4-4eac-a2f6-6bdddd023765 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:58:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-cce18583-73e4-4eac-a2f6-6bdddd023765 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:58:39 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-cce18583-73e4-4eac-a2f6-6bdddd023765 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:58:39 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-cce18583-73e4-4eac-a2f6-6bdddd023765 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:58:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-cce18583-73e4-4eac-a2f6-6bdddd023765 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:58:39 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-cce18583-73e4-4eac-a2f6-6bdddd023765 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:58:39 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-cce18583-73e4-4eac-a2f6-6bdddd023765 tempest-CreateVolumesFromSnapshotTest-1085348611 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:58:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-cce18583-73e4-4eac-a2f6-6bdddd023765 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-96766693-3b45-4ff9-b6d8-fcbdff16e81c 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:39 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f9dc3a86-637e-42ce-8951-854556349404 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04103389-2a7d-4af6-a5ae-56c9292c30d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcb032b9-77d2-41c8-a545-6344defdf796', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:39 devstack sudo[102681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-96766693-3b45-4ff9-b6d8-fcbdff16e81c 1073741824 Jul 08 01:58:39 devstack sudo[102681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:39 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f9dc3a86-637e-42ce-8951-854556349404 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d96935c-e77c-40eb-af01-a56f9ac3d9d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:39 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-f9dc3a86-637e-42ce-8951-854556349404 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Volume volume-dcb032b9-77d2-41c8-a545-6344defdf796 (dcb032b9-77d2-41c8-a545-6344defdf796): created successfully Jul 08 01:58:39 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f9dc3a86-637e-42ce-8951-854556349404 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d96935c-e77c-40eb-af01-a56f9ac3d9d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:39 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f9dc3a86-637e-42ce-8951-854556349404 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Flow 'volume_create_manager' (45f8ddac-c684-4571-820b-a43ccc6fbc9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:58:39 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-f9dc3a86-637e-42ce-8951-854556349404 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Created volume successfully. Jul 08 01:58:39 devstack sudo[102681]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-cce18583-73e4-4eac-a2f6-6bdddd023765 tempest-CreateVolumesFromSnapshotTest-1085348611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-96766693-3b45-4ff9-b6d8-fcbdff16e81c 1073741824" returned: 0 in 0.805s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-cce18583-73e4-4eac-a2f6-6bdddd023765 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-96766693-3b45-4ff9-b6d8-fcbdff16e81c {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:39 devstack sudo[102687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-96766693-3b45-4ff9-b6d8-fcbdff16e81c Jul 08 01:58:39 devstack sudo[102687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:40 devstack sudo[102687]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-cce18583-73e4-4eac-a2f6-6bdddd023765 tempest-CreateVolumesFromSnapshotTest-1085348611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-96766693-3b45-4ff9-b6d8-fcbdff16e81c" returned: 0 in 0.694s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:40 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-cce18583-73e4-4eac-a2f6-6bdddd023765 tempest-CreateVolumesFromSnapshotTest-1085348611 None] <== create_volume: return (1543ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:58:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-cce18583-73e4-4eac-a2f6-6bdddd023765 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.546s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:58:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-93e1e05e-235c-4cf1-96e8-091cb889ebff tempest-CreateVolumesFromSnapshotTest-1085348611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 21.665s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:58:40 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-93e1e05e-235c-4cf1-96e8-091cb889ebff tempest-CreateVolumesFromSnapshotTest-1085348611 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:58:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2056017146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af94057c-8638-4c43-a555-6681026e332b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6610d2bff4845f39c6f7738e6df4111',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:58:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:58:19Z,use_quota=True,user_id='6864a1cdffa44b608d610dde17fc2d2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:58:40 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-93e1e05e-235c-4cf1-96e8-091cb889ebff tempest-CreateVolumesFromSnapshotTest-1085348611 None] Creating volume af94057c-8638-4c43-a555-6681026e332b {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:58:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-93e1e05e-235c-4cf1-96e8-091cb889ebff tempest-CreateVolumesFromSnapshotTest-1085348611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:58:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-93e1e05e-235c-4cf1-96e8-091cb889ebff tempest-CreateVolumesFromSnapshotTest-1085348611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:58:40 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-93e1e05e-235c-4cf1-96e8-091cb889ebff tempest-CreateVolumesFromSnapshotTest-1085348611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:58:40 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-93e1e05e-235c-4cf1-96e8-091cb889ebff tempest-CreateVolumesFromSnapshotTest-1085348611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:58:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-93e1e05e-235c-4cf1-96e8-091cb889ebff tempest-CreateVolumesFromSnapshotTest-1085348611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:58:40 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-93e1e05e-235c-4cf1-96e8-091cb889ebff tempest-CreateVolumesFromSnapshotTest-1085348611 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:58:40 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-93e1e05e-235c-4cf1-96e8-091cb889ebff tempest-CreateVolumesFromSnapshotTest-1085348611 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:58:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-93e1e05e-235c-4cf1-96e8-091cb889ebff tempest-CreateVolumesFromSnapshotTest-1085348611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-af94057c-8638-4c43-a555-6681026e332b 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:40 devstack sudo[102690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-af94057c-8638-4c43-a555-6681026e332b 1073741824 Jul 08 01:58:40 devstack sudo[102690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:40 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-cce18583-73e4-4eac-a2f6-6bdddd023765 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (261b99ec-a973-499f-a2e6-23e0ed66eeed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96766693-3b45-4ff9-b6d8-fcbdff16e81c', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:40 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-cce18583-73e4-4eac-a2f6-6bdddd023765 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d517d0b2-9828-4ab4-8431-5045dcaf5055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:40 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-cce18583-73e4-4eac-a2f6-6bdddd023765 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Volume volume-96766693-3b45-4ff9-b6d8-fcbdff16e81c (96766693-3b45-4ff9-b6d8-fcbdff16e81c): created successfully Jul 08 01:58:40 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-cce18583-73e4-4eac-a2f6-6bdddd023765 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d517d0b2-9828-4ab4-8431-5045dcaf5055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:40 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-cce18583-73e4-4eac-a2f6-6bdddd023765 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Flow 'volume_create_manager' (d58ba0e7-3a04-4707-a9d7-6d29486c5795) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:58:40 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-cce18583-73e4-4eac-a2f6-6bdddd023765 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Created volume successfully. Jul 08 01:58:41 devstack sudo[102690]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-93e1e05e-235c-4cf1-96e8-091cb889ebff tempest-CreateVolumesFromSnapshotTest-1085348611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-af94057c-8638-4c43-a555-6681026e332b 1073741824" returned: 0 in 0.898s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-93e1e05e-235c-4cf1-96e8-091cb889ebff tempest-CreateVolumesFromSnapshotTest-1085348611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-af94057c-8638-4c43-a555-6681026e332b {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:41 devstack sudo[102695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-af94057c-8638-4c43-a555-6681026e332b Jul 08 01:58:41 devstack sudo[102695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:42 devstack sudo[102695]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-93e1e05e-235c-4cf1-96e8-091cb889ebff tempest-CreateVolumesFromSnapshotTest-1085348611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-af94057c-8638-4c43-a555-6681026e332b" returned: 0 in 0.700s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:42 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-93e1e05e-235c-4cf1-96e8-091cb889ebff tempest-CreateVolumesFromSnapshotTest-1085348611 None] <== create_volume: return (1645ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:58:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-93e1e05e-235c-4cf1-96e8-091cb889ebff tempest-CreateVolumesFromSnapshotTest-1085348611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.647s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:58:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-cd57a1de-0bd0-47dc-a174-b1454881289c req-0ea68633-c0a7-4073-99a3-bce230fc4ff8 tempest-TestShelveInstance-426081337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 10.741s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:58:42 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-93e1e05e-235c-4cf1-96e8-091cb889ebff tempest-CreateVolumesFromSnapshotTest-1085348611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b657fbb8-3b93-404b-b7cb-54cb78855948) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af94057c-8638-4c43-a555-6681026e332b', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:42 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-93e1e05e-235c-4cf1-96e8-091cb889ebff tempest-CreateVolumesFromSnapshotTest-1085348611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (642a9c89-b799-4d62-be35-e40666fa31b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:42 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-93e1e05e-235c-4cf1-96e8-091cb889ebff tempest-CreateVolumesFromSnapshotTest-1085348611 None] Volume volume-af94057c-8638-4c43-a555-6681026e332b (af94057c-8638-4c43-a555-6681026e332b): created successfully Jul 08 01:58:42 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-93e1e05e-235c-4cf1-96e8-091cb889ebff tempest-CreateVolumesFromSnapshotTest-1085348611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (642a9c89-b799-4d62-be35-e40666fa31b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:42 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-93e1e05e-235c-4cf1-96e8-091cb889ebff tempest-CreateVolumesFromSnapshotTest-1085348611 None] Flow 'volume_create_manager' (e4408da6-211e-4c4e-b3e4-124b0fb8347e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:58:42 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1d4fed-1cb2-481f-9834-819eb400deef]: (4, 'raw') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:58:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-cd57a1de-0bd0-47dc-a174-b1454881289c req-0ea68633-c0a7-4073-99a3-bce230fc4ff8 tempest-TestShelveInstance-426081337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1d15d46a-ee04-4123-97dc-6f823378d269 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:42 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-93e1e05e-235c-4cf1-96e8-091cb889ebff tempest-CreateVolumesFromSnapshotTest-1085348611 None] Created volume successfully. Jul 08 01:58:42 devstack sudo[102698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1d15d46a-ee04-4123-97dc-6f823378d269 Jul 08 01:58:42 devstack sudo[102698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:42 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-91545bba-b0b2-4c56-8ded-d0ea0e1ba37c tempest-CreateVolumesFromSnapshotTest-1085348611 None] Acquiring lock "cinder-af94057c-8638-4c43-a555-6681026e332b-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:58:42 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-91545bba-b0b2-4c56-8ded-d0ea0e1ba37c tempest-CreateVolumesFromSnapshotTest-1085348611 None] Lock "cinder-af94057c-8638-4c43-a555-6681026e332b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:58:42 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-91545bba-b0b2-4c56-8ded-d0ea0e1ba37c tempest-CreateVolumesFromSnapshotTest-1085348611 None] Acquiring lock "cinder-quobyte-af94057c-8638-4c43-a555-6681026e332b" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:58:43 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-91545bba-b0b2-4c56-8ded-d0ea0e1ba37c tempest-CreateVolumesFromSnapshotTest-1085348611 None] Lock "cinder-quobyte-af94057c-8638-4c43-a555-6681026e332b" acquired by "delete_volume" :: waited 0.022s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:58:43 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd158430-1bf9-49e7-929c-1c6e2354f557]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:58:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-91545bba-b0b2-4c56-8ded-d0ea0e1ba37c tempest-CreateVolumesFromSnapshotTest-1085348611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-af94057c-8638-4c43-a555-6681026e332b {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:43 devstack sudo[102698]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-cd57a1de-0bd0-47dc-a174-b1454881289c req-0ea68633-c0a7-4073-99a3-bce230fc4ff8 tempest-TestShelveInstance-426081337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1d15d46a-ee04-4123-97dc-6f823378d269" returned: 0 in 0.818s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-cd57a1de-0bd0-47dc-a174-b1454881289c req-0ea68633-c0a7-4073-99a3-bce230fc4ff8 tempest-TestShelveInstance-426081337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1d15d46a-ee04-4123-97dc-6f823378d269 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:43 devstack sudo[102703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-af94057c-8638-4c43-a555-6681026e332b Jul 08 01:58:43 devstack sudo[102703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:43 devstack sudo[102704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1d15d46a-ee04-4123-97dc-6f823378d269 Jul 08 01:58:43 devstack sudo[102704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:43 devstack sudo[102704]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-cd57a1de-0bd0-47dc-a174-b1454881289c req-0ea68633-c0a7-4073-99a3-bce230fc4ff8 tempest-TestShelveInstance-426081337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1d15d46a-ee04-4123-97dc-6f823378d269" returned: 1 in 0.831s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-cd57a1de-0bd0-47dc-a174-b1454881289c req-0ea68633-c0a7-4073-99a3-bce230fc4ff8 tempest-TestShelveInstance-426081337 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1d15d46a-ee04-4123-97dc-6f823378d269' failed. Not Retrying. {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:58:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-cd57a1de-0bd0-47dc-a174-b1454881289c req-0ea68633-c0a7-4073-99a3-bce230fc4ff8 tempest-TestShelveInstance-426081337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.705s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:58:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-8f420b61-1e5f-4207-9a17-1c4fb74652a9 tempest-VolumesGetTest-1407621467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.864s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:58:43 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-8f420b61-1e5f-4207-9a17-1c4fb74652a9 tempest-VolumesGetTest-1407621467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:58:36Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-727069013',display_name='tempest-VolumesGetTest-Volume-945095781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5bc7223-b35d-45fa-898c-05e552950206,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb44ecb9700c48c39aa9210cf1e798e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:58:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:58:36Z,use_quota=True,user_id='925ed36452c74af79400cbb0f3a38c86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:58:43 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-8f420b61-1e5f-4207-9a17-1c4fb74652a9 tempest-VolumesGetTest-1407621467 None] Creating volume f5bc7223-b35d-45fa-898c-05e552950206 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:58:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-8f420b61-1e5f-4207-9a17-1c4fb74652a9 tempest-VolumesGetTest-1407621467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:58:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-8f420b61-1e5f-4207-9a17-1c4fb74652a9 tempest-VolumesGetTest-1407621467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:58:43 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-8f420b61-1e5f-4207-9a17-1c4fb74652a9 tempest-VolumesGetTest-1407621467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:58:43 devstack sudo[102703]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:43 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-8f420b61-1e5f-4207-9a17-1c4fb74652a9 tempest-VolumesGetTest-1407621467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:58:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-8f420b61-1e5f-4207-9a17-1c4fb74652a9 tempest-VolumesGetTest-1407621467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:58:43 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-8f420b61-1e5f-4207-9a17-1c4fb74652a9 tempest-VolumesGetTest-1407621467 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:58:43 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-8f420b61-1e5f-4207-9a17-1c4fb74652a9 tempest-VolumesGetTest-1407621467 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:58:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8f420b61-1e5f-4207-9a17-1c4fb74652a9 tempest-VolumesGetTest-1407621467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f5bc7223-b35d-45fa-898c-05e552950206 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-91545bba-b0b2-4c56-8ded-d0ea0e1ba37c tempest-CreateVolumesFromSnapshotTest-1085348611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-af94057c-8638-4c43-a555-6681026e332b" returned: 0 in 0.900s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-91545bba-b0b2-4c56-8ded-d0ea0e1ba37c tempest-CreateVolumesFromSnapshotTest-1085348611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-af94057c-8638-4c43-a555-6681026e332b {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:43 devstack sudo[102713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f5bc7223-b35d-45fa-898c-05e552950206 1073741824 Jul 08 01:58:43 devstack sudo[102713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:43 devstack sudo[102714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-af94057c-8638-4c43-a555-6681026e332b Jul 08 01:58:43 devstack sudo[102714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:44 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [req-cd57a1de-0bd0-47dc-a174-b1454881289c req-0ea68633-c0a7-4073-99a3-bce230fc4ff8 tempest-TestShelveInstance-426081337 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17', 'name': 'volume-1d15d46a-ee04-4123-97dc-6f823378d269', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ebc2e24c-bc7e-4736-877e-d6828d0860b3', 'enforce_multipath': True} {{(pid=87134) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:58:44 devstack cinder-volume[87134]: INFO cinder.volume.manager [req-cd57a1de-0bd0-47dc-a174-b1454881289c req-0ea68633-c0a7-4073-99a3-bce230fc4ff8 tempest-TestShelveInstance-426081337 None] attachment_update completed successfully. Jul 08 01:58:44 devstack sudo[102714]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-91545bba-b0b2-4c56-8ded-d0ea0e1ba37c tempest-CreateVolumesFromSnapshotTest-1085348611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-af94057c-8638-4c43-a555-6681026e332b" returned: 0 in 0.784s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:44 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-91545bba-b0b2-4c56-8ded-d0ea0e1ba37c tempest-CreateVolumesFromSnapshotTest-1085348611 None] Lock "cinder-quobyte-af94057c-8638-4c43-a555-6681026e332b" released by "delete_volume" :: held 1.741s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:58:44 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-91545bba-b0b2-4c56-8ded-d0ea0e1ba37c tempest-CreateVolumesFromSnapshotTest-1085348611 None] Created reservations ['e28a1ce8-dac6-44cf-926b-670b9cfa98de', '7cc6dbbb-aa71-4f48-9cd6-e747503b4f6e', '4256ee20-ff42-424c-8446-f5200c8a7a2c', '570fca9d-1068-4765-95a5-419b1a5c04d7'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:58:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-91545bba-b0b2-4c56-8ded-d0ea0e1ba37c tempest-CreateVolumesFromSnapshotTest-1085348611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:58:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-91545bba-b0b2-4c56-8ded-d0ea0e1ba37c tempest-CreateVolumesFromSnapshotTest-1085348611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:58:44 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-91545bba-b0b2-4c56-8ded-d0ea0e1ba37c tempest-CreateVolumesFromSnapshotTest-1085348611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:58:44 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-91545bba-b0b2-4c56-8ded-d0ea0e1ba37c tempest-CreateVolumesFromSnapshotTest-1085348611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:58:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-91545bba-b0b2-4c56-8ded-d0ea0e1ba37c tempest-CreateVolumesFromSnapshotTest-1085348611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:58:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-91545bba-b0b2-4c56-8ded-d0ea0e1ba37c tempest-CreateVolumesFromSnapshotTest-1085348611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:44 devstack sudo[102713]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8f420b61-1e5f-4207-9a17-1c4fb74652a9 tempest-VolumesGetTest-1407621467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f5bc7223-b35d-45fa-898c-05e552950206 1073741824" returned: 0 in 1.062s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:44 devstack sudo[102721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:58:44 devstack sudo[102721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8f420b61-1e5f-4207-9a17-1c4fb74652a9 tempest-VolumesGetTest-1407621467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f5bc7223-b35d-45fa-898c-05e552950206 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:45 devstack sudo[102723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f5bc7223-b35d-45fa-898c-05e552950206 Jul 08 01:58:45 devstack sudo[102723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:45 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-947b3406-822b-43d9-b7e9-0175af9827fe tempest-CreateVolumesFromSnapshotTest-1085348611 None] Acquiring lock "cinder-96766693-3b45-4ff9-b6d8-fcbdff16e81c-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:58:45 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-947b3406-822b-43d9-b7e9-0175af9827fe tempest-CreateVolumesFromSnapshotTest-1085348611 None] Lock "cinder-96766693-3b45-4ff9-b6d8-fcbdff16e81c-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:58:45 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-947b3406-822b-43d9-b7e9-0175af9827fe tempest-CreateVolumesFromSnapshotTest-1085348611 None] Acquiring lock "cinder-quobyte-96766693-3b45-4ff9-b6d8-fcbdff16e81c" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:58:45 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-947b3406-822b-43d9-b7e9-0175af9827fe tempest-CreateVolumesFromSnapshotTest-1085348611 None] Lock "cinder-quobyte-96766693-3b45-4ff9-b6d8-fcbdff16e81c" acquired by "delete_volume" :: waited 0.029s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:58:45 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2aba245-6708-4f9f-8fd6-77fcd4a5b26d]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:58:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-947b3406-822b-43d9-b7e9-0175af9827fe tempest-CreateVolumesFromSnapshotTest-1085348611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-96766693-3b45-4ff9-b6d8-fcbdff16e81c {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:45 devstack sudo[102725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-96766693-3b45-4ff9-b6d8-fcbdff16e81c Jul 08 01:58:45 devstack sudo[102725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:45 devstack sudo[102721]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-91545bba-b0b2-4c56-8ded-d0ea0e1ba37c tempest-CreateVolumesFromSnapshotTest-1085348611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.930s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:45 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-91545bba-b0b2-4c56-8ded-d0ea0e1ba37c tempest-CreateVolumesFromSnapshotTest-1085348611 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:58:45 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-91545bba-b0b2-4c56-8ded-d0ea0e1ba37c tempest-CreateVolumesFromSnapshotTest-1085348611 None] Deleted volume successfully. Jul 08 01:58:45 devstack sudo[102723]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:45 devstack cinder-volume[87134]: DEBUG dbcounter [-] [87134] Writing DB stats cinder:SELECT=64,cinder:INSERT=19,cinder:UPDATE=81,cinder:DELETE=8 {{(pid=87134) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:58:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8f420b61-1e5f-4207-9a17-1c4fb74652a9 tempest-VolumesGetTest-1407621467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f5bc7223-b35d-45fa-898c-05e552950206" returned: 0 in 0.879s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:45 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-8f420b61-1e5f-4207-9a17-1c4fb74652a9 tempest-VolumesGetTest-1407621467 None] <== create_volume: return (2002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:58:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-8f420b61-1e5f-4207-9a17-1c4fb74652a9 tempest-VolumesGetTest-1407621467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.004s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:58:45 devstack cinder-volume[87134]: DEBUG dbcounter [-] [87134] Writing DB stats cinder:SELECT=68,cinder:INSERT=19,cinder:UPDATE=85,cinder:DELETE=8 {{(pid=87134) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:58:45 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8f420b61-1e5f-4207-9a17-1c4fb74652a9 tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f03be779-77f9-42a9-8659-a7d3ff477e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5bc7223-b35d-45fa-898c-05e552950206', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:45 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8f420b61-1e5f-4207-9a17-1c4fb74652a9 tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87940d6f-ff4a-4c93-9080-f2140f6d88d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:45 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-8f420b61-1e5f-4207-9a17-1c4fb74652a9 tempest-VolumesGetTest-1407621467 None] Volume volume-f5bc7223-b35d-45fa-898c-05e552950206 (f5bc7223-b35d-45fa-898c-05e552950206): created successfully Jul 08 01:58:45 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8f420b61-1e5f-4207-9a17-1c4fb74652a9 tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87940d6f-ff4a-4c93-9080-f2140f6d88d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:46 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8f420b61-1e5f-4207-9a17-1c4fb74652a9 tempest-VolumesGetTest-1407621467 None] Flow 'volume_create_manager' (d5c20174-d382-4060-98e2-bbf23f166f4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:58:46 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-91545bba-b0b2-4c56-8ded-d0ea0e1ba37c tempest-CreateVolumesFromSnapshotTest-1085348611 None] Lock "cinder-af94057c-8638-4c43-a555-6681026e332b-delete_volume" released by "delete_volume" :: held 3.088s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:58:46 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-8f420b61-1e5f-4207-9a17-1c4fb74652a9 tempest-VolumesGetTest-1407621467 None] Created volume successfully. Jul 08 01:58:46 devstack sudo[102725]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-947b3406-822b-43d9-b7e9-0175af9827fe tempest-CreateVolumesFromSnapshotTest-1085348611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-96766693-3b45-4ff9-b6d8-fcbdff16e81c" returned: 0 in 0.845s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-947b3406-822b-43d9-b7e9-0175af9827fe tempest-CreateVolumesFromSnapshotTest-1085348611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-96766693-3b45-4ff9-b6d8-fcbdff16e81c {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:46 devstack sudo[102732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-96766693-3b45-4ff9-b6d8-fcbdff16e81c Jul 08 01:58:46 devstack sudo[102732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:46 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-d4b398c5-96ac-407c-9700-48acc27904de tempest-VolumesGetTest-1407621467 None] Acquiring lock "cinder-f5bc7223-b35d-45fa-898c-05e552950206-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:58:46 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-d4b398c5-96ac-407c-9700-48acc27904de tempest-VolumesGetTest-1407621467 None] Lock "cinder-f5bc7223-b35d-45fa-898c-05e552950206-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:58:46 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-d4b398c5-96ac-407c-9700-48acc27904de tempest-VolumesGetTest-1407621467 None] Acquiring lock "cinder-quobyte-f5bc7223-b35d-45fa-898c-05e552950206" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:58:46 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-d4b398c5-96ac-407c-9700-48acc27904de tempest-VolumesGetTest-1407621467 None] Lock "cinder-quobyte-f5bc7223-b35d-45fa-898c-05e552950206" acquired by "delete_volume" :: waited 0.016s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:58:46 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[a83db4c9-8901-44e3-8093-35276135bd63]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:58:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d4b398c5-96ac-407c-9700-48acc27904de tempest-VolumesGetTest-1407621467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f5bc7223-b35d-45fa-898c-05e552950206 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:47 devstack sudo[102734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f5bc7223-b35d-45fa-898c-05e552950206 Jul 08 01:58:47 devstack sudo[102734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:47 devstack sudo[102732]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-947b3406-822b-43d9-b7e9-0175af9827fe tempest-CreateVolumesFromSnapshotTest-1085348611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-96766693-3b45-4ff9-b6d8-fcbdff16e81c" returned: 0 in 0.768s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:47 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-947b3406-822b-43d9-b7e9-0175af9827fe tempest-CreateVolumesFromSnapshotTest-1085348611 None] Lock "cinder-quobyte-96766693-3b45-4ff9-b6d8-fcbdff16e81c" released by "delete_volume" :: held 1.676s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:58:47 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-947b3406-822b-43d9-b7e9-0175af9827fe tempest-CreateVolumesFromSnapshotTest-1085348611 None] Created reservations ['e8afe29d-5189-4821-aae6-5bce91a0793c', '16172c14-46fb-411e-9f50-904b33e92b29', 'fae0ca79-e8c2-4651-a5b7-3b467da29f46', 'bf6a9d4c-5675-4368-87d4-4ae754649b88'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:58:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-947b3406-822b-43d9-b7e9-0175af9827fe tempest-CreateVolumesFromSnapshotTest-1085348611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:58:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-947b3406-822b-43d9-b7e9-0175af9827fe tempest-CreateVolumesFromSnapshotTest-1085348611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:58:47 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-947b3406-822b-43d9-b7e9-0175af9827fe tempest-CreateVolumesFromSnapshotTest-1085348611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:58:47 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-947b3406-822b-43d9-b7e9-0175af9827fe tempest-CreateVolumesFromSnapshotTest-1085348611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:58:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-947b3406-822b-43d9-b7e9-0175af9827fe tempest-CreateVolumesFromSnapshotTest-1085348611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:58:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-947b3406-822b-43d9-b7e9-0175af9827fe tempest-CreateVolumesFromSnapshotTest-1085348611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:47 devstack sudo[102737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:58:47 devstack sudo[102737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:47 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-e479d615-24d9-4b47-bb55-11ee0cb896e3 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Acquiring lock "cinder-dcb032b9-77d2-41c8-a545-6344defdf796-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:58:47 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-e479d615-24d9-4b47-bb55-11ee0cb896e3 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Lock "cinder-dcb032b9-77d2-41c8-a545-6344defdf796-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:58:47 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-e479d615-24d9-4b47-bb55-11ee0cb896e3 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Acquiring lock "cinder-quobyte-dcb032b9-77d2-41c8-a545-6344defdf796" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:58:47 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-e479d615-24d9-4b47-bb55-11ee0cb896e3 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Lock "cinder-quobyte-dcb032b9-77d2-41c8-a545-6344defdf796" acquired by "delete_volume" :: waited 0.022s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:58:47 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d2652a-08e9-408c-bb0e-fbccb9ac1e86]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:58:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e479d615-24d9-4b47-bb55-11ee0cb896e3 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-dcb032b9-77d2-41c8-a545-6344defdf796 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:47 devstack sudo[102742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-dcb032b9-77d2-41c8-a545-6344defdf796 Jul 08 01:58:47 devstack sudo[102742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:47 devstack sudo[102734]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d4b398c5-96ac-407c-9700-48acc27904de tempest-VolumesGetTest-1407621467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f5bc7223-b35d-45fa-898c-05e552950206" returned: 0 in 0.909s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d4b398c5-96ac-407c-9700-48acc27904de tempest-VolumesGetTest-1407621467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f5bc7223-b35d-45fa-898c-05e552950206 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:47 devstack sudo[102744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f5bc7223-b35d-45fa-898c-05e552950206 Jul 08 01:58:47 devstack sudo[102744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:48 devstack sudo[102737]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-947b3406-822b-43d9-b7e9-0175af9827fe tempest-CreateVolumesFromSnapshotTest-1085348611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.809s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:48 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-947b3406-822b-43d9-b7e9-0175af9827fe tempest-CreateVolumesFromSnapshotTest-1085348611 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:58:48 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-947b3406-822b-43d9-b7e9-0175af9827fe tempest-CreateVolumesFromSnapshotTest-1085348611 None] Deleted volume successfully. Jul 08 01:58:48 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-947b3406-822b-43d9-b7e9-0175af9827fe tempest-CreateVolumesFromSnapshotTest-1085348611 None] Lock "cinder-96766693-3b45-4ff9-b6d8-fcbdff16e81c-delete_volume" released by "delete_volume" :: held 2.773s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:58:48 devstack sudo[102742]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e479d615-24d9-4b47-bb55-11ee0cb896e3 tempest-CreateVolumesFromSnapshotTest-1085348611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-dcb032b9-77d2-41c8-a545-6344defdf796" returned: 0 in 0.855s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e479d615-24d9-4b47-bb55-11ee0cb896e3 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-dcb032b9-77d2-41c8-a545-6344defdf796 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:48 devstack sudo[102744]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d4b398c5-96ac-407c-9700-48acc27904de tempest-VolumesGetTest-1407621467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f5bc7223-b35d-45fa-898c-05e552950206" returned: 0 in 0.727s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:48 devstack sudo[102751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-dcb032b9-77d2-41c8-a545-6344defdf796 Jul 08 01:58:48 devstack sudo[102751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:48 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-d4b398c5-96ac-407c-9700-48acc27904de tempest-VolumesGetTest-1407621467 None] Lock "cinder-quobyte-f5bc7223-b35d-45fa-898c-05e552950206" released by "delete_volume" :: held 1.695s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:58:48 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-d4b398c5-96ac-407c-9700-48acc27904de tempest-VolumesGetTest-1407621467 None] Created reservations ['257c07d5-aa67-41bc-bf15-0a45f111d41f', '55d2f6ea-0697-4fc1-9f3f-c305e2c44623', '8055e349-9e2a-415c-a649-2aab8ec3444e', '944fc5b8-eeb6-4a76-afcd-17ef714542c5'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:58:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-d4b398c5-96ac-407c-9700-48acc27904de tempest-VolumesGetTest-1407621467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:58:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-d4b398c5-96ac-407c-9700-48acc27904de tempest-VolumesGetTest-1407621467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:58:48 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-d4b398c5-96ac-407c-9700-48acc27904de tempest-VolumesGetTest-1407621467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:58:48 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-d4b398c5-96ac-407c-9700-48acc27904de tempest-VolumesGetTest-1407621467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:58:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-d4b398c5-96ac-407c-9700-48acc27904de tempest-VolumesGetTest-1407621467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:58:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d4b398c5-96ac-407c-9700-48acc27904de tempest-VolumesGetTest-1407621467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:48 devstack sudo[102753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:58:48 devstack sudo[102753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:49 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-fd407ed5-5116-4f61-affa-8b77dfbc51ab tempest-VolumesGetTest-1407621467 None] Acquiring lock "cinder-8d41e3af-3397-43d7-8800-b51828e8b30c-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:58:49 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-fd407ed5-5116-4f61-affa-8b77dfbc51ab tempest-VolumesGetTest-1407621467 None] Lock "cinder-8d41e3af-3397-43d7-8800-b51828e8b30c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:58:49 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-fd407ed5-5116-4f61-affa-8b77dfbc51ab tempest-VolumesGetTest-1407621467 None] Acquiring lock "cinder-quobyte-8d41e3af-3397-43d7-8800-b51828e8b30c" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:58:49 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-fd407ed5-5116-4f61-affa-8b77dfbc51ab tempest-VolumesGetTest-1407621467 None] Lock "cinder-quobyte-8d41e3af-3397-43d7-8800-b51828e8b30c" acquired by "delete_volume" :: waited 0.031s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:58:49 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7f55a7-d6f4-4d83-9421-4312e8ccf0c1]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:58:49 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-fd407ed5-5116-4f61-affa-8b77dfbc51ab tempest-VolumesGetTest-1407621467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8d41e3af-3397-43d7-8800-b51828e8b30c {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:49 devstack sudo[102751]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:49 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e479d615-24d9-4b47-bb55-11ee0cb896e3 tempest-CreateVolumesFromSnapshotTest-1085348611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-dcb032b9-77d2-41c8-a545-6344defdf796" returned: 0 in 0.815s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:49 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-e479d615-24d9-4b47-bb55-11ee0cb896e3 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Lock "cinder-quobyte-dcb032b9-77d2-41c8-a545-6344defdf796" released by "delete_volume" :: held 1.723s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:58:49 devstack sudo[102756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8d41e3af-3397-43d7-8800-b51828e8b30c Jul 08 01:58:49 devstack sudo[102756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:49 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-e479d615-24d9-4b47-bb55-11ee0cb896e3 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Created reservations ['2ce25bb7-508c-4c10-bd0b-25b489b005a5', 'bf9ca3ad-ac71-4e70-b0da-a9d1213f2f34', '2f9ea08f-00c5-4fa5-962c-04b32372ab3d', '669226c2-3304-4b2f-a740-af34ea40e12c'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:58:49 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e479d615-24d9-4b47-bb55-11ee0cb896e3 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:58:49 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e479d615-24d9-4b47-bb55-11ee0cb896e3 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:58:49 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-e479d615-24d9-4b47-bb55-11ee0cb896e3 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:58:49 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-e479d615-24d9-4b47-bb55-11ee0cb896e3 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:58:49 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e479d615-24d9-4b47-bb55-11ee0cb896e3 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:58:49 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e479d615-24d9-4b47-bb55-11ee0cb896e3 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:49 devstack sudo[102759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:58:49 devstack sudo[102759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:49 devstack sudo[102753]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:49 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d4b398c5-96ac-407c-9700-48acc27904de tempest-VolumesGetTest-1407621467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.907s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:49 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-d4b398c5-96ac-407c-9700-48acc27904de tempest-VolumesGetTest-1407621467 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:58:49 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-d4b398c5-96ac-407c-9700-48acc27904de tempest-VolumesGetTest-1407621467 None] Deleted volume successfully. Jul 08 01:58:49 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-d4b398c5-96ac-407c-9700-48acc27904de tempest-VolumesGetTest-1407621467 None] Lock "cinder-f5bc7223-b35d-45fa-898c-05e552950206-delete_volume" released by "delete_volume" :: held 2.858s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:58:49 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-21557eac-18e6-4666-a316-850fa8a8a183 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Acquiring lock "cinder-25082018-c954-41a7-9f73-bd2d2db97725-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:58:49 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-21557eac-18e6-4666-a316-850fa8a8a183 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Lock "cinder-25082018-c954-41a7-9f73-bd2d2db97725-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:58:50 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-21557eac-18e6-4666-a316-850fa8a8a183 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Acquiring lock "cinder-quobyte-25082018-c954-41a7-9f73-bd2d2db97725" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:58:50 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-21557eac-18e6-4666-a316-850fa8a8a183 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Lock "cinder-quobyte-25082018-c954-41a7-9f73-bd2d2db97725" acquired by "delete_volume" :: waited 0.021s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:58:50 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d7724b-558c-42be-9bb8-2ff33644c190]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:58:50 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-21557eac-18e6-4666-a316-850fa8a8a183 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-25082018-c954-41a7-9f73-bd2d2db97725 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:50 devstack sudo[102761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-25082018-c954-41a7-9f73-bd2d2db97725 Jul 08 01:58:50 devstack sudo[102761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:50 devstack sudo[102756]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:50 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-fd407ed5-5116-4f61-affa-8b77dfbc51ab tempest-VolumesGetTest-1407621467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8d41e3af-3397-43d7-8800-b51828e8b30c" returned: 0 in 1.075s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:50 devstack sudo[102759]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:50 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-fd407ed5-5116-4f61-affa-8b77dfbc51ab tempest-VolumesGetTest-1407621467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8d41e3af-3397-43d7-8800-b51828e8b30c {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:50 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e479d615-24d9-4b47-bb55-11ee0cb896e3 tempest-CreateVolumesFromSnapshotTest-1085348611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.838s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:50 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-e479d615-24d9-4b47-bb55-11ee0cb896e3 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:58:50 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-e479d615-24d9-4b47-bb55-11ee0cb896e3 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Deleted volume successfully. Jul 08 01:58:50 devstack sudo[102767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8d41e3af-3397-43d7-8800-b51828e8b30c Jul 08 01:58:50 devstack sudo[102767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:50 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-e479d615-24d9-4b47-bb55-11ee0cb896e3 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Lock "cinder-dcb032b9-77d2-41c8-a545-6344defdf796-delete_volume" released by "delete_volume" :: held 2.856s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:58:51 devstack sudo[102761]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-21557eac-18e6-4666-a316-850fa8a8a183 tempest-CreateVolumesFromSnapshotTest-1085348611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-25082018-c954-41a7-9f73-bd2d2db97725" returned: 0 in 0.979s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-21557eac-18e6-4666-a316-850fa8a8a183 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-25082018-c954-41a7-9f73-bd2d2db97725 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:51 devstack sudo[102774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-25082018-c954-41a7-9f73-bd2d2db97725 Jul 08 01:58:51 devstack sudo[102774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:51 devstack sudo[102767]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-fd407ed5-5116-4f61-affa-8b77dfbc51ab tempest-VolumesGetTest-1407621467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8d41e3af-3397-43d7-8800-b51828e8b30c" returned: 0 in 0.752s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:51 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-fd407ed5-5116-4f61-affa-8b77dfbc51ab tempest-VolumesGetTest-1407621467 None] Lock "cinder-quobyte-8d41e3af-3397-43d7-8800-b51828e8b30c" released by "delete_volume" :: held 1.896s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:58:51 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-fd407ed5-5116-4f61-affa-8b77dfbc51ab tempest-VolumesGetTest-1407621467 None] Created reservations ['cc4e5d19-ffe5-4d46-83c1-46bb86a9abb4', 'b55f0b12-eadc-44cd-a8f7-ab16be9dc972', 'e6a2290b-a1ff-4bb3-ba1e-62e007260873', '0b38c5e2-6f5f-4ac1-9752-919d1b36aeff'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:58:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-fd407ed5-5116-4f61-affa-8b77dfbc51ab tempest-VolumesGetTest-1407621467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:58:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-fd407ed5-5116-4f61-affa-8b77dfbc51ab tempest-VolumesGetTest-1407621467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:58:51 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-fd407ed5-5116-4f61-affa-8b77dfbc51ab tempest-VolumesGetTest-1407621467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:58:51 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-fd407ed5-5116-4f61-affa-8b77dfbc51ab tempest-VolumesGetTest-1407621467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:58:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-fd407ed5-5116-4f61-affa-8b77dfbc51ab tempest-VolumesGetTest-1407621467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:58:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-fd407ed5-5116-4f61-affa-8b77dfbc51ab tempest-VolumesGetTest-1407621467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:51 devstack sudo[102776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:58:51 devstack sudo[102776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:51 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-fdacf425-a327-4c76-8c43-9177bb859fe7 tempest-VolumesGetTest-1407621467 None] Acquiring lock "cinder-c4b3a853-ee33-42f8-a52c-d36900ac0d80-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:58:51 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-fdacf425-a327-4c76-8c43-9177bb859fe7 tempest-VolumesGetTest-1407621467 None] Lock "cinder-c4b3a853-ee33-42f8-a52c-d36900ac0d80-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:58:51 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-fdacf425-a327-4c76-8c43-9177bb859fe7 tempest-VolumesGetTest-1407621467 None] Acquiring lock "cinder-quobyte-c4b3a853-ee33-42f8-a52c-d36900ac0d80" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:58:51 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-fdacf425-a327-4c76-8c43-9177bb859fe7 tempest-VolumesGetTest-1407621467 None] Lock "cinder-quobyte-c4b3a853-ee33-42f8-a52c-d36900ac0d80" acquired by "delete_volume" :: waited 0.018s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:58:51 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[a222b16e-db56-425a-be9b-cc251b978201]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:58:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-fdacf425-a327-4c76-8c43-9177bb859fe7 tempest-VolumesGetTest-1407621467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c4b3a853-ee33-42f8-a52c-d36900ac0d80 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:51 devstack sudo[102778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c4b3a853-ee33-42f8-a52c-d36900ac0d80 Jul 08 01:58:51 devstack sudo[102778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:51 devstack sudo[102774]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-21557eac-18e6-4666-a316-850fa8a8a183 tempest-CreateVolumesFromSnapshotTest-1085348611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-25082018-c954-41a7-9f73-bd2d2db97725" returned: 0 in 0.841s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:51 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-21557eac-18e6-4666-a316-850fa8a8a183 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Lock "cinder-quobyte-25082018-c954-41a7-9f73-bd2d2db97725" released by "delete_volume" :: held 1.880s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:58:51 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-21557eac-18e6-4666-a316-850fa8a8a183 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Created reservations ['64d5507b-95ce-4752-a3d6-31c556da9183', '557e1fc2-fb73-4f2b-9833-2b7437f9e26e', 'c09fcbad-f712-4c53-bf4c-55cea4330779', 'bd986484-9b08-4062-8867-20d1b8a784e4'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:58:52 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-21557eac-18e6-4666-a316-850fa8a8a183 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:58:52 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-21557eac-18e6-4666-a316-850fa8a8a183 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:58:52 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-21557eac-18e6-4666-a316-850fa8a8a183 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:58:52 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-21557eac-18e6-4666-a316-850fa8a8a183 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:58:52 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-21557eac-18e6-4666-a316-850fa8a8a183 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:58:52 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-21557eac-18e6-4666-a316-850fa8a8a183 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:52 devstack sudo[102781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:58:52 devstack sudo[102781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:52 devstack sudo[102776]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:52 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-fd407ed5-5116-4f61-affa-8b77dfbc51ab tempest-VolumesGetTest-1407621467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.917s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:52 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-fd407ed5-5116-4f61-affa-8b77dfbc51ab tempest-VolumesGetTest-1407621467 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:58:52 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-fd407ed5-5116-4f61-affa-8b77dfbc51ab tempest-VolumesGetTest-1407621467 None] Deleted volume successfully. Jul 08 01:58:52 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-8a4ad768-2efe-4c13-a55a-255a16d5f746 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Acquiring lock "cinder-9ddaf936-d12e-4a7c-ad13-fbd297bf623f-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:58:52 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-fd407ed5-5116-4f61-affa-8b77dfbc51ab tempest-VolumesGetTest-1407621467 None] Lock "cinder-8d41e3af-3397-43d7-8800-b51828e8b30c-delete_volume" released by "delete_volume" :: held 3.189s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:58:52 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-8a4ad768-2efe-4c13-a55a-255a16d5f746 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Lock "cinder-9ddaf936-d12e-4a7c-ad13-fbd297bf623f-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:58:52 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-8a4ad768-2efe-4c13-a55a-255a16d5f746 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Acquiring lock "cinder-quobyte-9ddaf936-d12e-4a7c-ad13-fbd297bf623f" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:58:52 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-8a4ad768-2efe-4c13-a55a-255a16d5f746 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Lock "cinder-quobyte-9ddaf936-d12e-4a7c-ad13-fbd297bf623f" acquired by "delete_volume" :: waited 0.025s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:58:52 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[9093b56c-6466-4e4f-8a0f-2e0bf3fdddf9]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:58:52 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8a4ad768-2efe-4c13-a55a-255a16d5f746 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9ddaf936-d12e-4a7c-ad13-fbd297bf623f {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:52 devstack sudo[102784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9ddaf936-d12e-4a7c-ad13-fbd297bf623f Jul 08 01:58:52 devstack sudo[102784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:52 devstack sudo[102781]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:52 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-21557eac-18e6-4666-a316-850fa8a8a183 tempest-CreateVolumesFromSnapshotTest-1085348611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.815s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:52 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-21557eac-18e6-4666-a316-850fa8a8a183 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:58:52 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-21557eac-18e6-4666-a316-850fa8a8a183 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Deleted volume successfully. Jul 08 01:58:52 devstack sudo[102778]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:52 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-fdacf425-a327-4c76-8c43-9177bb859fe7 tempest-VolumesGetTest-1407621467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c4b3a853-ee33-42f8-a52c-d36900ac0d80" returned: 0 in 1.215s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:52 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-fdacf425-a327-4c76-8c43-9177bb859fe7 tempest-VolumesGetTest-1407621467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c4b3a853-ee33-42f8-a52c-d36900ac0d80 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:52 devstack sudo[102818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c4b3a853-ee33-42f8-a52c-d36900ac0d80 Jul 08 01:58:52 devstack sudo[102818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:52 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-21557eac-18e6-4666-a316-850fa8a8a183 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Lock "cinder-25082018-c954-41a7-9f73-bd2d2db97725-delete_volume" released by "delete_volume" :: held 3.012s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:58:53 devstack sudo[102784]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8a4ad768-2efe-4c13-a55a-255a16d5f746 tempest-CreateVolumesFromSnapshotTest-1085348611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9ddaf936-d12e-4a7c-ad13-fbd297bf623f" returned: 0 in 0.969s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8a4ad768-2efe-4c13-a55a-255a16d5f746 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9ddaf936-d12e-4a7c-ad13-fbd297bf623f {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:53 devstack sudo[102863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9ddaf936-d12e-4a7c-ad13-fbd297bf623f Jul 08 01:58:53 devstack sudo[102863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:53 devstack sudo[102818]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-fdacf425-a327-4c76-8c43-9177bb859fe7 tempest-VolumesGetTest-1407621467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c4b3a853-ee33-42f8-a52c-d36900ac0d80" returned: 0 in 0.736s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:53 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-fdacf425-a327-4c76-8c43-9177bb859fe7 tempest-VolumesGetTest-1407621467 None] Lock "cinder-quobyte-c4b3a853-ee33-42f8-a52c-d36900ac0d80" released by "delete_volume" :: held 2.054s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:58:53 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-fdacf425-a327-4c76-8c43-9177bb859fe7 tempest-VolumesGetTest-1407621467 None] Created reservations ['c3d9eef7-eb66-48aa-a834-c5aa25516f23', 'bfafa3fb-e023-4162-83f6-c56e1269163d', 'd0219681-64d6-4bb8-9e83-9015133c9251', 'fa60e5a1-f34c-42da-985b-c8d4a92d03f7'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:58:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-fdacf425-a327-4c76-8c43-9177bb859fe7 tempest-VolumesGetTest-1407621467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:58:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-fdacf425-a327-4c76-8c43-9177bb859fe7 tempest-VolumesGetTest-1407621467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:58:53 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-fdacf425-a327-4c76-8c43-9177bb859fe7 tempest-VolumesGetTest-1407621467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:58:53 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-fdacf425-a327-4c76-8c43-9177bb859fe7 tempest-VolumesGetTest-1407621467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:58:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-fdacf425-a327-4c76-8c43-9177bb859fe7 tempest-VolumesGetTest-1407621467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:58:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-fdacf425-a327-4c76-8c43-9177bb859fe7 tempest-VolumesGetTest-1407621467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:53 devstack sudo[102866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:58:53 devstack sudo[102866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:54 devstack sudo[102863]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8a4ad768-2efe-4c13-a55a-255a16d5f746 tempest-CreateVolumesFromSnapshotTest-1085348611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9ddaf936-d12e-4a7c-ad13-fbd297bf623f" returned: 0 in 0.896s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:54 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-8a4ad768-2efe-4c13-a55a-255a16d5f746 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Lock "cinder-quobyte-9ddaf936-d12e-4a7c-ad13-fbd297bf623f" released by "delete_volume" :: held 1.931s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:58:54 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-8a4ad768-2efe-4c13-a55a-255a16d5f746 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Created reservations ['b73a929f-37ab-4fab-bab3-d28950e93b68', '3e88857c-538f-4060-9a07-c7f7c74170b3', '6c57b467-1ef6-47d6-99a1-e3c59b1865f1', '44dfe513-d816-45b4-ae1c-f222a1397ada'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:58:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-8a4ad768-2efe-4c13-a55a-255a16d5f746 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:58:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-8a4ad768-2efe-4c13-a55a-255a16d5f746 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:58:54 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-8a4ad768-2efe-4c13-a55a-255a16d5f746 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:58:54 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-8a4ad768-2efe-4c13-a55a-255a16d5f746 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:58:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-8a4ad768-2efe-4c13-a55a-255a16d5f746 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:58:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8a4ad768-2efe-4c13-a55a-255a16d5f746 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:54 devstack sudo[102903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:58:54 devstack sudo[102903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:54 devstack sudo[102866]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-fdacf425-a327-4c76-8c43-9177bb859fe7 tempest-VolumesGetTest-1407621467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 1.087s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:54 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-fdacf425-a327-4c76-8c43-9177bb859fe7 tempest-VolumesGetTest-1407621467 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:58:54 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-fdacf425-a327-4c76-8c43-9177bb859fe7 tempest-VolumesGetTest-1407621467 None] Deleted volume successfully. Jul 08 01:58:55 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-fdacf425-a327-4c76-8c43-9177bb859fe7 tempest-VolumesGetTest-1407621467 None] Lock "cinder-c4b3a853-ee33-42f8-a52c-d36900ac0d80-delete_volume" released by "delete_volume" :: held 3.464s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:58:55 devstack sudo[102903]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:55 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8a4ad768-2efe-4c13-a55a-255a16d5f746 tempest-CreateVolumesFromSnapshotTest-1085348611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.966s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:55 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-8a4ad768-2efe-4c13-a55a-255a16d5f746 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:58:55 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-8a4ad768-2efe-4c13-a55a-255a16d5f746 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Deleted volume successfully. Jul 08 01:58:55 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-8a4ad768-2efe-4c13-a55a-255a16d5f746 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Lock "cinder-9ddaf936-d12e-4a7c-ad13-fbd297bf623f-delete_volume" released by "delete_volume" :: held 3.272s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:58:55 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-e90c1b31-d1ef-4d37-83d3-c7019773752d tempest-CreateVolumesFromSnapshotTest-1085348611 None] Acquiring lock "cinder-adcdbd33-7af1-4e78-a35a-717312034dc0-delete_snapshot" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:58:55 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-e90c1b31-d1ef-4d37-83d3-c7019773752d tempest-CreateVolumesFromSnapshotTest-1085348611 None] Lock "cinder-adcdbd33-7af1-4e78-a35a-717312034dc0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:58:55 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-e90c1b31-d1ef-4d37-83d3-c7019773752d tempest-CreateVolumesFromSnapshotTest-1085348611 None] Acquiring lock "cinder-quobyte-49abc5a7-a5d5-4586-8c83-1cf917a91ade" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:58:55 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-e90c1b31-d1ef-4d37-83d3-c7019773752d tempest-CreateVolumesFromSnapshotTest-1085348611 None] Lock "cinder-quobyte-49abc5a7-a5d5-4586-8c83-1cf917a91ade" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:58:55 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-e90c1b31-d1ef-4d37-83d3-c7019773752d tempest-CreateVolumesFromSnapshotTest-1085348611 None] Acquiring lock "cinder-quobyte-adcdbd33-7af1-4e78-a35a-717312034dc0" by "_delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:58:55 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-e90c1b31-d1ef-4d37-83d3-c7019773752d tempest-CreateVolumesFromSnapshotTest-1085348611 None] Lock "cinder-quobyte-adcdbd33-7af1-4e78-a35a-717312034dc0" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:58:55 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-e90c1b31-d1ef-4d37-83d3-c7019773752d tempest-CreateVolumesFromSnapshotTest-1085348611 None] Deleting offline snapshot adcdbd33-7af1-4e78-a35a-717312034dc0 of volume 49abc5a7-a5d5-4586-8c83-1cf917a91ade {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:58:55 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-e90c1b31-d1ef-4d37-83d3-c7019773752d tempest-CreateVolumesFromSnapshotTest-1085348611 None] snapshot_file for this snap is: volume-49abc5a7-a5d5-4586-8c83-1cf917a91ade.adcdbd33-7af1-4e78-a35a-717312034dc0 {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:58:55 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f17943-ce34-47d1-a342-9f2a9e882941]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:58:55 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e90c1b31-d1ef-4d37-83d3-c7019773752d tempest-CreateVolumesFromSnapshotTest-1085348611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-49abc5a7-a5d5-4586-8c83-1cf917a91ade.adcdbd33-7af1-4e78-a35a-717312034dc0 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:55 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b4814ee-d12a-4f3c-a165-50db40252e78 tempest-VolumesGetTest-1407621467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:58:55 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-2b4814ee-d12a-4f3c-a165-50db40252e78 tempest-VolumesGetTest-1407621467 None] Flow 'volume_create_manager' (854726f9-380f-4ddc-80d0-6be84c3674d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:58:55 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-2b4814ee-d12a-4f3c-a165-50db40252e78 tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1cdc13f-b681-4809-9c0c-b5b9aa17bfc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:55 devstack sudo[102925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-49abc5a7-a5d5-4586-8c83-1cf917a91ade.adcdbd33-7af1-4e78-a35a-717312034dc0 Jul 08 01:58:55 devstack sudo[102925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:55 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-2b4814ee-d12a-4f3c-a165-50db40252e78 tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1cdc13f-b681-4809-9c0c-b5b9aa17bfc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:58:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1279768630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30c45540-20c2-4f2f-b160-b3983df41242,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='bb44ecb9700c48c39aa9210cf1e798e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:58:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:58:56Z,use_quota=True,user_id='925ed36452c74af79400cbb0f3a38c86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:55 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-2b4814ee-d12a-4f3c-a165-50db40252e78 tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5a51812-b436-482f-af52-47fb24b565c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:55 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-2b4814ee-d12a-4f3c-a165-50db40252e78 tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5a51812-b436-482f-af52-47fb24b565c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:55 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-2b4814ee-d12a-4f3c-a165-50db40252e78 tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6856dfca-12c9-4422-9f09-3b431d9a5f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:55 devstack cinder-volume[87134]: DEBUG cinder.image.glance [None req-2b4814ee-d12a-4f3c-a165-50db40252e78 tempest-VolumesGetTest-1407621467 None] Creating Keystone auth plugin from conf {{(pid=87134) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 01:58:56 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-2b4814ee-d12a-4f3c-a165-50db40252e78 tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6856dfca-12c9-4422-9f09-3b431d9a5f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '30c45540-20c2-4f2f-b160-b3983df41242', 'volume_name': 'volume-30c45540-20c2-4f2f-b160-b3983df41242', 'volume_size': 1, 'image_id': 'd85f0fe5-8496-4fc8-ab6c-110323b36076', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d85f0fe5-8496-4fc8-ab6c-110323b36076', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '44fe2859624d49239062555b2318d354', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd85f0fe5-8496-4fc8-ab6c-110323b36076', 'created_at': datetime.datetime(2026, 7, 7, 23, 34, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 34, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d85f0fe5-8496-4fc8-ab6c-110323b36076/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:56 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-2b4814ee-d12a-4f3c-a165-50db40252e78 tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc092425-ea42-4e57-a3b3-aff821f30aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:56 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-2b4814ee-d12a-4f3c-a165-50db40252e78 tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc092425-ea42-4e57-a3b3-aff821f30aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:58:56 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-2b4814ee-d12a-4f3c-a165-50db40252e78 tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b4829f2-bc9a-4954-b42f-dd84b5fec5eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:58:56 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-2b4814ee-d12a-4f3c-a165-50db40252e78 tempest-VolumesGetTest-1407621467 None] Volume 30c45540-20c2-4f2f-b160-b3983df41242: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-30c45540-20c2-4f2f-b160-b3983df41242', 'volume_size': 1, 'image_id': 'd85f0fe5-8496-4fc8-ab6c-110323b36076', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d85f0fe5-8496-4fc8-ab6c-110323b36076', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '44fe2859624d49239062555b2318d354', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd85f0fe5-8496-4fc8-ab6c-110323b36076', 'created_at': datetime.datetime(2026, 7, 7, 23, 34, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 34, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d85f0fe5-8496-4fc8-ab6c-110323b36076/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 08 01:58:56 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b4814ee-d12a-4f3c-a165-50db40252e78 tempest-VolumesGetTest-1407621467 None] Trying to clone 30c45540-20c2-4f2f-b160-b3983df41242 from image d85f0fe5-8496-4fc8-ab6c-110323b36076 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d85f0fe5-8496-4fc8-ab6c-110323b36076', 'metadata': {}}]). {{(pid=87134) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 01:58:56 devstack sudo[102925]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:56 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e90c1b31-d1ef-4d37-83d3-c7019773752d tempest-CreateVolumesFromSnapshotTest-1085348611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-49abc5a7-a5d5-4586-8c83-1cf917a91ade.adcdbd33-7af1-4e78-a35a-717312034dc0" returned: 0 in 1.110s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:56 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-e90c1b31-d1ef-4d37-83d3-c7019773752d tempest-CreateVolumesFromSnapshotTest-1085348611 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-49abc5a7-a5d5-4586-8c83-1cf917a91ade(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:58:56 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[d063c880-a7c2-4345-8c8d-957448b7c7a1]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:58:56 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e90c1b31-d1ef-4d37-83d3-c7019773752d tempest-CreateVolumesFromSnapshotTest-1085348611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-49abc5a7-a5d5-4586-8c83-1cf917a91ade {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:56 devstack cinder-volume[87134]: DEBUG cinder.image.image_utils [None req-2b4814ee-d12a-4f3c-a165-50db40252e78 tempest-VolumesGetTest-1407621467 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d85f0fe5-8496-4fc8-ab6c-110323b36076_e0wrev1tdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87134) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 01:58:56 devstack cinder-volume[87134]: INFO cinder.image.image_utils [None req-2b4814ee-d12a-4f3c-a165-50db40252e78 tempest-VolumesGetTest-1407621467 None] Image download 20.69 MB at 20.69 MB/s Jul 08 01:58:57 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a149a3f-3faf-4a48-ae27-b8e995f4826d]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:58:57 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2b4814ee-d12a-4f3c-a165-50db40252e78 tempest-VolumesGetTest-1407621467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d85f0fe5-8496-4fc8-ab6c-110323b36076_e0wrev1tdevstack@QuobyteHD {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:57 devstack sudo[103255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-49abc5a7-a5d5-4586-8c83-1cf917a91ade Jul 08 01:58:57 devstack sudo[103255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:57 devstack sudo[103256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d85f0fe5-8496-4fc8-ab6c-110323b36076_e0wrev1tdevstack@QuobyteHD Jul 08 01:58:57 devstack sudo[103256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:57 devstack sudo[103255]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:57 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e90c1b31-d1ef-4d37-83d3-c7019773752d tempest-CreateVolumesFromSnapshotTest-1085348611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-49abc5a7-a5d5-4586-8c83-1cf917a91ade" returned: 0 in 0.977s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:57 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e90c1b31-d1ef-4d37-83d3-c7019773752d tempest-CreateVolumesFromSnapshotTest-1085348611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-49abc5a7-a5d5-4586-8c83-1cf917a91ade.adcdbd33-7af1-4e78-a35a-717312034dc0 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:57 devstack sudo[103266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-49abc5a7-a5d5-4586-8c83-1cf917a91ade.adcdbd33-7af1-4e78-a35a-717312034dc0 Jul 08 01:58:57 devstack sudo[103266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:58 devstack sudo[103256]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:58 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2b4814ee-d12a-4f3c-a165-50db40252e78 tempest-VolumesGetTest-1407621467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d85f0fe5-8496-4fc8-ab6c-110323b36076_e0wrev1tdevstack@QuobyteHD" returned: 0 in 1.035s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:58 devstack cinder-volume[87134]: DEBUG cinder.image.image_utils [None req-2b4814ee-d12a-4f3c-a165-50db40252e78 tempest-VolumesGetTest-1407621467 None] Temporary image d85f0fe5-8496-4fc8-ab6c-110323b36076 is fetched for user 925ed36452c74af79400cbb0f3a38c86. {{(pid=87134) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 01:58:58 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[a599fc9e-758b-4d69-9d9c-230498a14eab]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:58:58 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2b4814ee-d12a-4f3c-a165-50db40252e78 tempest-VolumesGetTest-1407621467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d85f0fe5-8496-4fc8-ab6c-110323b36076_e0wrev1tdevstack@QuobyteHD {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:58 devstack sudo[103270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d85f0fe5-8496-4fc8-ab6c-110323b36076_e0wrev1tdevstack@QuobyteHD Jul 08 01:58:58 devstack sudo[103270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:58 devstack sudo[103266]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:58 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e90c1b31-d1ef-4d37-83d3-c7019773752d tempest-CreateVolumesFromSnapshotTest-1085348611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-49abc5a7-a5d5-4586-8c83-1cf917a91ade.adcdbd33-7af1-4e78-a35a-717312034dc0" returned: 0 in 0.910s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:58 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e90c1b31-d1ef-4d37-83d3-c7019773752d tempest-CreateVolumesFromSnapshotTest-1085348611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-49abc5a7-a5d5-4586-8c83-1cf917a91ade.adcdbd33-7af1-4e78-a35a-717312034dc0 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:58 devstack sudo[103275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-49abc5a7-a5d5-4586-8c83-1cf917a91ade.adcdbd33-7af1-4e78-a35a-717312034dc0 Jul 08 01:58:58 devstack sudo[103275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:59 devstack sudo[103270]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2b4814ee-d12a-4f3c-a165-50db40252e78 tempest-VolumesGetTest-1407621467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d85f0fe5-8496-4fc8-ab6c-110323b36076_e0wrev1tdevstack@QuobyteHD" returned: 0 in 0.892s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-2b4814ee-d12a-4f3c-a165-50db40252e78 tempest-VolumesGetTest-1407621467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:58:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-2b4814ee-d12a-4f3c-a165-50db40252e78 tempest-VolumesGetTest-1407621467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:58:59 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-2b4814ee-d12a-4f3c-a165-50db40252e78 tempest-VolumesGetTest-1407621467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:58:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1279768630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30c45540-20c2-4f2f-b160-b3983df41242,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='bb44ecb9700c48c39aa9210cf1e798e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:58:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:58:56Z,use_quota=True,user_id='925ed36452c74af79400cbb0f3a38c86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:58:59 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-2b4814ee-d12a-4f3c-a165-50db40252e78 tempest-VolumesGetTest-1407621467 None] Creating volume 30c45540-20c2-4f2f-b160-b3983df41242 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:58:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-2b4814ee-d12a-4f3c-a165-50db40252e78 tempest-VolumesGetTest-1407621467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:58:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-2b4814ee-d12a-4f3c-a165-50db40252e78 tempest-VolumesGetTest-1407621467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:58:59 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-2b4814ee-d12a-4f3c-a165-50db40252e78 tempest-VolumesGetTest-1407621467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:58:59 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-2b4814ee-d12a-4f3c-a165-50db40252e78 tempest-VolumesGetTest-1407621467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:58:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-2b4814ee-d12a-4f3c-a165-50db40252e78 tempest-VolumesGetTest-1407621467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:58:59 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-2b4814ee-d12a-4f3c-a165-50db40252e78 tempest-VolumesGetTest-1407621467 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:58:59 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-2b4814ee-d12a-4f3c-a165-50db40252e78 tempest-VolumesGetTest-1407621467 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:58:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2b4814ee-d12a-4f3c-a165-50db40252e78 tempest-VolumesGetTest-1407621467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-30c45540-20c2-4f2f-b160-b3983df41242 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:58:59 devstack sudo[103280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-30c45540-20c2-4f2f-b160-b3983df41242 1073741824 Jul 08 01:58:59 devstack sudo[103280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:58:59 devstack sudo[103275]: pam_unix(sudo:session): session closed for user root Jul 08 01:58:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e90c1b31-d1ef-4d37-83d3-c7019773752d tempest-CreateVolumesFromSnapshotTest-1085348611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-49abc5a7-a5d5-4586-8c83-1cf917a91ade.adcdbd33-7af1-4e78-a35a-717312034dc0" returned: 0 in 0.797s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:58:59 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-e90c1b31-d1ef-4d37-83d3-c7019773752d tempest-CreateVolumesFromSnapshotTest-1085348611 None] Lock "cinder-quobyte-adcdbd33-7af1-4e78-a35a-717312034dc0" released by "_delete_snapshot" :: held 3.941s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:58:59 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-e90c1b31-d1ef-4d37-83d3-c7019773752d tempest-CreateVolumesFromSnapshotTest-1085348611 None] Lock "cinder-quobyte-49abc5a7-a5d5-4586-8c83-1cf917a91ade" released by "delete_snapshot" :: held 3.974s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:58:59 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-e90c1b31-d1ef-4d37-83d3-c7019773752d tempest-CreateVolumesFromSnapshotTest-1085348611 None] Created reservations ['cd56587c-950f-452e-b1f7-94f815baea79', '5cca9ea1-f870-4ec1-8ebb-5a9ea814f342', '5982dbd2-9dc6-4d73-a84a-767eb0998741', '01bc4664-14e7-417f-9c1a-a9010a11c267'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:58:59 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-e90c1b31-d1ef-4d37-83d3-c7019773752d tempest-CreateVolumesFromSnapshotTest-1085348611 None] Delete snapshot completed successfully. Jul 08 01:58:59 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-e90c1b31-d1ef-4d37-83d3-c7019773752d tempest-CreateVolumesFromSnapshotTest-1085348611 None] Lock "cinder-adcdbd33-7af1-4e78-a35a-717312034dc0-delete_snapshot" released by "delete_snapshot" :: held 4.232s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:59:00 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-c3d68163-703f-4051-9be9-98fc8c0aab17 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Acquiring lock "cinder-49abc5a7-a5d5-4586-8c83-1cf917a91ade-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:59:00 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-c3d68163-703f-4051-9be9-98fc8c0aab17 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Lock "cinder-49abc5a7-a5d5-4586-8c83-1cf917a91ade-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:59:00 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-c3d68163-703f-4051-9be9-98fc8c0aab17 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Acquiring lock "cinder-quobyte-49abc5a7-a5d5-4586-8c83-1cf917a91ade" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:59:00 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-c3d68163-703f-4051-9be9-98fc8c0aab17 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Lock "cinder-quobyte-49abc5a7-a5d5-4586-8c83-1cf917a91ade" acquired by "delete_volume" :: waited 0.041s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:59:00 devstack sudo[103280]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2b4814ee-d12a-4f3c-a165-50db40252e78 tempest-VolumesGetTest-1407621467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-30c45540-20c2-4f2f-b160-b3983df41242 1073741824" returned: 0 in 1.194s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:00 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dac6c94-121c-4e7f-83c9-573f3dbfa19d]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:59:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c3d68163-703f-4051-9be9-98fc8c0aab17 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-49abc5a7-a5d5-4586-8c83-1cf917a91ade {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2b4814ee-d12a-4f3c-a165-50db40252e78 tempest-VolumesGetTest-1407621467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-30c45540-20c2-4f2f-b160-b3983df41242 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:00 devstack sudo[103288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-30c45540-20c2-4f2f-b160-b3983df41242 Jul 08 01:59:00 devstack sudo[103288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:00 devstack sudo[103287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-49abc5a7-a5d5-4586-8c83-1cf917a91ade Jul 08 01:59:00 devstack sudo[103287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:01 devstack sudo[103288]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2b4814ee-d12a-4f3c-a165-50db40252e78 tempest-VolumesGetTest-1407621467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-30c45540-20c2-4f2f-b160-b3983df41242" returned: 0 in 0.794s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:01 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-2b4814ee-d12a-4f3c-a165-50db40252e78 tempest-VolumesGetTest-1407621467 None] <== create_volume: return (2070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:59:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-2b4814ee-d12a-4f3c-a165-50db40252e78 tempest-VolumesGetTest-1407621467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.074s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:59:01 devstack cinder-volume[87134]: DEBUG cinder.volume.volume_utils [None req-2b4814ee-d12a-4f3c-a165-50db40252e78 tempest-VolumesGetTest-1407621467 None] Attempting download of d85f0fe5-8496-4fc8-ab6c-110323b36076 ((None, [{'url': 'file:///opt/stack/data/glance/images/d85f0fe5-8496-4fc8-ab6c-110323b36076', 'metadata': {}}])) to volume 30c45540-20c2-4f2f-b160-b3983df41242. {{(pid=87134) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 01:59:01 devstack sudo[103287]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c3d68163-703f-4051-9be9-98fc8c0aab17 tempest-CreateVolumesFromSnapshotTest-1085348611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-49abc5a7-a5d5-4586-8c83-1cf917a91ade" returned: 0 in 0.958s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c3d68163-703f-4051-9be9-98fc8c0aab17 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-49abc5a7-a5d5-4586-8c83-1cf917a91ade {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:01 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[3047015b-512e-45d8-80a9-e712bf35ed9e]: (4, 'raw') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:59:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2b4814ee-d12a-4f3c-a165-50db40252e78 tempest-VolumesGetTest-1407621467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d85f0fe5-8496-4fc8-ab6c-110323b36076_iwu9ui4q {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:01 devstack sudo[103295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-49abc5a7-a5d5-4586-8c83-1cf917a91ade Jul 08 01:59:01 devstack sudo[103295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:01 devstack sudo[103296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d85f0fe5-8496-4fc8-ab6c-110323b36076_iwu9ui4q Jul 08 01:59:01 devstack sudo[103296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:02 devstack sudo[103295]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c3d68163-703f-4051-9be9-98fc8c0aab17 tempest-CreateVolumesFromSnapshotTest-1085348611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-49abc5a7-a5d5-4586-8c83-1cf917a91ade" returned: 0 in 0.837s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:02 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-c3d68163-703f-4051-9be9-98fc8c0aab17 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Lock "cinder-quobyte-49abc5a7-a5d5-4586-8c83-1cf917a91ade" released by "delete_volume" :: held 1.928s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:59:02 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-c3d68163-703f-4051-9be9-98fc8c0aab17 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Created reservations ['511ce306-0d43-4159-a48d-97abf1f6a0b2', 'bf386182-3b64-4a4a-a21f-b97b518691cb', '0af4e9c6-ffd8-4c85-bf08-60acb262ebce', '81438aa3-3a7a-476a-9294-fb30456c3943'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:59:02 devstack sudo[103296]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2b4814ee-d12a-4f3c-a165-50db40252e78 tempest-VolumesGetTest-1407621467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d85f0fe5-8496-4fc8-ab6c-110323b36076_iwu9ui4q" returned: 0 in 0.933s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2b4814ee-d12a-4f3c-a165-50db40252e78 tempest-VolumesGetTest-1407621467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d85f0fe5-8496-4fc8-ab6c-110323b36076_iwu9ui4q {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c3d68163-703f-4051-9be9-98fc8c0aab17 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:59:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c3d68163-703f-4051-9be9-98fc8c0aab17 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:59:02 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-c3d68163-703f-4051-9be9-98fc8c0aab17 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:59:02 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-c3d68163-703f-4051-9be9-98fc8c0aab17 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:59:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c3d68163-703f-4051-9be9-98fc8c0aab17 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:59:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c3d68163-703f-4051-9be9-98fc8c0aab17 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:02 devstack sudo[103303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:59:02 devstack sudo[103303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:02 devstack sudo[103302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d85f0fe5-8496-4fc8-ab6c-110323b36076_iwu9ui4q Jul 08 01:59:02 devstack sudo[103302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:03 devstack sudo[103302]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:03 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2b4814ee-d12a-4f3c-a165-50db40252e78 tempest-VolumesGetTest-1407621467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d85f0fe5-8496-4fc8-ab6c-110323b36076_iwu9ui4q" returned: 1 in 0.929s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:03 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2b4814ee-d12a-4f3c-a165-50db40252e78 tempest-VolumesGetTest-1407621467 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d85f0fe5-8496-4fc8-ab6c-110323b36076_iwu9ui4q' failed. Not Retrying. {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:59:03 devstack sudo[103303]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:03 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[696c007e-9f3c-414b-9141-9e48da9dd439]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:59:03 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2b4814ee-d12a-4f3c-a165-50db40252e78 tempest-VolumesGetTest-1407621467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d85f0fe5-8496-4fc8-ab6c-110323b36076_e0wrev1tdevstack@QuobyteHD {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:03 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c3d68163-703f-4051-9be9-98fc8c0aab17 tempest-CreateVolumesFromSnapshotTest-1085348611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.879s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:03 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-c3d68163-703f-4051-9be9-98fc8c0aab17 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:59:03 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-c3d68163-703f-4051-9be9-98fc8c0aab17 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Deleted volume successfully. Jul 08 01:59:03 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-c3d68163-703f-4051-9be9-98fc8c0aab17 tempest-CreateVolumesFromSnapshotTest-1085348611 None] Lock "cinder-49abc5a7-a5d5-4586-8c83-1cf917a91ade-delete_volume" released by "delete_volume" :: held 3.149s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:59:03 devstack sudo[103310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d85f0fe5-8496-4fc8-ab6c-110323b36076_e0wrev1tdevstack@QuobyteHD Jul 08 01:59:03 devstack sudo[103310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:04 devstack sudo[103310]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:04 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2b4814ee-d12a-4f3c-a165-50db40252e78 tempest-VolumesGetTest-1407621467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d85f0fe5-8496-4fc8-ab6c-110323b36076_e0wrev1tdevstack@QuobyteHD" returned: 0 in 0.940s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:04 devstack cinder-volume[87134]: DEBUG cinder.image.image_utils [None req-2b4814ee-d12a-4f3c-a165-50db40252e78 tempest-VolumesGetTest-1407621467 None] d85f0fe5-8496-4fc8-ab6c-110323b36076 was qcow2, converting to raw {{(pid=87134) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 01:59:04 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2b4814ee-d12a-4f3c-a165-50db40252e78 tempest-VolumesGetTest-1407621467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d85f0fe5-8496-4fc8-ab6c-110323b36076_e0wrev1tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-30c45540-20c2-4f2f-b160-b3983df41242 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:04 devstack sudo[103315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d85f0fe5-8496-4fc8-ab6c-110323b36076_e0wrev1tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-30c45540-20c2-4f2f-b160-b3983df41242 Jul 08 01:59:04 devstack sudo[103315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:06 devstack sudo[103315]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:06 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2b4814ee-d12a-4f3c-a165-50db40252e78 tempest-VolumesGetTest-1407621467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d85f0fe5-8496-4fc8-ab6c-110323b36076_e0wrev1tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-30c45540-20c2-4f2f-b160-b3983df41242" returned: 0 in 2.219s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:06 devstack cinder-volume[87134]: DEBUG cinder.image.image_utils [None req-2b4814ee-d12a-4f3c-a165-50db40252e78 tempest-VolumesGetTest-1407621467 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d85f0fe5-8496-4fc8-ab6c-110323b36076_e0wrev1tdevstack@QuobyteHD, size 112.00 MB, duration 2.22 sec, destination /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-30c45540-20c2-4f2f-b160-b3983df41242 {{(pid=87134) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:59:06 devstack cinder-volume[87134]: INFO cinder.image.image_utils [None req-2b4814ee-d12a-4f3c-a165-50db40252e78 tempest-VolumesGetTest-1407621467 None] Converted 112.00 MB image at 50.44 MB/s Jul 08 01:59:06 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2b4814ee-d12a-4f3c-a165-50db40252e78 tempest-VolumesGetTest-1407621467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-30c45540-20c2-4f2f-b160-b3983df41242 1G {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:06 devstack sudo[103323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-30c45540-20c2-4f2f-b160-b3983df41242 1G Jul 08 01:59:06 devstack sudo[103323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:07 devstack sudo[103323]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:07 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2b4814ee-d12a-4f3c-a165-50db40252e78 tempest-VolumesGetTest-1407621467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-30c45540-20c2-4f2f-b160-b3983df41242 1G" returned: 0 in 0.745s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:07 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc900015-560a-4031-83da-bb45c792f636]: (4, 'raw') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:59:07 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2b4814ee-d12a-4f3c-a165-50db40252e78 tempest-VolumesGetTest-1407621467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-30c45540-20c2-4f2f-b160-b3983df41242 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:07 devstack sudo[103328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-30c45540-20c2-4f2f-b160-b3983df41242 Jul 08 01:59:07 devstack sudo[103328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:08 devstack sudo[103328]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:08 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2b4814ee-d12a-4f3c-a165-50db40252e78 tempest-VolumesGetTest-1407621467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-30c45540-20c2-4f2f-b160-b3983df41242" returned: 0 in 0.868s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:08 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2b4814ee-d12a-4f3c-a165-50db40252e78 tempest-VolumesGetTest-1407621467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-30c45540-20c2-4f2f-b160-b3983df41242 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:08 devstack sudo[103332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-30c45540-20c2-4f2f-b160-b3983df41242 Jul 08 01:59:08 devstack sudo[103332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:08 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef3c5221-2280-4ad2-83da-ba48f147ce1b tempest-VolumeImageDependencyTests-133183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:59:08 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ef3c5221-2280-4ad2-83da-ba48f147ce1b tempest-VolumeImageDependencyTests-133183 None] Flow 'volume_create_manager' (916b618d-5a7c-4992-b21f-5bb74547d66a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:59:08 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ef3c5221-2280-4ad2-83da-ba48f147ce1b tempest-VolumeImageDependencyTests-133183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c0e75f0-8ec7-4707-ac4d-6c5e5bfc3fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:59:08 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ef3c5221-2280-4ad2-83da-ba48f147ce1b tempest-VolumeImageDependencyTests-133183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c0e75f0-8ec7-4707-ac4d-6c5e5bfc3fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:59:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f3df87a-b32f-42a9-af0e-619ccf74160d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='544fe185ddb442179c2e6a3a9974bc7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:59:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:59:08Z,use_quota=True,user_id='d2e815ea86ab4f70b756761f74e778e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:59:08 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ef3c5221-2280-4ad2-83da-ba48f147ce1b tempest-VolumeImageDependencyTests-133183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (708e07c7-e1f4-4640-a829-5912a4c6c85e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:59:08 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ef3c5221-2280-4ad2-83da-ba48f147ce1b tempest-VolumeImageDependencyTests-133183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (708e07c7-e1f4-4640-a829-5912a4c6c85e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:59:08 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ef3c5221-2280-4ad2-83da-ba48f147ce1b tempest-VolumeImageDependencyTests-133183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcf4d3d2-1eb4-455d-9eb3-dfe71e0676f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:59:08 devstack cinder-volume[87134]: DEBUG cinder.image.glance [None req-ef3c5221-2280-4ad2-83da-ba48f147ce1b tempest-VolumeImageDependencyTests-133183 None] Creating Keystone auth plugin from conf {{(pid=87134) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 01:59:08 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ef3c5221-2280-4ad2-83da-ba48f147ce1b tempest-VolumeImageDependencyTests-133183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcf4d3d2-1eb4-455d-9eb3-dfe71e0676f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9f3df87a-b32f-42a9-af0e-619ccf74160d', 'volume_name': 'volume-9f3df87a-b32f-42a9-af0e-619ccf74160d', 'volume_size': 1, 'image_id': '85fd944f-51ef-41a6-96ab-ee4a7ee8cec3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/85fd944f-51ef-41a6-96ab-ee4a7ee8cec3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7673757c4bb8eed7fbb19a0aef76d90a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '544fe185ddb442179c2e6a3a9974bc7f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f1714872e5ca3f5270ff2629953740e918599c41a200d11efcb00f86d4b3ae7822337e30c076c22c326039d95dd5629d7bb6173b0fa67c901384d2a33d5511ac', 'id': '85fd944f-51ef-41a6-96ab-ee4a7ee8cec3', 'created_at': datetime.datetime(2026, 7, 7, 23, 59, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 59, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/85fd944f-51ef-41a6-96ab-ee4a7ee8cec3/file', 'properties': {}}, 'image_service': }' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:59:08 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ef3c5221-2280-4ad2-83da-ba48f147ce1b tempest-VolumeImageDependencyTests-133183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (938f5319-491a-4fd2-aee8-82cffe998384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:59:08 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ef3c5221-2280-4ad2-83da-ba48f147ce1b tempest-VolumeImageDependencyTests-133183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (938f5319-491a-4fd2-aee8-82cffe998384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:59:08 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ef3c5221-2280-4ad2-83da-ba48f147ce1b tempest-VolumeImageDependencyTests-133183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e8c0b02-76f3-463a-b49a-1b13b79a3249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:59:08 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-ef3c5221-2280-4ad2-83da-ba48f147ce1b tempest-VolumeImageDependencyTests-133183 None] Volume 9f3df87a-b32f-42a9-af0e-619ccf74160d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9f3df87a-b32f-42a9-af0e-619ccf74160d', 'volume_size': 1, 'image_id': '85fd944f-51ef-41a6-96ab-ee4a7ee8cec3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/85fd944f-51ef-41a6-96ab-ee4a7ee8cec3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7673757c4bb8eed7fbb19a0aef76d90a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '544fe185ddb442179c2e6a3a9974bc7f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f1714872e5ca3f5270ff2629953740e918599c41a200d11efcb00f86d4b3ae7822337e30c076c22c326039d95dd5629d7bb6173b0fa67c901384d2a33d5511ac', 'id': '85fd944f-51ef-41a6-96ab-ee4a7ee8cec3', 'created_at': datetime.datetime(2026, 7, 7, 23, 59, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 59, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/85fd944f-51ef-41a6-96ab-ee4a7ee8cec3/file', 'properties': {}}, 'image_service': } Jul 08 01:59:08 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef3c5221-2280-4ad2-83da-ba48f147ce1b tempest-VolumeImageDependencyTests-133183 None] Trying to clone 9f3df87a-b32f-42a9-af0e-619ccf74160d from image 85fd944f-51ef-41a6-96ab-ee4a7ee8cec3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/85fd944f-51ef-41a6-96ab-ee4a7ee8cec3', 'metadata': {}}]). {{(pid=87134) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 01:59:08 devstack cinder-volume[87134]: DEBUG cinder.image.image_utils [None req-ef3c5221-2280-4ad2-83da-ba48f147ce1b tempest-VolumeImageDependencyTests-133183 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_85fd944f-51ef-41a6-96ab-ee4a7ee8cec3_0wh39eufdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87134) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 01:59:08 devstack cinder-volume[87134]: INFO cinder.image.image_utils [None req-ef3c5221-2280-4ad2-83da-ba48f147ce1b tempest-VolumeImageDependencyTests-133183 None] Image download 0.00 MB at 0.00 MB/s Jul 08 01:59:08 devstack sudo[103332]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:08 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2b4814ee-d12a-4f3c-a165-50db40252e78 tempest-VolumesGetTest-1407621467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-30c45540-20c2-4f2f-b160-b3983df41242" returned: 1 in 0.868s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:08 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2b4814ee-d12a-4f3c-a165-50db40252e78 tempest-VolumesGetTest-1407621467 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-30c45540-20c2-4f2f-b160-b3983df41242' failed. Not Retrying. {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:59:08 devstack cinder-volume[87134]: DEBUG cinder.volume.volume_utils [None req-2b4814ee-d12a-4f3c-a165-50db40252e78 tempest-VolumesGetTest-1407621467 None] Downloaded image d85f0fe5-8496-4fc8-ab6c-110323b36076 ((None, [{'url': 'file:///opt/stack/data/glance/images/d85f0fe5-8496-4fc8-ab6c-110323b36076', 'metadata': {}}])) to volume 30c45540-20c2-4f2f-b160-b3983df41242 successfully. {{(pid=87134) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 01:59:08 devstack cinder-volume[87134]: DEBUG cinder.image.image_utils [None req-2b4814ee-d12a-4f3c-a165-50db40252e78 tempest-VolumesGetTest-1407621467 None] Temporary image d85f0fe5-8496-4fc8-ab6c-110323b36076 for user 925ed36452c74af79400cbb0f3a38c86 is deleted. {{(pid=87134) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 01:59:08 devstack cinder-volume[87134]: DEBUG cinder.volume.volume_utils [None req-2b4814ee-d12a-4f3c-a165-50db40252e78 tempest-VolumesGetTest-1407621467 None] Marking volume 30c45540-20c2-4f2f-b160-b3983df41242 as bootable. {{(pid=87134) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 01:59:08 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b4814ee-d12a-4f3c-a165-50db40252e78 tempest-VolumesGetTest-1407621467 None] Copying metadata from image d85f0fe5-8496-4fc8-ab6c-110323b36076 to 30c45540-20c2-4f2f-b160-b3983df41242. {{(pid=87134) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 01:59:08 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b4814ee-d12a-4f3c-a165-50db40252e78 tempest-VolumesGetTest-1407621467 None] Creating volume glance metadata for volume 30c45540-20c2-4f2f-b160-b3983df41242 backed by image d85f0fe5-8496-4fc8-ab6c-110323b36076 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd85f0fe5-8496-4fc8-ab6c-110323b36076', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87134) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 01:59:08 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[df33db10-3ba6-4f00-b9ac-d308d0c2b498]: (4, 'raw') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:59:08 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ef3c5221-2280-4ad2-83da-ba48f147ce1b tempest-VolumeImageDependencyTests-133183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_85fd944f-51ef-41a6-96ab-ee4a7ee8cec3_0wh39eufdevstack@QuobyteHD {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:09 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-2b4814ee-d12a-4f3c-a165-50db40252e78 tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b4829f2-bc9a-4954-b42f-dd84b5fec5eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30c45540-20c2-4f2f-b160-b3983df41242', 'volume_size': 1, 'image_id': 'd85f0fe5-8496-4fc8-ab6c-110323b36076', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d85f0fe5-8496-4fc8-ab6c-110323b36076', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '44fe2859624d49239062555b2318d354', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd85f0fe5-8496-4fc8-ab6c-110323b36076', 'created_at': datetime.datetime(2026, 7, 7, 23, 34, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 34, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d85f0fe5-8496-4fc8-ab6c-110323b36076/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:59:09 devstack sudo[103338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_85fd944f-51ef-41a6-96ab-ee4a7ee8cec3_0wh39eufdevstack@QuobyteHD Jul 08 01:59:09 devstack sudo[103338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:09 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-2b4814ee-d12a-4f3c-a165-50db40252e78 tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (399834ed-f5f2-4509-96d5-0cdd1f8c4dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:59:09 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-2b4814ee-d12a-4f3c-a165-50db40252e78 tempest-VolumesGetTest-1407621467 None] Volume volume-30c45540-20c2-4f2f-b160-b3983df41242 (30c45540-20c2-4f2f-b160-b3983df41242): created successfully Jul 08 01:59:09 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-2b4814ee-d12a-4f3c-a165-50db40252e78 tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (399834ed-f5f2-4509-96d5-0cdd1f8c4dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:59:09 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-2b4814ee-d12a-4f3c-a165-50db40252e78 tempest-VolumesGetTest-1407621467 None] Flow 'volume_create_manager' (854726f9-380f-4ddc-80d0-6be84c3674d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:59:09 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-2b4814ee-d12a-4f3c-a165-50db40252e78 tempest-VolumesGetTest-1407621467 None] Created volume successfully. Jul 08 01:59:09 devstack sudo[103338]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:09 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ef3c5221-2280-4ad2-83da-ba48f147ce1b tempest-VolumeImageDependencyTests-133183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_85fd944f-51ef-41a6-96ab-ee4a7ee8cec3_0wh39eufdevstack@QuobyteHD" returned: 0 in 0.803s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:09 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ef3c5221-2280-4ad2-83da-ba48f147ce1b tempest-VolumeImageDependencyTests-133183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_85fd944f-51ef-41a6-96ab-ee4a7ee8cec3_0wh39eufdevstack@QuobyteHD {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:09 devstack sudo[103343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_85fd944f-51ef-41a6-96ab-ee4a7ee8cec3_0wh39eufdevstack@QuobyteHD Jul 08 01:59:09 devstack sudo[103343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:10 devstack sudo[103343]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:10 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ef3c5221-2280-4ad2-83da-ba48f147ce1b tempest-VolumeImageDependencyTests-133183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_85fd944f-51ef-41a6-96ab-ee4a7ee8cec3_0wh39eufdevstack@QuobyteHD" returned: 1 in 0.804s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:10 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ef3c5221-2280-4ad2-83da-ba48f147ce1b tempest-VolumeImageDependencyTests-133183 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_85fd944f-51ef-41a6-96ab-ee4a7ee8cec3_0wh39eufdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:59:10 devstack cinder-volume[87134]: DEBUG cinder.image.image_utils [None req-ef3c5221-2280-4ad2-83da-ba48f147ce1b tempest-VolumeImageDependencyTests-133183 None] Temporary image 85fd944f-51ef-41a6-96ab-ee4a7ee8cec3 is fetched for user d2e815ea86ab4f70b756761f74e778e8. {{(pid=87134) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 01:59:10 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed52895-f5a0-4546-842e-8b64b0e0bd28]: (4, 'raw') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:59:10 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ef3c5221-2280-4ad2-83da-ba48f147ce1b tempest-VolumeImageDependencyTests-133183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_85fd944f-51ef-41a6-96ab-ee4a7ee8cec3_0wh39eufdevstack@QuobyteHD {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:10 devstack sudo[103349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_85fd944f-51ef-41a6-96ab-ee4a7ee8cec3_0wh39eufdevstack@QuobyteHD Jul 08 01:59:10 devstack sudo[103349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:11 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9d01834-293e-4b9e-a8b1-3b64c45ef844 tempest-VolumesGetTest-1407621467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:59:11 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e9d01834-293e-4b9e-a8b1-3b64c45ef844 tempest-VolumesGetTest-1407621467 None] Flow 'volume_create_manager' (16c0f9ce-1309-4923-ac13-fbb57a6e0b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:59:11 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e9d01834-293e-4b9e-a8b1-3b64c45ef844 tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e9b5365-86f2-406d-b463-a2709e560955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:59:11 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e9d01834-293e-4b9e-a8b1-3b64c45ef844 tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e9b5365-86f2-406d-b463-a2709e560955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:59:11Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-767363663',display_name='tempest-VolumesGetTest-Volume-387290783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=929e6e50-755e-40f4-8bef-0f5b9caa501b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb44ecb9700c48c39aa9210cf1e798e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:59:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:59:11Z,use_quota=True,user_id='925ed36452c74af79400cbb0f3a38c86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:59:11 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e9d01834-293e-4b9e-a8b1-3b64c45ef844 tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cedc542-7d08-4409-b623-a5d22e5fb7c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:59:11 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e9d01834-293e-4b9e-a8b1-3b64c45ef844 tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cedc542-7d08-4409-b623-a5d22e5fb7c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:59:11 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e9d01834-293e-4b9e-a8b1-3b64c45ef844 tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1abcfa3d-8ad4-4b22-ab27-4145075befe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:59:11 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e9d01834-293e-4b9e-a8b1-3b64c45ef844 tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1abcfa3d-8ad4-4b22-ab27-4145075befe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '929e6e50-755e-40f4-8bef-0f5b9caa501b', 'volume_name': 'volume-929e6e50-755e-40f4-8bef-0f5b9caa501b', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:59:11 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e9d01834-293e-4b9e-a8b1-3b64c45ef844 tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4efe3a9a-bd33-4b96-9433-966f8060106c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:59:11 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e9d01834-293e-4b9e-a8b1-3b64c45ef844 tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4efe3a9a-bd33-4b96-9433-966f8060106c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:59:11 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e9d01834-293e-4b9e-a8b1-3b64c45ef844 tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e60a360-6066-4e00-a123-692d7e96db00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:59:11 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-e9d01834-293e-4b9e-a8b1-3b64c45ef844 tempest-VolumesGetTest-1407621467 None] Volume 929e6e50-755e-40f4-8bef-0f5b9caa501b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-929e6e50-755e-40f4-8bef-0f5b9caa501b', 'volume_size': 1} Jul 08 01:59:11 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e9d01834-293e-4b9e-a8b1-3b64c45ef844 tempest-VolumesGetTest-1407621467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:59:11 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e9d01834-293e-4b9e-a8b1-3b64c45ef844 tempest-VolumesGetTest-1407621467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:59:11 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-e9d01834-293e-4b9e-a8b1-3b64c45ef844 tempest-VolumesGetTest-1407621467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:59:11Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-767363663',display_name='tempest-VolumesGetTest-Volume-387290783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=929e6e50-755e-40f4-8bef-0f5b9caa501b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb44ecb9700c48c39aa9210cf1e798e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:59:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:59:11Z,use_quota=True,user_id='925ed36452c74af79400cbb0f3a38c86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:59:11 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-e9d01834-293e-4b9e-a8b1-3b64c45ef844 tempest-VolumesGetTest-1407621467 None] Creating volume 929e6e50-755e-40f4-8bef-0f5b9caa501b {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:59:11 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e9d01834-293e-4b9e-a8b1-3b64c45ef844 tempest-VolumesGetTest-1407621467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:59:11 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e9d01834-293e-4b9e-a8b1-3b64c45ef844 tempest-VolumesGetTest-1407621467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:59:11 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-e9d01834-293e-4b9e-a8b1-3b64c45ef844 tempest-VolumesGetTest-1407621467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:59:11 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-e9d01834-293e-4b9e-a8b1-3b64c45ef844 tempest-VolumesGetTest-1407621467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:59:11 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e9d01834-293e-4b9e-a8b1-3b64c45ef844 tempest-VolumesGetTest-1407621467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:59:11 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-e9d01834-293e-4b9e-a8b1-3b64c45ef844 tempest-VolumesGetTest-1407621467 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:59:11 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-e9d01834-293e-4b9e-a8b1-3b64c45ef844 tempest-VolumesGetTest-1407621467 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:59:11 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e9d01834-293e-4b9e-a8b1-3b64c45ef844 tempest-VolumesGetTest-1407621467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-929e6e50-755e-40f4-8bef-0f5b9caa501b 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:11 devstack sudo[103351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-929e6e50-755e-40f4-8bef-0f5b9caa501b 1073741824 Jul 08 01:59:11 devstack sudo[103351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:11 devstack sudo[103349]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:11 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ef3c5221-2280-4ad2-83da-ba48f147ce1b tempest-VolumeImageDependencyTests-133183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_85fd944f-51ef-41a6-96ab-ee4a7ee8cec3_0wh39eufdevstack@QuobyteHD" returned: 0 in 0.868s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:11 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ef3c5221-2280-4ad2-83da-ba48f147ce1b tempest-VolumeImageDependencyTests-133183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_85fd944f-51ef-41a6-96ab-ee4a7ee8cec3_0wh39eufdevstack@QuobyteHD {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:11 devstack sudo[103367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_85fd944f-51ef-41a6-96ab-ee4a7ee8cec3_0wh39eufdevstack@QuobyteHD Jul 08 01:59:11 devstack sudo[103367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:12 devstack sudo[103351]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:12 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e9d01834-293e-4b9e-a8b1-3b64c45ef844 tempest-VolumesGetTest-1407621467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-929e6e50-755e-40f4-8bef-0f5b9caa501b 1073741824" returned: 0 in 1.028s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:12 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e9d01834-293e-4b9e-a8b1-3b64c45ef844 tempest-VolumesGetTest-1407621467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-929e6e50-755e-40f4-8bef-0f5b9caa501b {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:12 devstack sudo[103372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-929e6e50-755e-40f4-8bef-0f5b9caa501b Jul 08 01:59:12 devstack sudo[103372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:12 devstack sudo[103367]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:12 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ef3c5221-2280-4ad2-83da-ba48f147ce1b tempest-VolumeImageDependencyTests-133183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_85fd944f-51ef-41a6-96ab-ee4a7ee8cec3_0wh39eufdevstack@QuobyteHD" returned: 1 in 0.918s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:12 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ef3c5221-2280-4ad2-83da-ba48f147ce1b tempest-VolumeImageDependencyTests-133183 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_85fd944f-51ef-41a6-96ab-ee4a7ee8cec3_0wh39eufdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:59:12 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-ef3c5221-2280-4ad2-83da-ba48f147ce1b tempest-VolumeImageDependencyTests-133183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:59:12 devstack sudo[103372]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:12 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e9d01834-293e-4b9e-a8b1-3b64c45ef844 tempest-VolumesGetTest-1407621467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-929e6e50-755e-40f4-8bef-0f5b9caa501b" returned: 0 in 0.721s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:12 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-e9d01834-293e-4b9e-a8b1-3b64c45ef844 tempest-VolumesGetTest-1407621467 None] <== create_volume: return (1815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:59:12 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e9d01834-293e-4b9e-a8b1-3b64c45ef844 tempest-VolumesGetTest-1407621467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.818s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:59:12 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-ef3c5221-2280-4ad2-83da-ba48f147ce1b tempest-VolumeImageDependencyTests-133183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.490s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:59:12 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-ef3c5221-2280-4ad2-83da-ba48f147ce1b tempest-VolumeImageDependencyTests-133183 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:59:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f3df87a-b32f-42a9-af0e-619ccf74160d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='544fe185ddb442179c2e6a3a9974bc7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:59:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:59:08Z,use_quota=True,user_id='d2e815ea86ab4f70b756761f74e778e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:59:12 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-ef3c5221-2280-4ad2-83da-ba48f147ce1b tempest-VolumeImageDependencyTests-133183 None] Creating volume 9f3df87a-b32f-42a9-af0e-619ccf74160d {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:59:12 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-ef3c5221-2280-4ad2-83da-ba48f147ce1b tempest-VolumeImageDependencyTests-133183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:59:12 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-ef3c5221-2280-4ad2-83da-ba48f147ce1b tempest-VolumeImageDependencyTests-133183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:59:12 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-ef3c5221-2280-4ad2-83da-ba48f147ce1b tempest-VolumeImageDependencyTests-133183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:59:12 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-ef3c5221-2280-4ad2-83da-ba48f147ce1b tempest-VolumeImageDependencyTests-133183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:59:12 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-ef3c5221-2280-4ad2-83da-ba48f147ce1b tempest-VolumeImageDependencyTests-133183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:59:12 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-ef3c5221-2280-4ad2-83da-ba48f147ce1b tempest-VolumeImageDependencyTests-133183 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:59:12 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-ef3c5221-2280-4ad2-83da-ba48f147ce1b tempest-VolumeImageDependencyTests-133183 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:59:12 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ef3c5221-2280-4ad2-83da-ba48f147ce1b tempest-VolumeImageDependencyTests-133183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9f3df87a-b32f-42a9-af0e-619ccf74160d 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:12 devstack sudo[103403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9f3df87a-b32f-42a9-af0e-619ccf74160d 1073741824 Jul 08 01:59:12 devstack sudo[103403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:12 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e9d01834-293e-4b9e-a8b1-3b64c45ef844 tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e60a360-6066-4e00-a123-692d7e96db00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-929e6e50-755e-40f4-8bef-0f5b9caa501b', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:59:12 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e9d01834-293e-4b9e-a8b1-3b64c45ef844 tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b5af06b-4e7a-48f6-92fd-1ca2e96397ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:59:13 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-e9d01834-293e-4b9e-a8b1-3b64c45ef844 tempest-VolumesGetTest-1407621467 None] Volume volume-929e6e50-755e-40f4-8bef-0f5b9caa501b (929e6e50-755e-40f4-8bef-0f5b9caa501b): created successfully Jul 08 01:59:13 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e9d01834-293e-4b9e-a8b1-3b64c45ef844 tempest-VolumesGetTest-1407621467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b5af06b-4e7a-48f6-92fd-1ca2e96397ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:59:13 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e9d01834-293e-4b9e-a8b1-3b64c45ef844 tempest-VolumesGetTest-1407621467 None] Flow 'volume_create_manager' (16c0f9ce-1309-4923-ac13-fbb57a6e0b27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:59:13 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-e9d01834-293e-4b9e-a8b1-3b64c45ef844 tempest-VolumesGetTest-1407621467 None] Created volume successfully. Jul 08 01:59:13 devstack sudo[103403]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ef3c5221-2280-4ad2-83da-ba48f147ce1b tempest-VolumeImageDependencyTests-133183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9f3df87a-b32f-42a9-af0e-619ccf74160d 1073741824" returned: 0 in 0.899s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ef3c5221-2280-4ad2-83da-ba48f147ce1b tempest-VolumeImageDependencyTests-133183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9f3df87a-b32f-42a9-af0e-619ccf74160d {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:13 devstack sudo[103409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9f3df87a-b32f-42a9-af0e-619ccf74160d Jul 08 01:59:13 devstack sudo[103409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:14 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-cb4b8ce2-ac3c-40af-9753-ef56887836ee tempest-VolumesGetTest-1407621467 None] Acquiring lock "cinder-929e6e50-755e-40f4-8bef-0f5b9caa501b-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:59:14 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-cb4b8ce2-ac3c-40af-9753-ef56887836ee tempest-VolumesGetTest-1407621467 None] Lock "cinder-929e6e50-755e-40f4-8bef-0f5b9caa501b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:59:14 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-cb4b8ce2-ac3c-40af-9753-ef56887836ee tempest-VolumesGetTest-1407621467 None] Acquiring lock "cinder-quobyte-929e6e50-755e-40f4-8bef-0f5b9caa501b" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:59:14 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-cb4b8ce2-ac3c-40af-9753-ef56887836ee tempest-VolumesGetTest-1407621467 None] Lock "cinder-quobyte-929e6e50-755e-40f4-8bef-0f5b9caa501b" acquired by "delete_volume" :: waited 0.017s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:59:14 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[1613e13d-d2d5-40cf-b4f9-fe54aeaff22a]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:59:14 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-cb4b8ce2-ac3c-40af-9753-ef56887836ee tempest-VolumesGetTest-1407621467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-929e6e50-755e-40f4-8bef-0f5b9caa501b {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:14 devstack sudo[103411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-929e6e50-755e-40f4-8bef-0f5b9caa501b Jul 08 01:59:14 devstack sudo[103411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:14 devstack sudo[103409]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:14 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ef3c5221-2280-4ad2-83da-ba48f147ce1b tempest-VolumeImageDependencyTests-133183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9f3df87a-b32f-42a9-af0e-619ccf74160d" returned: 0 in 0.727s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:14 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-ef3c5221-2280-4ad2-83da-ba48f147ce1b tempest-VolumeImageDependencyTests-133183 None] <== create_volume: return (1673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:59:14 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-ef3c5221-2280-4ad2-83da-ba48f147ce1b tempest-VolumeImageDependencyTests-133183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.677s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:59:14 devstack cinder-volume[87134]: DEBUG cinder.volume.volume_utils [None req-ef3c5221-2280-4ad2-83da-ba48f147ce1b tempest-VolumeImageDependencyTests-133183 None] Attempting download of 85fd944f-51ef-41a6-96ab-ee4a7ee8cec3 ((None, [{'url': 'file:///opt/stack/data/glance/images/85fd944f-51ef-41a6-96ab-ee4a7ee8cec3', 'metadata': {}}])) to volume 9f3df87a-b32f-42a9-af0e-619ccf74160d. {{(pid=87134) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 01:59:14 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71e0091-b9ff-4df4-8561-b042fa87afb0]: (4, 'raw') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:59:14 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ef3c5221-2280-4ad2-83da-ba48f147ce1b tempest-VolumeImageDependencyTests-133183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_85fd944f-51ef-41a6-96ab-ee4a7ee8cec3_qg86lfft {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:14 devstack sudo[103414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_85fd944f-51ef-41a6-96ab-ee4a7ee8cec3_qg86lfft Jul 08 01:59:14 devstack sudo[103414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:15 devstack sudo[103411]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-cb4b8ce2-ac3c-40af-9753-ef56887836ee tempest-VolumesGetTest-1407621467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-929e6e50-755e-40f4-8bef-0f5b9caa501b" returned: 0 in 0.902s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-cb4b8ce2-ac3c-40af-9753-ef56887836ee tempest-VolumesGetTest-1407621467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-929e6e50-755e-40f4-8bef-0f5b9caa501b {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:15 devstack sudo[103419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-929e6e50-755e-40f4-8bef-0f5b9caa501b Jul 08 01:59:15 devstack sudo[103419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:15 devstack sudo[103414]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ef3c5221-2280-4ad2-83da-ba48f147ce1b tempest-VolumeImageDependencyTests-133183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_85fd944f-51ef-41a6-96ab-ee4a7ee8cec3_qg86lfft" returned: 0 in 0.837s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ef3c5221-2280-4ad2-83da-ba48f147ce1b tempest-VolumeImageDependencyTests-133183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_85fd944f-51ef-41a6-96ab-ee4a7ee8cec3_qg86lfft {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:15 devstack sudo[103423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_85fd944f-51ef-41a6-96ab-ee4a7ee8cec3_qg86lfft Jul 08 01:59:15 devstack sudo[103423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:16 devstack sudo[103419]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-cb4b8ce2-ac3c-40af-9753-ef56887836ee tempest-VolumesGetTest-1407621467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-929e6e50-755e-40f4-8bef-0f5b9caa501b" returned: 0 in 0.787s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:16 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-cb4b8ce2-ac3c-40af-9753-ef56887836ee tempest-VolumesGetTest-1407621467 None] Lock "cinder-quobyte-929e6e50-755e-40f4-8bef-0f5b9caa501b" released by "delete_volume" :: held 1.741s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:59:16 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-cb4b8ce2-ac3c-40af-9753-ef56887836ee tempest-VolumesGetTest-1407621467 None] Created reservations ['5cb7c9b5-613b-4971-9786-f445e7cb926e', '9854f8da-e941-4558-9bf9-815849104ec8', '524a51d4-a14e-4ce4-8248-41fd26f11a40', '06266968-59b8-4a14-95a8-1811d2ab1764'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:59:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-cb4b8ce2-ac3c-40af-9753-ef56887836ee tempest-VolumesGetTest-1407621467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:59:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-cb4b8ce2-ac3c-40af-9753-ef56887836ee tempest-VolumesGetTest-1407621467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:59:16 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-cb4b8ce2-ac3c-40af-9753-ef56887836ee tempest-VolumesGetTest-1407621467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:59:16 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-cb4b8ce2-ac3c-40af-9753-ef56887836ee tempest-VolumesGetTest-1407621467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:59:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-cb4b8ce2-ac3c-40af-9753-ef56887836ee tempest-VolumesGetTest-1407621467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:59:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-cb4b8ce2-ac3c-40af-9753-ef56887836ee tempest-VolumesGetTest-1407621467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:16 devstack sudo[103428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:59:16 devstack sudo[103428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:16 devstack sudo[103423]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ef3c5221-2280-4ad2-83da-ba48f147ce1b tempest-VolumeImageDependencyTests-133183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_85fd944f-51ef-41a6-96ab-ee4a7ee8cec3_qg86lfft" returned: 1 in 0.810s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ef3c5221-2280-4ad2-83da-ba48f147ce1b tempest-VolumeImageDependencyTests-133183 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_85fd944f-51ef-41a6-96ab-ee4a7ee8cec3_qg86lfft' failed. Not Retrying. {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:59:16 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f79c4dd-fd74-42c1-ad1c-9cbccb3911bf]: (4, 'raw') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:59:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ef3c5221-2280-4ad2-83da-ba48f147ce1b tempest-VolumeImageDependencyTests-133183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_85fd944f-51ef-41a6-96ab-ee4a7ee8cec3_0wh39eufdevstack@QuobyteHD {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:16 devstack sudo[103430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_85fd944f-51ef-41a6-96ab-ee4a7ee8cec3_0wh39eufdevstack@QuobyteHD Jul 08 01:59:16 devstack sudo[103430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:16 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-8e0d315e-4eff-47b7-9a8e-75993a818778 tempest-VolumesGetTest-1407621467 None] Acquiring lock "cinder-30c45540-20c2-4f2f-b160-b3983df41242-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:59:16 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-8e0d315e-4eff-47b7-9a8e-75993a818778 tempest-VolumesGetTest-1407621467 None] Lock "cinder-30c45540-20c2-4f2f-b160-b3983df41242-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:59:16 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-8e0d315e-4eff-47b7-9a8e-75993a818778 tempest-VolumesGetTest-1407621467 None] Acquiring lock "cinder-quobyte-30c45540-20c2-4f2f-b160-b3983df41242" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:59:16 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-8e0d315e-4eff-47b7-9a8e-75993a818778 tempest-VolumesGetTest-1407621467 None] Lock "cinder-quobyte-30c45540-20c2-4f2f-b160-b3983df41242" acquired by "delete_volume" :: waited 0.022s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:59:16 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[5debc8ee-29db-4442-af17-94e8cc790055]: (4, 'raw') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:59:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8e0d315e-4eff-47b7-9a8e-75993a818778 tempest-VolumesGetTest-1407621467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-30c45540-20c2-4f2f-b160-b3983df41242 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:16 devstack sudo[103432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-30c45540-20c2-4f2f-b160-b3983df41242 Jul 08 01:59:16 devstack sudo[103432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:17 devstack sudo[103428]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-cb4b8ce2-ac3c-40af-9753-ef56887836ee tempest-VolumesGetTest-1407621467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.783s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:17 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-cb4b8ce2-ac3c-40af-9753-ef56887836ee tempest-VolumesGetTest-1407621467 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:59:17 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-cb4b8ce2-ac3c-40af-9753-ef56887836ee tempest-VolumesGetTest-1407621467 None] Deleted volume successfully. Jul 08 01:59:17 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-cb4b8ce2-ac3c-40af-9753-ef56887836ee tempest-VolumesGetTest-1407621467 None] Lock "cinder-929e6e50-755e-40f4-8bef-0f5b9caa501b-delete_volume" released by "delete_volume" :: held 2.776s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:59:17 devstack sudo[103430]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ef3c5221-2280-4ad2-83da-ba48f147ce1b tempest-VolumeImageDependencyTests-133183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_85fd944f-51ef-41a6-96ab-ee4a7ee8cec3_0wh39eufdevstack@QuobyteHD" returned: 0 in 0.772s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ef3c5221-2280-4ad2-83da-ba48f147ce1b tempest-VolumeImageDependencyTests-133183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_85fd944f-51ef-41a6-96ab-ee4a7ee8cec3_0wh39eufdevstack@QuobyteHD {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:17 devstack sudo[103437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_85fd944f-51ef-41a6-96ab-ee4a7ee8cec3_0wh39eufdevstack@QuobyteHD Jul 08 01:59:17 devstack sudo[103437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:17 devstack sudo[103432]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8e0d315e-4eff-47b7-9a8e-75993a818778 tempest-VolumesGetTest-1407621467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-30c45540-20c2-4f2f-b160-b3983df41242" returned: 0 in 0.891s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8e0d315e-4eff-47b7-9a8e-75993a818778 tempest-VolumesGetTest-1407621467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-30c45540-20c2-4f2f-b160-b3983df41242 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:17 devstack sudo[103441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-30c45540-20c2-4f2f-b160-b3983df41242 Jul 08 01:59:17 devstack sudo[103441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:18 devstack sudo[103437]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ef3c5221-2280-4ad2-83da-ba48f147ce1b tempest-VolumeImageDependencyTests-133183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_85fd944f-51ef-41a6-96ab-ee4a7ee8cec3_0wh39eufdevstack@QuobyteHD" returned: 1 in 0.886s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ef3c5221-2280-4ad2-83da-ba48f147ce1b tempest-VolumeImageDependencyTests-133183 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_85fd944f-51ef-41a6-96ab-ee4a7ee8cec3_0wh39eufdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:59:18 devstack cinder-volume[87134]: DEBUG cinder.image.image_utils [None req-ef3c5221-2280-4ad2-83da-ba48f147ce1b tempest-VolumeImageDependencyTests-133183 None] 85fd944f-51ef-41a6-96ab-ee4a7ee8cec3 was raw, converting to raw {{(pid=87134) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 01:59:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ef3c5221-2280-4ad2-83da-ba48f147ce1b tempest-VolumeImageDependencyTests-133183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_85fd944f-51ef-41a6-96ab-ee4a7ee8cec3_0wh39eufdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9f3df87a-b32f-42a9-af0e-619ccf74160d {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:18 devstack sudo[103446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_85fd944f-51ef-41a6-96ab-ee4a7ee8cec3_0wh39eufdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9f3df87a-b32f-42a9-af0e-619ccf74160d Jul 08 01:59:18 devstack sudo[103446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:18 devstack sudo[103441]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8e0d315e-4eff-47b7-9a8e-75993a818778 tempest-VolumesGetTest-1407621467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-30c45540-20c2-4f2f-b160-b3983df41242" returned: 1 in 0.844s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8e0d315e-4eff-47b7-9a8e-75993a818778 tempest-VolumesGetTest-1407621467 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-30c45540-20c2-4f2f-b160-b3983df41242' failed. Not Retrying. {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:59:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8e0d315e-4eff-47b7-9a8e-75993a818778 tempest-VolumesGetTest-1407621467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-30c45540-20c2-4f2f-b160-b3983df41242 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:18 devstack sudo[103451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-30c45540-20c2-4f2f-b160-b3983df41242 Jul 08 01:59:18 devstack sudo[103451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:18 devstack sudo[103446]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ef3c5221-2280-4ad2-83da-ba48f147ce1b tempest-VolumeImageDependencyTests-133183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_85fd944f-51ef-41a6-96ab-ee4a7ee8cec3_0wh39eufdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9f3df87a-b32f-42a9-af0e-619ccf74160d" returned: 0 in 0.870s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:18 devstack cinder-volume[87134]: DEBUG cinder.image.image_utils [None req-ef3c5221-2280-4ad2-83da-ba48f147ce1b tempest-VolumeImageDependencyTests-133183 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_85fd944f-51ef-41a6-96ab-ee4a7ee8cec3_0wh39eufdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9f3df87a-b32f-42a9-af0e-619ccf74160d {{(pid=87134) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:59:18 devstack cinder-volume[87134]: INFO cinder.image.image_utils [None req-ef3c5221-2280-4ad2-83da-ba48f147ce1b tempest-VolumeImageDependencyTests-133183 None] Converted 0.00 MB image at 0.00 MB/s Jul 08 01:59:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ef3c5221-2280-4ad2-83da-ba48f147ce1b tempest-VolumeImageDependencyTests-133183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9f3df87a-b32f-42a9-af0e-619ccf74160d 1G {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:18 devstack sudo[103456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9f3df87a-b32f-42a9-af0e-619ccf74160d 1G Jul 08 01:59:18 devstack sudo[103456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:19 devstack sudo[103451]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8e0d315e-4eff-47b7-9a8e-75993a818778 tempest-VolumesGetTest-1407621467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-30c45540-20c2-4f2f-b160-b3983df41242" returned: 0 in 0.714s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:19 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-8e0d315e-4eff-47b7-9a8e-75993a818778 tempest-VolumesGetTest-1407621467 None] Lock "cinder-quobyte-30c45540-20c2-4f2f-b160-b3983df41242" released by "delete_volume" :: held 2.516s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:59:19 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-8e0d315e-4eff-47b7-9a8e-75993a818778 tempest-VolumesGetTest-1407621467 None] Created reservations ['d73230f7-72b2-488d-b849-f17ef0747c59', '7d33fe40-ac3d-4078-bfdf-b0bfcd0be229', '2dd562be-ee82-4652-8c8f-5625134f6739', 'e7a2af6a-3ebb-43f6-980e-c0f338232ae2'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:59:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-8e0d315e-4eff-47b7-9a8e-75993a818778 tempest-VolumesGetTest-1407621467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:59:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-8e0d315e-4eff-47b7-9a8e-75993a818778 tempest-VolumesGetTest-1407621467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:59:19 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-8e0d315e-4eff-47b7-9a8e-75993a818778 tempest-VolumesGetTest-1407621467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:59:19 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-8e0d315e-4eff-47b7-9a8e-75993a818778 tempest-VolumesGetTest-1407621467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:59:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-8e0d315e-4eff-47b7-9a8e-75993a818778 tempest-VolumesGetTest-1407621467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:59:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8e0d315e-4eff-47b7-9a8e-75993a818778 tempest-VolumesGetTest-1407621467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:19 devstack sudo[103459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:59:19 devstack sudo[103459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:19 devstack sudo[103456]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ef3c5221-2280-4ad2-83da-ba48f147ce1b tempest-VolumeImageDependencyTests-133183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9f3df87a-b32f-42a9-af0e-619ccf74160d 1G" returned: 0 in 0.739s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:19 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a1cc00-510c-43da-89af-2f26b3d5d033]: (4, 'raw') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:59:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ef3c5221-2280-4ad2-83da-ba48f147ce1b tempest-VolumeImageDependencyTests-133183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9f3df87a-b32f-42a9-af0e-619ccf74160d {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:19 devstack sudo[103464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9f3df87a-b32f-42a9-af0e-619ccf74160d Jul 08 01:59:19 devstack sudo[103464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:20 devstack sudo[103459]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8e0d315e-4eff-47b7-9a8e-75993a818778 tempest-VolumesGetTest-1407621467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.678s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:20 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-8e0d315e-4eff-47b7-9a8e-75993a818778 tempest-VolumesGetTest-1407621467 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:59:20 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-8e0d315e-4eff-47b7-9a8e-75993a818778 tempest-VolumesGetTest-1407621467 None] Deleted volume successfully. Jul 08 01:59:20 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-8e0d315e-4eff-47b7-9a8e-75993a818778 tempest-VolumesGetTest-1407621467 None] Lock "cinder-30c45540-20c2-4f2f-b160-b3983df41242-delete_volume" released by "delete_volume" :: held 3.450s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:59:20 devstack sudo[103464]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ef3c5221-2280-4ad2-83da-ba48f147ce1b tempest-VolumeImageDependencyTests-133183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9f3df87a-b32f-42a9-af0e-619ccf74160d" returned: 0 in 0.804s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ef3c5221-2280-4ad2-83da-ba48f147ce1b tempest-VolumeImageDependencyTests-133183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9f3df87a-b32f-42a9-af0e-619ccf74160d {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:20 devstack sudo[103473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9f3df87a-b32f-42a9-af0e-619ccf74160d Jul 08 01:59:20 devstack sudo[103473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:20 devstack cinder-volume[87134]: DEBUG oslo_service.periodic_task [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87134) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:59:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:59:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:59:20 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:59:20 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:59:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:59:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:20 devstack sudo[103475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:59:20 devstack sudo[103475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:21 devstack sudo[103473]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ef3c5221-2280-4ad2-83da-ba48f147ce1b tempest-VolumeImageDependencyTests-133183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9f3df87a-b32f-42a9-af0e-619ccf74160d" returned: 1 in 1.047s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ef3c5221-2280-4ad2-83da-ba48f147ce1b tempest-VolumeImageDependencyTests-133183 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9f3df87a-b32f-42a9-af0e-619ccf74160d' failed. Not Retrying. {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:59:21 devstack cinder-volume[87134]: DEBUG cinder.volume.volume_utils [None req-ef3c5221-2280-4ad2-83da-ba48f147ce1b tempest-VolumeImageDependencyTests-133183 None] Downloaded image 85fd944f-51ef-41a6-96ab-ee4a7ee8cec3 ((None, [{'url': 'file:///opt/stack/data/glance/images/85fd944f-51ef-41a6-96ab-ee4a7ee8cec3', 'metadata': {}}])) to volume 9f3df87a-b32f-42a9-af0e-619ccf74160d successfully. {{(pid=87134) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 01:59:21 devstack cinder-volume[87134]: DEBUG cinder.image.image_utils [None req-ef3c5221-2280-4ad2-83da-ba48f147ce1b tempest-VolumeImageDependencyTests-133183 None] Temporary image 85fd944f-51ef-41a6-96ab-ee4a7ee8cec3 for user d2e815ea86ab4f70b756761f74e778e8 is deleted. {{(pid=87134) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 01:59:21 devstack cinder-volume[87134]: DEBUG cinder.volume.volume_utils [None req-ef3c5221-2280-4ad2-83da-ba48f147ce1b tempest-VolumeImageDependencyTests-133183 None] Marking volume 9f3df87a-b32f-42a9-af0e-619ccf74160d as bootable. {{(pid=87134) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 01:59:21 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef3c5221-2280-4ad2-83da-ba48f147ce1b tempest-VolumeImageDependencyTests-133183 None] Copying metadata from image 85fd944f-51ef-41a6-96ab-ee4a7ee8cec3 to 9f3df87a-b32f-42a9-af0e-619ccf74160d. {{(pid=87134) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 01:59:21 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef3c5221-2280-4ad2-83da-ba48f147ce1b tempest-VolumeImageDependencyTests-133183 None] Creating volume glance metadata for volume 9f3df87a-b32f-42a9-af0e-619ccf74160d backed by image 85fd944f-51ef-41a6-96ab-ee4a7ee8cec3 with: {'image_id': '85fd944f-51ef-41a6-96ab-ee4a7ee8cec3', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '7673757c4bb8eed7fbb19a0aef76d90a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87134) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 01:59:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ef3c5221-2280-4ad2-83da-ba48f147ce1b tempest-VolumeImageDependencyTests-133183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e8c0b02-76f3-463a-b49a-1b13b79a3249) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f3df87a-b32f-42a9-af0e-619ccf74160d', 'volume_size': 1, 'image_id': '85fd944f-51ef-41a6-96ab-ee4a7ee8cec3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/85fd944f-51ef-41a6-96ab-ee4a7ee8cec3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7673757c4bb8eed7fbb19a0aef76d90a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '544fe185ddb442179c2e6a3a9974bc7f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f1714872e5ca3f5270ff2629953740e918599c41a200d11efcb00f86d4b3ae7822337e30c076c22c326039d95dd5629d7bb6173b0fa67c901384d2a33d5511ac', 'id': '85fd944f-51ef-41a6-96ab-ee4a7ee8cec3', 'created_at': datetime.datetime(2026, 7, 7, 23, 59, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 59, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/85fd944f-51ef-41a6-96ab-ee4a7ee8cec3/file', 'properties': {}}, 'image_service': }' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:59:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ef3c5221-2280-4ad2-83da-ba48f147ce1b tempest-VolumeImageDependencyTests-133183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c3ec968-c50c-4cd6-889f-ffd97fcc7af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:59:21 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-ef3c5221-2280-4ad2-83da-ba48f147ce1b tempest-VolumeImageDependencyTests-133183 None] Volume volume-9f3df87a-b32f-42a9-af0e-619ccf74160d (9f3df87a-b32f-42a9-af0e-619ccf74160d): created successfully Jul 08 01:59:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ef3c5221-2280-4ad2-83da-ba48f147ce1b tempest-VolumeImageDependencyTests-133183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c3ec968-c50c-4cd6-889f-ffd97fcc7af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:59:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ef3c5221-2280-4ad2-83da-ba48f147ce1b tempest-VolumeImageDependencyTests-133183 None] Flow 'volume_create_manager' (916b618d-5a7c-4992-b21f-5bb74547d66a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:59:21 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-ef3c5221-2280-4ad2-83da-ba48f147ce1b tempest-VolumeImageDependencyTests-133183 None] Created volume successfully. Jul 08 01:59:21 devstack sudo[103475]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.903s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:21 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:59:21 devstack cinder-volume[87134]: DEBUG oslo_service.periodic_task [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running periodic task VolumeManager._thread_info {{(pid=87134) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:59:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] thread count: 28 {{(pid=87134) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:59:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] thread info: [<_MainThread(MainThread, started 129378964615296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87134) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:59:22 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a7198a74-bbb4-45a0-9fb0-1085c07dd312 tempest-VolumeImageDependencyTests-133183 None] Acquiring lock "cinder-9f3df87a-b32f-42a9-af0e-619ccf74160d-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:59:22 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a7198a74-bbb4-45a0-9fb0-1085c07dd312 tempest-VolumeImageDependencyTests-133183 None] Lock "cinder-9f3df87a-b32f-42a9-af0e-619ccf74160d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:59:22 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a7198a74-bbb4-45a0-9fb0-1085c07dd312 tempest-VolumeImageDependencyTests-133183 None] Acquiring lock "cinder-quobyte-9f3df87a-b32f-42a9-af0e-619ccf74160d" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:59:22 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a7198a74-bbb4-45a0-9fb0-1085c07dd312 tempest-VolumeImageDependencyTests-133183 None] Lock "cinder-quobyte-9f3df87a-b32f-42a9-af0e-619ccf74160d" acquired by "delete_volume" :: waited 0.018s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:59:22 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a6cd7b-61af-4ca9-a33a-4657b1dfe473]: (4, 'raw') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:59:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a7198a74-bbb4-45a0-9fb0-1085c07dd312 tempest-VolumeImageDependencyTests-133183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9f3df87a-b32f-42a9-af0e-619ccf74160d {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:22 devstack sudo[103483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9f3df87a-b32f-42a9-af0e-619ccf74160d Jul 08 01:59:22 devstack sudo[103483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:23 devstack sudo[103483]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:23 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a7198a74-bbb4-45a0-9fb0-1085c07dd312 tempest-VolumeImageDependencyTests-133183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9f3df87a-b32f-42a9-af0e-619ccf74160d" returned: 0 in 0.991s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:23 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a7198a74-bbb4-45a0-9fb0-1085c07dd312 tempest-VolumeImageDependencyTests-133183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9f3df87a-b32f-42a9-af0e-619ccf74160d {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:23 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-b778f4bb-cb2d-49d4-b408-5e27949dfbb8 tempest-VolumesNegativeTest-988989842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:59:23 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b778f4bb-cb2d-49d4-b408-5e27949dfbb8 tempest-VolumesNegativeTest-988989842 None] Flow 'volume_create_manager' (e25f2bc0-4c0c-4d05-a35e-72a935c5f4d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:59:23 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b778f4bb-cb2d-49d4-b408-5e27949dfbb8 tempest-VolumesNegativeTest-988989842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc0503aa-661a-42f7-a483-d4802f252005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:59:23 devstack sudo[103501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9f3df87a-b32f-42a9-af0e-619ccf74160d Jul 08 01:59:23 devstack sudo[103501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:23 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b778f4bb-cb2d-49d4-b408-5e27949dfbb8 tempest-VolumesNegativeTest-988989842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc0503aa-661a-42f7-a483-d4802f252005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:59:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-413712820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9da0e124-c0ec-4fa2-a3aa-452975eb16eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b0f0dabcddf419fbd9dbab042fc45f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:59:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:59:24Z,use_quota=True,user_id='74af835b612d4666b19d556166326b8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:59:23 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b778f4bb-cb2d-49d4-b408-5e27949dfbb8 tempest-VolumesNegativeTest-988989842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2867b3b3-68fe-454e-9182-b90a76eb0961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:59:23 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b778f4bb-cb2d-49d4-b408-5e27949dfbb8 tempest-VolumesNegativeTest-988989842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2867b3b3-68fe-454e-9182-b90a76eb0961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:59:23 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b778f4bb-cb2d-49d4-b408-5e27949dfbb8 tempest-VolumesNegativeTest-988989842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5cca180-e1e2-40b7-9214-613b27d48636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:59:23 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b778f4bb-cb2d-49d4-b408-5e27949dfbb8 tempest-VolumesNegativeTest-988989842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5cca180-e1e2-40b7-9214-613b27d48636) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9da0e124-c0ec-4fa2-a3aa-452975eb16eb', 'volume_name': 'volume-9da0e124-c0ec-4fa2-a3aa-452975eb16eb', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:59:23 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b778f4bb-cb2d-49d4-b408-5e27949dfbb8 tempest-VolumesNegativeTest-988989842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c270272-3ad8-4cf5-b1ef-e7ed8707cb9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:59:23 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b778f4bb-cb2d-49d4-b408-5e27949dfbb8 tempest-VolumesNegativeTest-988989842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c270272-3ad8-4cf5-b1ef-e7ed8707cb9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:59:23 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b778f4bb-cb2d-49d4-b408-5e27949dfbb8 tempest-VolumesNegativeTest-988989842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12089aba-7026-4fea-9a98-542e67f6d9ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:59:23 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-b778f4bb-cb2d-49d4-b408-5e27949dfbb8 tempest-VolumesNegativeTest-988989842 None] Volume 9da0e124-c0ec-4fa2-a3aa-452975eb16eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9da0e124-c0ec-4fa2-a3aa-452975eb16eb', 'volume_size': 1} Jul 08 01:59:23 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b778f4bb-cb2d-49d4-b408-5e27949dfbb8 tempest-VolumesNegativeTest-988989842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:59:23 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b778f4bb-cb2d-49d4-b408-5e27949dfbb8 tempest-VolumesNegativeTest-988989842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:59:23 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-b778f4bb-cb2d-49d4-b408-5e27949dfbb8 tempest-VolumesNegativeTest-988989842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:59:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-413712820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9da0e124-c0ec-4fa2-a3aa-452975eb16eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b0f0dabcddf419fbd9dbab042fc45f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:59:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:59:24Z,use_quota=True,user_id='74af835b612d4666b19d556166326b8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:59:23 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-b778f4bb-cb2d-49d4-b408-5e27949dfbb8 tempest-VolumesNegativeTest-988989842 None] Creating volume 9da0e124-c0ec-4fa2-a3aa-452975eb16eb {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:59:23 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b778f4bb-cb2d-49d4-b408-5e27949dfbb8 tempest-VolumesNegativeTest-988989842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:59:23 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b778f4bb-cb2d-49d4-b408-5e27949dfbb8 tempest-VolumesNegativeTest-988989842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:59:23 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-b778f4bb-cb2d-49d4-b408-5e27949dfbb8 tempest-VolumesNegativeTest-988989842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:59:23 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-b778f4bb-cb2d-49d4-b408-5e27949dfbb8 tempest-VolumesNegativeTest-988989842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:59:23 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b778f4bb-cb2d-49d4-b408-5e27949dfbb8 tempest-VolumesNegativeTest-988989842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:59:23 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-b778f4bb-cb2d-49d4-b408-5e27949dfbb8 tempest-VolumesNegativeTest-988989842 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:59:23 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-b778f4bb-cb2d-49d4-b408-5e27949dfbb8 tempest-VolumesNegativeTest-988989842 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:59:23 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b778f4bb-cb2d-49d4-b408-5e27949dfbb8 tempest-VolumesNegativeTest-988989842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9da0e124-c0ec-4fa2-a3aa-452975eb16eb 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:23 devstack sudo[103507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9da0e124-c0ec-4fa2-a3aa-452975eb16eb 1073741824 Jul 08 01:59:23 devstack sudo[103507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:24 devstack sudo[103501]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a7198a74-bbb4-45a0-9fb0-1085c07dd312 tempest-VolumeImageDependencyTests-133183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9f3df87a-b32f-42a9-af0e-619ccf74160d" returned: 1 in 0.990s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a7198a74-bbb4-45a0-9fb0-1085c07dd312 tempest-VolumeImageDependencyTests-133183 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9f3df87a-b32f-42a9-af0e-619ccf74160d' failed. Not Retrying. {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:59:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a7198a74-bbb4-45a0-9fb0-1085c07dd312 tempest-VolumeImageDependencyTests-133183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9f3df87a-b32f-42a9-af0e-619ccf74160d {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:24 devstack sudo[103518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9f3df87a-b32f-42a9-af0e-619ccf74160d Jul 08 01:59:24 devstack sudo[103518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:24 devstack sudo[103507]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b778f4bb-cb2d-49d4-b408-5e27949dfbb8 tempest-VolumesNegativeTest-988989842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9da0e124-c0ec-4fa2-a3aa-452975eb16eb 1073741824" returned: 0 in 1.098s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b778f4bb-cb2d-49d4-b408-5e27949dfbb8 tempest-VolumesNegativeTest-988989842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9da0e124-c0ec-4fa2-a3aa-452975eb16eb {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:25 devstack sudo[103522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9da0e124-c0ec-4fa2-a3aa-452975eb16eb Jul 08 01:59:25 devstack sudo[103522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:25 devstack sudo[103518]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:25 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a7198a74-bbb4-45a0-9fb0-1085c07dd312 tempest-VolumeImageDependencyTests-133183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9f3df87a-b32f-42a9-af0e-619ccf74160d" returned: 0 in 0.727s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:25 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a7198a74-bbb4-45a0-9fb0-1085c07dd312 tempest-VolumeImageDependencyTests-133183 None] Lock "cinder-quobyte-9f3df87a-b32f-42a9-af0e-619ccf74160d" released by "delete_volume" :: held 2.772s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:59:25 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-a7198a74-bbb4-45a0-9fb0-1085c07dd312 tempest-VolumeImageDependencyTests-133183 None] Created reservations ['519988e9-aa5b-4704-b45f-fad4166e75e1', 'bce9ec6d-5dd8-41d9-a92d-17b89ba83bcc', 'f19acb39-b73f-4a20-94d5-75907595dd80', '7c0be94b-d11f-48c0-a9db-d815c92696b0'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:59:25 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-a7198a74-bbb4-45a0-9fb0-1085c07dd312 tempest-VolumeImageDependencyTests-133183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:59:25 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-a7198a74-bbb4-45a0-9fb0-1085c07dd312 tempest-VolumeImageDependencyTests-133183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:59:25 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-a7198a74-bbb4-45a0-9fb0-1085c07dd312 tempest-VolumeImageDependencyTests-133183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:59:25 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-a7198a74-bbb4-45a0-9fb0-1085c07dd312 tempest-VolumeImageDependencyTests-133183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:59:25 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-a7198a74-bbb4-45a0-9fb0-1085c07dd312 tempest-VolumeImageDependencyTests-133183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:59:25 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a7198a74-bbb4-45a0-9fb0-1085c07dd312 tempest-VolumeImageDependencyTests-133183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:25 devstack sudo[103526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:59:25 devstack sudo[103526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:25 devstack sudo[103522]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:25 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b778f4bb-cb2d-49d4-b408-5e27949dfbb8 tempest-VolumesNegativeTest-988989842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9da0e124-c0ec-4fa2-a3aa-452975eb16eb" returned: 0 in 0.651s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:25 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-b778f4bb-cb2d-49d4-b408-5e27949dfbb8 tempest-VolumesNegativeTest-988989842 None] <== create_volume: return (1807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:59:25 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b778f4bb-cb2d-49d4-b408-5e27949dfbb8 tempest-VolumesNegativeTest-988989842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.815s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:59:25 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b778f4bb-cb2d-49d4-b408-5e27949dfbb8 tempest-VolumesNegativeTest-988989842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12089aba-7026-4fea-9a98-542e67f6d9ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9da0e124-c0ec-4fa2-a3aa-452975eb16eb', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:59:25 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b778f4bb-cb2d-49d4-b408-5e27949dfbb8 tempest-VolumesNegativeTest-988989842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c455d366-d8bc-4329-9f08-36c34267e525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:59:25 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-b778f4bb-cb2d-49d4-b408-5e27949dfbb8 tempest-VolumesNegativeTest-988989842 None] Volume volume-9da0e124-c0ec-4fa2-a3aa-452975eb16eb (9da0e124-c0ec-4fa2-a3aa-452975eb16eb): created successfully Jul 08 01:59:25 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b778f4bb-cb2d-49d4-b408-5e27949dfbb8 tempest-VolumesNegativeTest-988989842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c455d366-d8bc-4329-9f08-36c34267e525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:59:25 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b778f4bb-cb2d-49d4-b408-5e27949dfbb8 tempest-VolumesNegativeTest-988989842 None] Flow 'volume_create_manager' (e25f2bc0-4c0c-4d05-a35e-72a935c5f4d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:59:25 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-b778f4bb-cb2d-49d4-b408-5e27949dfbb8 tempest-VolumesNegativeTest-988989842 None] Created volume successfully. Jul 08 01:59:25 devstack cinder-volume[87134]: INFO cinder.volume.manager [req-86dc777e-8fb7-4c69-8b78-6dcf8ac35a25 req-58f3485a-69fb-43dd-ad02-1117a8b9be5d tempest-TestShelveInstance-426081337 None] Terminate volume connection completed successfully. Jul 08 01:59:25 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [req-86dc777e-8fb7-4c69-8b78-6dcf8ac35a25 req-58f3485a-69fb-43dd-ad02-1117a8b9be5d tempest-TestShelveInstance-426081337 None] Deleting attachment ebc2e24c-bc7e-4736-877e-d6828d0860b3. {{(pid=87134) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:59:26 devstack sudo[103526]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:26 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a7198a74-bbb4-45a0-9fb0-1085c07dd312 tempest-VolumeImageDependencyTests-133183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.747s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:26 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-a7198a74-bbb4-45a0-9fb0-1085c07dd312 tempest-VolumeImageDependencyTests-133183 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:59:26 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-a7198a74-bbb4-45a0-9fb0-1085c07dd312 tempest-VolumeImageDependencyTests-133183 None] Deleted volume successfully. Jul 08 01:59:26 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a7198a74-bbb4-45a0-9fb0-1085c07dd312 tempest-VolumeImageDependencyTests-133183 None] Lock "cinder-9f3df87a-b32f-42a9-af0e-619ccf74160d-delete_volume" released by "delete_volume" :: held 3.740s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:59:26 devstack cinder-volume[87134]: DEBUG cinder.coordination [req-86dc777e-8fb7-4c69-8b78-6dcf8ac35a25 req-1a054a6e-d901-48b0-8d5f-9bb3c8b42824 tempest-TestShelveInstance-426081337 None] Acquiring lock "cinder-1d15d46a-ee04-4123-97dc-6f823378d269-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:59:26 devstack cinder-volume[87134]: DEBUG cinder.coordination [req-86dc777e-8fb7-4c69-8b78-6dcf8ac35a25 req-1a054a6e-d901-48b0-8d5f-9bb3c8b42824 tempest-TestShelveInstance-426081337 None] Lock "cinder-1d15d46a-ee04-4123-97dc-6f823378d269-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:59:26 devstack cinder-volume[87134]: DEBUG cinder.coordination [req-86dc777e-8fb7-4c69-8b78-6dcf8ac35a25 req-1a054a6e-d901-48b0-8d5f-9bb3c8b42824 tempest-TestShelveInstance-426081337 None] Acquiring lock "cinder-quobyte-1d15d46a-ee04-4123-97dc-6f823378d269" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:59:26 devstack cinder-volume[87134]: DEBUG cinder.coordination [req-86dc777e-8fb7-4c69-8b78-6dcf8ac35a25 req-1a054a6e-d901-48b0-8d5f-9bb3c8b42824 tempest-TestShelveInstance-426081337 None] Lock "cinder-quobyte-1d15d46a-ee04-4123-97dc-6f823378d269" acquired by "delete_volume" :: waited 0.026s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:59:26 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e80eda-5e5a-481f-93c5-eb997fb0da2a]: (4, 'raw') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:59:26 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-86dc777e-8fb7-4c69-8b78-6dcf8ac35a25 req-1a054a6e-d901-48b0-8d5f-9bb3c8b42824 tempest-TestShelveInstance-426081337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1d15d46a-ee04-4123-97dc-6f823378d269 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:26 devstack sudo[103530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1d15d46a-ee04-4123-97dc-6f823378d269 Jul 08 01:59:26 devstack sudo[103530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:27 devstack sudo[103530]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:27 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-86dc777e-8fb7-4c69-8b78-6dcf8ac35a25 req-1a054a6e-d901-48b0-8d5f-9bb3c8b42824 tempest-TestShelveInstance-426081337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1d15d46a-ee04-4123-97dc-6f823378d269" returned: 0 in 1.076s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:27 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-86dc777e-8fb7-4c69-8b78-6dcf8ac35a25 req-1a054a6e-d901-48b0-8d5f-9bb3c8b42824 tempest-TestShelveInstance-426081337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1d15d46a-ee04-4123-97dc-6f823378d269 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:27 devstack sudo[103537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1d15d46a-ee04-4123-97dc-6f823378d269 Jul 08 01:59:27 devstack sudo[103537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:28 devstack sudo[103537]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:28 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-86dc777e-8fb7-4c69-8b78-6dcf8ac35a25 req-1a054a6e-d901-48b0-8d5f-9bb3c8b42824 tempest-TestShelveInstance-426081337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1d15d46a-ee04-4123-97dc-6f823378d269" returned: 1 in 0.918s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:28 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-86dc777e-8fb7-4c69-8b78-6dcf8ac35a25 req-1a054a6e-d901-48b0-8d5f-9bb3c8b42824 tempest-TestShelveInstance-426081337 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1d15d46a-ee04-4123-97dc-6f823378d269' failed. Not Retrying. {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:59:28 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-86dc777e-8fb7-4c69-8b78-6dcf8ac35a25 req-1a054a6e-d901-48b0-8d5f-9bb3c8b42824 tempest-TestShelveInstance-426081337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1d15d46a-ee04-4123-97dc-6f823378d269 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:28 devstack sudo[103542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1d15d46a-ee04-4123-97dc-6f823378d269 Jul 08 01:59:28 devstack sudo[103542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:29 devstack sudo[103542]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-86dc777e-8fb7-4c69-8b78-6dcf8ac35a25 req-1a054a6e-d901-48b0-8d5f-9bb3c8b42824 tempest-TestShelveInstance-426081337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1d15d46a-ee04-4123-97dc-6f823378d269" returned: 0 in 0.779s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:29 devstack cinder-volume[87134]: DEBUG cinder.coordination [req-86dc777e-8fb7-4c69-8b78-6dcf8ac35a25 req-1a054a6e-d901-48b0-8d5f-9bb3c8b42824 tempest-TestShelveInstance-426081337 None] Lock "cinder-quobyte-1d15d46a-ee04-4123-97dc-6f823378d269" released by "delete_volume" :: held 2.865s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:59:29 devstack cinder-volume[87134]: DEBUG cinder.quota [req-86dc777e-8fb7-4c69-8b78-6dcf8ac35a25 req-1a054a6e-d901-48b0-8d5f-9bb3c8b42824 tempest-TestShelveInstance-426081337 None] Created reservations ['9889b35f-8d0f-4437-820a-4f21a581899e', '27762b78-92c3-4833-b574-2a8818849d66', 'c1865db5-761a-4978-9c3f-fbef80758c4f', 'eb51b311-cb80-4f63-a6e0-46677e69ef3f'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:59:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-86dc777e-8fb7-4c69-8b78-6dcf8ac35a25 req-1a054a6e-d901-48b0-8d5f-9bb3c8b42824 tempest-TestShelveInstance-426081337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:59:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-86dc777e-8fb7-4c69-8b78-6dcf8ac35a25 req-1a054a6e-d901-48b0-8d5f-9bb3c8b42824 tempest-TestShelveInstance-426081337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:59:29 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [req-86dc777e-8fb7-4c69-8b78-6dcf8ac35a25 req-1a054a6e-d901-48b0-8d5f-9bb3c8b42824 tempest-TestShelveInstance-426081337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:59:29 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [req-86dc777e-8fb7-4c69-8b78-6dcf8ac35a25 req-1a054a6e-d901-48b0-8d5f-9bb3c8b42824 tempest-TestShelveInstance-426081337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:59:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-86dc777e-8fb7-4c69-8b78-6dcf8ac35a25 req-1a054a6e-d901-48b0-8d5f-9bb3c8b42824 tempest-TestShelveInstance-426081337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:59:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-86dc777e-8fb7-4c69-8b78-6dcf8ac35a25 req-1a054a6e-d901-48b0-8d5f-9bb3c8b42824 tempest-TestShelveInstance-426081337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:29 devstack sudo[103545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:59:29 devstack sudo[103545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:30 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b059777-2e26-43b9-aca9-a9bbc689cd31 tempest-CinderUnicodeTest-463139019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:59:30 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6b059777-2e26-43b9-aca9-a9bbc689cd31 tempest-CinderUnicodeTest-463139019 None] Flow 'volume_create_manager' (97301adf-52cb-40ee-8c02-3684c59d079e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:59:30 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6b059777-2e26-43b9-aca9-a9bbc689cd31 tempest-CinderUnicodeTest-463139019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c993410-8ba1-4f92-b4e6-f00c2c4757f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:59:30 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6b059777-2e26-43b9-aca9-a9bbc689cd31 tempest-CinderUnicodeTest-463139019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c993410-8ba1-4f92-b4e6-f00c2c4757f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:59:30Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a0f3db2-a33f-4084-81a2-5aea5e953fa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14251e3a47dc41838319150956a4d1c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:59:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:59:30Z,use_quota=True,user_id='3c38d25bc157485c87bbad8e356777fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:59:30 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6b059777-2e26-43b9-aca9-a9bbc689cd31 tempest-CinderUnicodeTest-463139019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (253f814d-f7fe-414a-ad09-120477180fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:59:30 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6b059777-2e26-43b9-aca9-a9bbc689cd31 tempest-CinderUnicodeTest-463139019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (253f814d-f7fe-414a-ad09-120477180fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:59:30 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6b059777-2e26-43b9-aca9-a9bbc689cd31 tempest-CinderUnicodeTest-463139019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (395c4979-625b-4045-9fa2-796919b4a107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:59:30 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6b059777-2e26-43b9-aca9-a9bbc689cd31 tempest-CinderUnicodeTest-463139019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (395c4979-625b-4045-9fa2-796919b4a107) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a0f3db2-a33f-4084-81a2-5aea5e953fa8', 'volume_name': 'volume-0a0f3db2-a33f-4084-81a2-5aea5e953fa8', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:59:30 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6b059777-2e26-43b9-aca9-a9bbc689cd31 tempest-CinderUnicodeTest-463139019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4638661-184f-401c-9356-144b62898452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:59:30 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6b059777-2e26-43b9-aca9-a9bbc689cd31 tempest-CinderUnicodeTest-463139019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4638661-184f-401c-9356-144b62898452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:59:30 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6b059777-2e26-43b9-aca9-a9bbc689cd31 tempest-CinderUnicodeTest-463139019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (025e4772-43b4-483e-8563-3da869b7fe6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:59:30 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-6b059777-2e26-43b9-aca9-a9bbc689cd31 tempest-CinderUnicodeTest-463139019 None] Volume 0a0f3db2-a33f-4084-81a2-5aea5e953fa8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a0f3db2-a33f-4084-81a2-5aea5e953fa8', 'volume_size': 1} Jul 08 01:59:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6b059777-2e26-43b9-aca9-a9bbc689cd31 tempest-CinderUnicodeTest-463139019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:59:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6b059777-2e26-43b9-aca9-a9bbc689cd31 tempest-CinderUnicodeTest-463139019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:59:30 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-6b059777-2e26-43b9-aca9-a9bbc689cd31 tempest-CinderUnicodeTest-463139019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:59:30Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a0f3db2-a33f-4084-81a2-5aea5e953fa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14251e3a47dc41838319150956a4d1c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:59:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:59:30Z,use_quota=True,user_id='3c38d25bc157485c87bbad8e356777fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:59:30 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-6b059777-2e26-43b9-aca9-a9bbc689cd31 tempest-CinderUnicodeTest-463139019 None] Creating volume 0a0f3db2-a33f-4084-81a2-5aea5e953fa8 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:59:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6b059777-2e26-43b9-aca9-a9bbc689cd31 tempest-CinderUnicodeTest-463139019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:59:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6b059777-2e26-43b9-aca9-a9bbc689cd31 tempest-CinderUnicodeTest-463139019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:59:30 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-6b059777-2e26-43b9-aca9-a9bbc689cd31 tempest-CinderUnicodeTest-463139019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:59:30 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-6b059777-2e26-43b9-aca9-a9bbc689cd31 tempest-CinderUnicodeTest-463139019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:59:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6b059777-2e26-43b9-aca9-a9bbc689cd31 tempest-CinderUnicodeTest-463139019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:59:30 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-6b059777-2e26-43b9-aca9-a9bbc689cd31 tempest-CinderUnicodeTest-463139019 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:59:30 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-6b059777-2e26-43b9-aca9-a9bbc689cd31 tempest-CinderUnicodeTest-463139019 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:59:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6b059777-2e26-43b9-aca9-a9bbc689cd31 tempest-CinderUnicodeTest-463139019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0a0f3db2-a33f-4084-81a2-5aea5e953fa8 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:30 devstack sudo[103547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0a0f3db2-a33f-4084-81a2-5aea5e953fa8 1073741824 Jul 08 01:59:30 devstack sudo[103547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:30 devstack sudo[103545]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-86dc777e-8fb7-4c69-8b78-6dcf8ac35a25 req-1a054a6e-d901-48b0-8d5f-9bb3c8b42824 tempest-TestShelveInstance-426081337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.814s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:30 devstack cinder-volume[87134]: DEBUG cinder.manager [req-86dc777e-8fb7-4c69-8b78-6dcf8ac35a25 req-1a054a6e-d901-48b0-8d5f-9bb3c8b42824 tempest-TestShelveInstance-426081337 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:59:30 devstack cinder-volume[87134]: INFO cinder.volume.manager [req-86dc777e-8fb7-4c69-8b78-6dcf8ac35a25 req-1a054a6e-d901-48b0-8d5f-9bb3c8b42824 tempest-TestShelveInstance-426081337 None] Deleted volume successfully. Jul 08 01:59:30 devstack cinder-volume[87134]: DEBUG cinder.coordination [req-86dc777e-8fb7-4c69-8b78-6dcf8ac35a25 req-1a054a6e-d901-48b0-8d5f-9bb3c8b42824 tempest-TestShelveInstance-426081337 None] Lock "cinder-1d15d46a-ee04-4123-97dc-6f823378d269-delete_volume" released by "delete_volume" :: held 3.990s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:59:31 devstack sudo[103547]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6b059777-2e26-43b9-aca9-a9bbc689cd31 tempest-CinderUnicodeTest-463139019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0a0f3db2-a33f-4084-81a2-5aea5e953fa8 1073741824" returned: 0 in 1.006s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6b059777-2e26-43b9-aca9-a9bbc689cd31 tempest-CinderUnicodeTest-463139019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0a0f3db2-a33f-4084-81a2-5aea5e953fa8 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:31 devstack sudo[103591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0a0f3db2-a33f-4084-81a2-5aea5e953fa8 Jul 08 01:59:31 devstack sudo[103591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:31 devstack sudo[103591]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6b059777-2e26-43b9-aca9-a9bbc689cd31 tempest-CinderUnicodeTest-463139019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0a0f3db2-a33f-4084-81a2-5aea5e953fa8" returned: 0 in 0.772s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:31 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-6b059777-2e26-43b9-aca9-a9bbc689cd31 tempest-CinderUnicodeTest-463139019 None] <== create_volume: return (1836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:59:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6b059777-2e26-43b9-aca9-a9bbc689cd31 tempest-CinderUnicodeTest-463139019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.839s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:59:32 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6b059777-2e26-43b9-aca9-a9bbc689cd31 tempest-CinderUnicodeTest-463139019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (025e4772-43b4-483e-8563-3da869b7fe6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a0f3db2-a33f-4084-81a2-5aea5e953fa8', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:59:32 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6b059777-2e26-43b9-aca9-a9bbc689cd31 tempest-CinderUnicodeTest-463139019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ef6b215-6732-4ea1-9777-1c189f82f6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:59:32 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-6b059777-2e26-43b9-aca9-a9bbc689cd31 tempest-CinderUnicodeTest-463139019 None] Volume volume-0a0f3db2-a33f-4084-81a2-5aea5e953fa8 (0a0f3db2-a33f-4084-81a2-5aea5e953fa8): created successfully Jul 08 01:59:32 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6b059777-2e26-43b9-aca9-a9bbc689cd31 tempest-CinderUnicodeTest-463139019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ef6b215-6732-4ea1-9777-1c189f82f6e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:59:32 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6b059777-2e26-43b9-aca9-a9bbc689cd31 tempest-CinderUnicodeTest-463139019 None] Flow 'volume_create_manager' (97301adf-52cb-40ee-8c02-3684c59d079e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:59:32 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-6b059777-2e26-43b9-aca9-a9bbc689cd31 tempest-CinderUnicodeTest-463139019 None] Created volume successfully. Jul 08 01:59:33 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-f480a1f0-4be5-4798-9118-7d85a2ceffbf tempest-CinderUnicodeTest-463139019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:59:33 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f480a1f0-4be5-4798-9118-7d85a2ceffbf tempest-CinderUnicodeTest-463139019 None] Flow 'volume_create_manager' (0b76ee62-a721-474e-8760-0acfcf956bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:59:33 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f480a1f0-4be5-4798-9118-7d85a2ceffbf tempest-CinderUnicodeTest-463139019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3904daad-57a5-483b-80ab-fe9c89b9b854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:59:34 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f480a1f0-4be5-4798-9118-7d85a2ceffbf tempest-CinderUnicodeTest-463139019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3904daad-57a5-483b-80ab-fe9c89b9b854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:59:33Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1140634886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ea49fbe-4a15-4f58-96cf-9f60f46dc369,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14251e3a47dc41838319150956a4d1c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:59:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:59:34Z,use_quota=True,user_id='3c38d25bc157485c87bbad8e356777fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:59:34 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f480a1f0-4be5-4798-9118-7d85a2ceffbf tempest-CinderUnicodeTest-463139019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a827c25c-3e96-4a5a-b93f-ddba2f710923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:59:34 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f480a1f0-4be5-4798-9118-7d85a2ceffbf tempest-CinderUnicodeTest-463139019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a827c25c-3e96-4a5a-b93f-ddba2f710923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:59:34 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f480a1f0-4be5-4798-9118-7d85a2ceffbf tempest-CinderUnicodeTest-463139019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a775d669-5195-4917-ba75-eeb6b198165a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:59:34 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f480a1f0-4be5-4798-9118-7d85a2ceffbf tempest-CinderUnicodeTest-463139019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a775d669-5195-4917-ba75-eeb6b198165a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ea49fbe-4a15-4f58-96cf-9f60f46dc369', 'volume_name': 'volume-1ea49fbe-4a15-4f58-96cf-9f60f46dc369', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:59:34 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f480a1f0-4be5-4798-9118-7d85a2ceffbf tempest-CinderUnicodeTest-463139019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80b4aa18-e664-4470-b3ac-3096170de032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:59:34 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f480a1f0-4be5-4798-9118-7d85a2ceffbf tempest-CinderUnicodeTest-463139019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80b4aa18-e664-4470-b3ac-3096170de032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:59:34 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f480a1f0-4be5-4798-9118-7d85a2ceffbf tempest-CinderUnicodeTest-463139019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6415fdca-b81f-4c7b-affb-80dcd5880ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:59:34 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-f480a1f0-4be5-4798-9118-7d85a2ceffbf tempest-CinderUnicodeTest-463139019 None] Volume 1ea49fbe-4a15-4f58-96cf-9f60f46dc369: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ea49fbe-4a15-4f58-96cf-9f60f46dc369', 'volume_size': 1} Jul 08 01:59:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-f480a1f0-4be5-4798-9118-7d85a2ceffbf tempest-CinderUnicodeTest-463139019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:59:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-f480a1f0-4be5-4798-9118-7d85a2ceffbf tempest-CinderUnicodeTest-463139019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:59:34 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-f480a1f0-4be5-4798-9118-7d85a2ceffbf tempest-CinderUnicodeTest-463139019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:59:33Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1140634886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ea49fbe-4a15-4f58-96cf-9f60f46dc369,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14251e3a47dc41838319150956a4d1c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:59:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:59:34Z,use_quota=True,user_id='3c38d25bc157485c87bbad8e356777fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:59:34 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-f480a1f0-4be5-4798-9118-7d85a2ceffbf tempest-CinderUnicodeTest-463139019 None] Creating volume 1ea49fbe-4a15-4f58-96cf-9f60f46dc369 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:59:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-f480a1f0-4be5-4798-9118-7d85a2ceffbf tempest-CinderUnicodeTest-463139019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:59:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-f480a1f0-4be5-4798-9118-7d85a2ceffbf tempest-CinderUnicodeTest-463139019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:59:34 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-f480a1f0-4be5-4798-9118-7d85a2ceffbf tempest-CinderUnicodeTest-463139019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:59:34 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-f480a1f0-4be5-4798-9118-7d85a2ceffbf tempest-CinderUnicodeTest-463139019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:59:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-f480a1f0-4be5-4798-9118-7d85a2ceffbf tempest-CinderUnicodeTest-463139019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:59:34 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-f480a1f0-4be5-4798-9118-7d85a2ceffbf tempest-CinderUnicodeTest-463139019 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:59:34 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-f480a1f0-4be5-4798-9118-7d85a2ceffbf tempest-CinderUnicodeTest-463139019 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:59:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f480a1f0-4be5-4798-9118-7d85a2ceffbf tempest-CinderUnicodeTest-463139019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1ea49fbe-4a15-4f58-96cf-9f60f46dc369 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:34 devstack sudo[103601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1ea49fbe-4a15-4f58-96cf-9f60f46dc369 1073741824 Jul 08 01:59:34 devstack sudo[103601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:35 devstack sudo[103601]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f480a1f0-4be5-4798-9118-7d85a2ceffbf tempest-CinderUnicodeTest-463139019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1ea49fbe-4a15-4f58-96cf-9f60f46dc369 1073741824" returned: 0 in 1.141s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f480a1f0-4be5-4798-9118-7d85a2ceffbf tempest-CinderUnicodeTest-463139019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1ea49fbe-4a15-4f58-96cf-9f60f46dc369 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:35 devstack sudo[103625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1ea49fbe-4a15-4f58-96cf-9f60f46dc369 Jul 08 01:59:35 devstack sudo[103625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:35 devstack sudo[103625]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f480a1f0-4be5-4798-9118-7d85a2ceffbf tempest-CinderUnicodeTest-463139019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1ea49fbe-4a15-4f58-96cf-9f60f46dc369" returned: 0 in 0.708s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:35 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-f480a1f0-4be5-4798-9118-7d85a2ceffbf tempest-CinderUnicodeTest-463139019 None] <== create_volume: return (1912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:59:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-f480a1f0-4be5-4798-9118-7d85a2ceffbf tempest-CinderUnicodeTest-463139019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.917s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:59:35 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f480a1f0-4be5-4798-9118-7d85a2ceffbf tempest-CinderUnicodeTest-463139019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6415fdca-b81f-4c7b-affb-80dcd5880ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ea49fbe-4a15-4f58-96cf-9f60f46dc369', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:59:36 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f480a1f0-4be5-4798-9118-7d85a2ceffbf tempest-CinderUnicodeTest-463139019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a961ee05-6d51-4669-972d-f6b016eecefe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:59:36 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-f480a1f0-4be5-4798-9118-7d85a2ceffbf tempest-CinderUnicodeTest-463139019 None] Volume volume-1ea49fbe-4a15-4f58-96cf-9f60f46dc369 (1ea49fbe-4a15-4f58-96cf-9f60f46dc369): created successfully Jul 08 01:59:36 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f480a1f0-4be5-4798-9118-7d85a2ceffbf tempest-CinderUnicodeTest-463139019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a961ee05-6d51-4669-972d-f6b016eecefe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:59:36 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f480a1f0-4be5-4798-9118-7d85a2ceffbf tempest-CinderUnicodeTest-463139019 None] Flow 'volume_create_manager' (0b76ee62-a721-474e-8760-0acfcf956bf5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:59:36 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-f480a1f0-4be5-4798-9118-7d85a2ceffbf tempest-CinderUnicodeTest-463139019 None] Created volume successfully. Jul 08 01:59:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e4686273-d1bd-4dd7-b8c8-810bc054e0de tempest-CinderUnicodeTest-463139019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:59:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e4686273-d1bd-4dd7-b8c8-810bc054e0de tempest-CinderUnicodeTest-463139019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:59:37 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-e4686273-d1bd-4dd7-b8c8-810bc054e0de tempest-CinderUnicodeTest-463139019 None] Creating offline snapshot dd35de90-0ac4-4111-b079-9e8d9cdd389c of volume 1ea49fbe-4a15-4f58-96cf-9f60f46dc369 {{(pid=87134) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:59:37 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c526cce-44bc-481b-afb7-37088f61c46c]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:59:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e4686273-d1bd-4dd7-b8c8-810bc054e0de tempest-CinderUnicodeTest-463139019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1ea49fbe-4a15-4f58-96cf-9f60f46dc369 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:37 devstack sudo[103629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1ea49fbe-4a15-4f58-96cf-9f60f46dc369 Jul 08 01:59:37 devstack sudo[103629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:38 devstack sudo[103629]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e4686273-d1bd-4dd7-b8c8-810bc054e0de tempest-CinderUnicodeTest-463139019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1ea49fbe-4a15-4f58-96cf-9f60f46dc369" returned: 0 in 0.952s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e4686273-d1bd-4dd7-b8c8-810bc054e0de tempest-CinderUnicodeTest-463139019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1ea49fbe-4a15-4f58-96cf-9f60f46dc369,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1ea49fbe-4a15-4f58-96cf-9f60f46dc369.dd35de90-0ac4-4111-b079-9e8d9cdd389c 1G {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:38 devstack sudo[103634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1ea49fbe-4a15-4f58-96cf-9f60f46dc369,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1ea49fbe-4a15-4f58-96cf-9f60f46dc369.dd35de90-0ac4-4111-b079-9e8d9cdd389c 1G Jul 08 01:59:38 devstack sudo[103634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:39 devstack sudo[103634]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e4686273-d1bd-4dd7-b8c8-810bc054e0de tempest-CinderUnicodeTest-463139019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1ea49fbe-4a15-4f58-96cf-9f60f46dc369,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1ea49fbe-4a15-4f58-96cf-9f60f46dc369.dd35de90-0ac4-4111-b079-9e8d9cdd389c 1G" returned: 0 in 1.322s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e4686273-d1bd-4dd7-b8c8-810bc054e0de tempest-CinderUnicodeTest-463139019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ea49fbe-4a15-4f58-96cf-9f60f46dc369 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1ea49fbe-4a15-4f58-96cf-9f60f46dc369.dd35de90-0ac4-4111-b079-9e8d9cdd389c {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:39 devstack sudo[103687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ea49fbe-4a15-4f58-96cf-9f60f46dc369 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1ea49fbe-4a15-4f58-96cf-9f60f46dc369.dd35de90-0ac4-4111-b079-9e8d9cdd389c Jul 08 01:59:39 devstack sudo[103687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:40 devstack sudo[103687]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e4686273-d1bd-4dd7-b8c8-810bc054e0de tempest-CinderUnicodeTest-463139019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ea49fbe-4a15-4f58-96cf-9f60f46dc369 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1ea49fbe-4a15-4f58-96cf-9f60f46dc369.dd35de90-0ac4-4111-b079-9e8d9cdd389c" returned: 0 in 0.797s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:40 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-e4686273-d1bd-4dd7-b8c8-810bc054e0de tempest-CinderUnicodeTest-463139019 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1ea49fbe-4a15-4f58-96cf-9f60f46dc369.dd35de90-0ac4-4111-b079-9e8d9cdd389c is being set with open permissions: ugo+rw Jul 08 01:59:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e4686273-d1bd-4dd7-b8c8-810bc054e0de tempest-CinderUnicodeTest-463139019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1ea49fbe-4a15-4f58-96cf-9f60f46dc369.dd35de90-0ac4-4111-b079-9e8d9cdd389c {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:40 devstack sudo[103693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1ea49fbe-4a15-4f58-96cf-9f60f46dc369.dd35de90-0ac4-4111-b079-9e8d9cdd389c Jul 08 01:59:40 devstack sudo[103693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:41 devstack sudo[103693]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e4686273-d1bd-4dd7-b8c8-810bc054e0de tempest-CinderUnicodeTest-463139019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1ea49fbe-4a15-4f58-96cf-9f60f46dc369.dd35de90-0ac4-4111-b079-9e8d9cdd389c" returned: 0 in 0.779s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e4686273-d1bd-4dd7-b8c8-810bc054e0de tempest-CinderUnicodeTest-463139019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1ea49fbe-4a15-4f58-96cf-9f60f46dc369.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:41 devstack sudo[103715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1ea49fbe-4a15-4f58-96cf-9f60f46dc369.info Jul 08 01:59:41 devstack sudo[103715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:42 devstack sudo[103715]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e4686273-d1bd-4dd7-b8c8-810bc054e0de tempest-CinderUnicodeTest-463139019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1ea49fbe-4a15-4f58-96cf-9f60f46dc369.info" returned: 0 in 0.793s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:42 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-e4686273-d1bd-4dd7-b8c8-810bc054e0de tempest-CinderUnicodeTest-463139019 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1ea49fbe-4a15-4f58-96cf-9f60f46dc369.info is being set with open permissions: ugo+rw Jul 08 01:59:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e4686273-d1bd-4dd7-b8c8-810bc054e0de tempest-CinderUnicodeTest-463139019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1ea49fbe-4a15-4f58-96cf-9f60f46dc369.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:42 devstack sudo[103720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1ea49fbe-4a15-4f58-96cf-9f60f46dc369.info Jul 08 01:59:42 devstack sudo[103720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:43 devstack sudo[103720]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e4686273-d1bd-4dd7-b8c8-810bc054e0de tempest-CinderUnicodeTest-463139019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1ea49fbe-4a15-4f58-96cf-9f60f46dc369.info" returned: 0 in 0.998s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e4686273-d1bd-4dd7-b8c8-810bc054e0de tempest-CinderUnicodeTest-463139019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.807s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:59:43 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-e4686273-d1bd-4dd7-b8c8-810bc054e0de tempest-CinderUnicodeTest-463139019 None] Create snapshot completed successfully Jul 08 01:59:43 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-19c9c34a-51a0-4a19-8c3c-c7ce1e6b160a tempest-CinderUnicodeTest-463139019 None] Acquiring lock "cinder-dd35de90-0ac4-4111-b079-9e8d9cdd389c-delete_snapshot" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:59:43 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-19c9c34a-51a0-4a19-8c3c-c7ce1e6b160a tempest-CinderUnicodeTest-463139019 None] Lock "cinder-dd35de90-0ac4-4111-b079-9e8d9cdd389c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:59:43 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-19c9c34a-51a0-4a19-8c3c-c7ce1e6b160a tempest-CinderUnicodeTest-463139019 None] Acquiring lock "cinder-quobyte-1ea49fbe-4a15-4f58-96cf-9f60f46dc369" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:59:43 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-19c9c34a-51a0-4a19-8c3c-c7ce1e6b160a tempest-CinderUnicodeTest-463139019 None] Lock "cinder-quobyte-1ea49fbe-4a15-4f58-96cf-9f60f46dc369" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:59:43 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-19c9c34a-51a0-4a19-8c3c-c7ce1e6b160a tempest-CinderUnicodeTest-463139019 None] Acquiring lock "cinder-quobyte-dd35de90-0ac4-4111-b079-9e8d9cdd389c" by "_delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:59:43 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-19c9c34a-51a0-4a19-8c3c-c7ce1e6b160a tempest-CinderUnicodeTest-463139019 None] Lock "cinder-quobyte-dd35de90-0ac4-4111-b079-9e8d9cdd389c" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:59:43 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-19c9c34a-51a0-4a19-8c3c-c7ce1e6b160a tempest-CinderUnicodeTest-463139019 None] Deleting offline snapshot dd35de90-0ac4-4111-b079-9e8d9cdd389c of volume 1ea49fbe-4a15-4f58-96cf-9f60f46dc369 {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:59:43 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-19c9c34a-51a0-4a19-8c3c-c7ce1e6b160a tempest-CinderUnicodeTest-463139019 None] snapshot_file for this snap is: volume-1ea49fbe-4a15-4f58-96cf-9f60f46dc369.dd35de90-0ac4-4111-b079-9e8d9cdd389c {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:59:43 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[10dbfe1b-20dd-4880-94d9-4fcf8978d8f0]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:59:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-19c9c34a-51a0-4a19-8c3c-c7ce1e6b160a tempest-CinderUnicodeTest-463139019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1ea49fbe-4a15-4f58-96cf-9f60f46dc369.dd35de90-0ac4-4111-b079-9e8d9cdd389c {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:44 devstack sudo[103724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1ea49fbe-4a15-4f58-96cf-9f60f46dc369.dd35de90-0ac4-4111-b079-9e8d9cdd389c Jul 08 01:59:44 devstack sudo[103724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:44 devstack sudo[103724]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-19c9c34a-51a0-4a19-8c3c-c7ce1e6b160a tempest-CinderUnicodeTest-463139019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1ea49fbe-4a15-4f58-96cf-9f60f46dc369.dd35de90-0ac4-4111-b079-9e8d9cdd389c" returned: 0 in 0.975s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:44 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-19c9c34a-51a0-4a19-8c3c-c7ce1e6b160a tempest-CinderUnicodeTest-463139019 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ea49fbe-4a15-4f58-96cf-9f60f46dc369(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:59:44 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db36874-061e-4276-8ebb-9ff101cc6bee]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:59:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-19c9c34a-51a0-4a19-8c3c-c7ce1e6b160a tempest-CinderUnicodeTest-463139019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1ea49fbe-4a15-4f58-96cf-9f60f46dc369 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:45 devstack sudo[103729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1ea49fbe-4a15-4f58-96cf-9f60f46dc369 Jul 08 01:59:45 devstack sudo[103729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:45 devstack sudo[103729]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-19c9c34a-51a0-4a19-8c3c-c7ce1e6b160a tempest-CinderUnicodeTest-463139019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1ea49fbe-4a15-4f58-96cf-9f60f46dc369" returned: 0 in 0.936s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-19c9c34a-51a0-4a19-8c3c-c7ce1e6b160a tempest-CinderUnicodeTest-463139019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1ea49fbe-4a15-4f58-96cf-9f60f46dc369.dd35de90-0ac4-4111-b079-9e8d9cdd389c {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:45 devstack sudo[103734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1ea49fbe-4a15-4f58-96cf-9f60f46dc369.dd35de90-0ac4-4111-b079-9e8d9cdd389c Jul 08 01:59:45 devstack sudo[103734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:46 devstack sudo[103734]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-19c9c34a-51a0-4a19-8c3c-c7ce1e6b160a tempest-CinderUnicodeTest-463139019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1ea49fbe-4a15-4f58-96cf-9f60f46dc369.dd35de90-0ac4-4111-b079-9e8d9cdd389c" returned: 0 in 0.800s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-19c9c34a-51a0-4a19-8c3c-c7ce1e6b160a tempest-CinderUnicodeTest-463139019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1ea49fbe-4a15-4f58-96cf-9f60f46dc369.dd35de90-0ac4-4111-b079-9e8d9cdd389c {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:46 devstack sudo[103751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1ea49fbe-4a15-4f58-96cf-9f60f46dc369.dd35de90-0ac4-4111-b079-9e8d9cdd389c Jul 08 01:59:46 devstack sudo[103751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:47 devstack sudo[103751]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-19c9c34a-51a0-4a19-8c3c-c7ce1e6b160a tempest-CinderUnicodeTest-463139019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1ea49fbe-4a15-4f58-96cf-9f60f46dc369.dd35de90-0ac4-4111-b079-9e8d9cdd389c" returned: 0 in 0.859s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:47 devstack cinder-volume[87134]: DEBUG dbcounter [-] [87134] Writing DB stats cinder:UPDATE=128,cinder:DELETE=11,cinder:SELECT=88,cinder:INSERT=52 {{(pid=87134) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:59:47 devstack cinder-volume[87134]: DEBUG dbcounter [-] [87134] Writing DB stats cinder:SELECT=102,cinder:UPDATE=121,cinder:INSERT=29,cinder:DELETE=9 {{(pid=87134) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:59:47 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-19c9c34a-51a0-4a19-8c3c-c7ce1e6b160a tempest-CinderUnicodeTest-463139019 None] Lock "cinder-quobyte-dd35de90-0ac4-4111-b079-9e8d9cdd389c" released by "_delete_snapshot" :: held 3.764s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:59:47 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-19c9c34a-51a0-4a19-8c3c-c7ce1e6b160a tempest-CinderUnicodeTest-463139019 None] Lock "cinder-quobyte-1ea49fbe-4a15-4f58-96cf-9f60f46dc369" released by "delete_snapshot" :: held 3.814s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:59:47 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-19c9c34a-51a0-4a19-8c3c-c7ce1e6b160a tempest-CinderUnicodeTest-463139019 None] Created reservations ['531ee6e2-5f98-456d-879c-15b1f60d17fc', '489f30a9-25de-49e5-bb76-7af2f2d60443', '6b68debd-20ac-400c-a6e6-c126394b1cfa', '791562a7-f841-4588-b287-acfcc127f967'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:59:47 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-19c9c34a-51a0-4a19-8c3c-c7ce1e6b160a tempest-CinderUnicodeTest-463139019 None] Delete snapshot completed successfully. Jul 08 01:59:47 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-19c9c34a-51a0-4a19-8c3c-c7ce1e6b160a tempest-CinderUnicodeTest-463139019 None] Lock "cinder-dd35de90-0ac4-4111-b079-9e8d9cdd389c-delete_snapshot" released by "delete_snapshot" :: held 3.991s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:59:48 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-4ce41dd0-475f-4792-9a37-4db6cc2df221 tempest-CinderUnicodeTest-463139019 None] Acquiring lock "cinder-1ea49fbe-4a15-4f58-96cf-9f60f46dc369-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:59:48 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-4ce41dd0-475f-4792-9a37-4db6cc2df221 tempest-CinderUnicodeTest-463139019 None] Lock "cinder-1ea49fbe-4a15-4f58-96cf-9f60f46dc369-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:59:48 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-4ce41dd0-475f-4792-9a37-4db6cc2df221 tempest-CinderUnicodeTest-463139019 None] Acquiring lock "cinder-quobyte-1ea49fbe-4a15-4f58-96cf-9f60f46dc369" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:59:48 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-4ce41dd0-475f-4792-9a37-4db6cc2df221 tempest-CinderUnicodeTest-463139019 None] Lock "cinder-quobyte-1ea49fbe-4a15-4f58-96cf-9f60f46dc369" acquired by "delete_volume" :: waited 0.022s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:59:48 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b118cc-68e0-4ce9-a184-3558cdd4ddf6]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:59:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4ce41dd0-475f-4792-9a37-4db6cc2df221 tempest-CinderUnicodeTest-463139019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1ea49fbe-4a15-4f58-96cf-9f60f46dc369 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:48 devstack sudo[103767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1ea49fbe-4a15-4f58-96cf-9f60f46dc369 Jul 08 01:59:48 devstack sudo[103767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:48 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2f70b05-6f68-4b2d-9b12-dccfabba5a52 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:59:48 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e2f70b05-6f68-4b2d-9b12-dccfabba5a52 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] Flow 'volume_create_manager' (eae75eed-28df-4360-a53c-dcfdb3f5c9b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:59:48 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e2f70b05-6f68-4b2d-9b12-dccfabba5a52 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccd466d0-d604-4d27-88a4-5fd462d115a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:59:48 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e2f70b05-6f68-4b2d-9b12-dccfabba5a52 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccd466d0-d604-4d27-88a4-5fd462d115a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:59:49Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d04cbd2-0d2f-40ae-b3eb-29c4be9f3673,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='499c3c4597144f778497457ec80c0052',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:59:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:59:49Z,use_quota=True,user_id='694558d7ab724424b4d2fc65a7883082',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1c0f019-13a2-467a-a8db-357169086812),volume_type_id=c1c0f019-13a2-467a-a8db-357169086812)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:59:48 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e2f70b05-6f68-4b2d-9b12-dccfabba5a52 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36c94781-b73e-4e1b-bbd4-0042a912841f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:59:48 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e2f70b05-6f68-4b2d-9b12-dccfabba5a52 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36c94781-b73e-4e1b-bbd4-0042a912841f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:59:48 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e2f70b05-6f68-4b2d-9b12-dccfabba5a52 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f5ddf40-b75e-471b-a792-23697c979c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:59:48 devstack cinder-volume[87134]: DEBUG cinder.image.glance [None req-e2f70b05-6f68-4b2d-9b12-dccfabba5a52 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] Creating Keystone auth plugin from conf {{(pid=87134) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 01:59:49 devstack sudo[103767]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:49 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4ce41dd0-475f-4792-9a37-4db6cc2df221 tempest-CinderUnicodeTest-463139019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1ea49fbe-4a15-4f58-96cf-9f60f46dc369" returned: 0 in 0.897s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:49 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4ce41dd0-475f-4792-9a37-4db6cc2df221 tempest-CinderUnicodeTest-463139019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1ea49fbe-4a15-4f58-96cf-9f60f46dc369 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:49 devstack sudo[103772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1ea49fbe-4a15-4f58-96cf-9f60f46dc369 Jul 08 01:59:49 devstack sudo[103772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:49 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e2f70b05-6f68-4b2d-9b12-dccfabba5a52 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f5ddf40-b75e-471b-a792-23697c979c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0d04cbd2-0d2f-40ae-b3eb-29c4be9f3673', 'volume_name': 'volume-0d04cbd2-0d2f-40ae-b3eb-29c4be9f3673', 'volume_size': 1, 'image_id': '3a4c01e1-d261-4b05-870f-16fae0b2528e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3a4c01e1-d261-4b05-870f-16fae0b2528e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0952d21624805601332b15a01599d526', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '499c3c4597144f778497457ec80c0052', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '45c3446451e3fc0da4c4915cb1d86a9b5ae9ae57755c9f723e711bde1963030d2ca27493c908142e669658c0a123c94eed25145ad3573dc63b0e5384b949cecf', 'id': '3a4c01e1-d261-4b05-870f-16fae0b2528e', 'created_at': datetime.datetime(2026, 7, 7, 23, 59, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 59, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3a4c01e1-d261-4b05-870f-16fae0b2528e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:59:49 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e2f70b05-6f68-4b2d-9b12-dccfabba5a52 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45b4707d-ea44-41d2-95fa-04f5c06059c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:59:49 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e2f70b05-6f68-4b2d-9b12-dccfabba5a52 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45b4707d-ea44-41d2-95fa-04f5c06059c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:59:49 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e2f70b05-6f68-4b2d-9b12-dccfabba5a52 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3922ec83-90d7-4334-85a4-15933a050967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:59:49 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-e2f70b05-6f68-4b2d-9b12-dccfabba5a52 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] Volume 0d04cbd2-0d2f-40ae-b3eb-29c4be9f3673: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0d04cbd2-0d2f-40ae-b3eb-29c4be9f3673', 'volume_size': 1, 'image_id': '3a4c01e1-d261-4b05-870f-16fae0b2528e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3a4c01e1-d261-4b05-870f-16fae0b2528e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0952d21624805601332b15a01599d526', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '499c3c4597144f778497457ec80c0052', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '45c3446451e3fc0da4c4915cb1d86a9b5ae9ae57755c9f723e711bde1963030d2ca27493c908142e669658c0a123c94eed25145ad3573dc63b0e5384b949cecf', 'id': '3a4c01e1-d261-4b05-870f-16fae0b2528e', 'created_at': datetime.datetime(2026, 7, 7, 23, 59, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 59, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3a4c01e1-d261-4b05-870f-16fae0b2528e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 08 01:59:49 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2f70b05-6f68-4b2d-9b12-dccfabba5a52 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] Trying to clone 0d04cbd2-0d2f-40ae-b3eb-29c4be9f3673 from image 3a4c01e1-d261-4b05-870f-16fae0b2528e at location (None, [{'url': 'file:///opt/stack/data/glance/images/3a4c01e1-d261-4b05-870f-16fae0b2528e', 'metadata': {}}]). {{(pid=87134) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 01:59:49 devstack cinder-volume[87134]: DEBUG cinder.image.image_utils [None req-e2f70b05-6f68-4b2d-9b12-dccfabba5a52 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3a4c01e1-d261-4b05-870f-16fae0b2528e_vii0bebfdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87134) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 01:59:49 devstack cinder-volume[87134]: INFO cinder.image.image_utils [None req-e2f70b05-6f68-4b2d-9b12-dccfabba5a52 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] Image download 0.00 MB at 0.00 MB/s Jul 08 01:59:49 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac46d4bf-f88f-457d-a2ac-094601542f3c]: (4, 'raw') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:59:49 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e2f70b05-6f68-4b2d-9b12-dccfabba5a52 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3a4c01e1-d261-4b05-870f-16fae0b2528e_vii0bebfdevstack@QuobyteHD {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:49 devstack sudo[103774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3a4c01e1-d261-4b05-870f-16fae0b2528e_vii0bebfdevstack@QuobyteHD Jul 08 01:59:49 devstack sudo[103774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:49 devstack sudo[103772]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:49 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4ce41dd0-475f-4792-9a37-4db6cc2df221 tempest-CinderUnicodeTest-463139019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1ea49fbe-4a15-4f58-96cf-9f60f46dc369" returned: 0 in 0.688s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:49 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-4ce41dd0-475f-4792-9a37-4db6cc2df221 tempest-CinderUnicodeTest-463139019 None] Lock "cinder-quobyte-1ea49fbe-4a15-4f58-96cf-9f60f46dc369" released by "delete_volume" :: held 1.654s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:59:49 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-4ce41dd0-475f-4792-9a37-4db6cc2df221 tempest-CinderUnicodeTest-463139019 None] Created reservations ['7356d28b-16b3-43f0-a7f0-3628c3ec31fd', 'c0094eed-3453-430b-ad7b-6724472d7c11', '01ce057b-f1e1-4d57-bdcc-880a3c97c56a', '26144e6f-1281-4976-bc6d-594617178e7d'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:59:50 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-4ce41dd0-475f-4792-9a37-4db6cc2df221 tempest-CinderUnicodeTest-463139019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:59:50 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-4ce41dd0-475f-4792-9a37-4db6cc2df221 tempest-CinderUnicodeTest-463139019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:59:50 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-4ce41dd0-475f-4792-9a37-4db6cc2df221 tempest-CinderUnicodeTest-463139019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:59:50 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-4ce41dd0-475f-4792-9a37-4db6cc2df221 tempest-CinderUnicodeTest-463139019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:59:50 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-4ce41dd0-475f-4792-9a37-4db6cc2df221 tempest-CinderUnicodeTest-463139019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:59:50 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4ce41dd0-475f-4792-9a37-4db6cc2df221 tempest-CinderUnicodeTest-463139019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:50 devstack sudo[103777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:59:50 devstack sudo[103777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:50 devstack sudo[103774]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:50 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e2f70b05-6f68-4b2d-9b12-dccfabba5a52 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3a4c01e1-d261-4b05-870f-16fae0b2528e_vii0bebfdevstack@QuobyteHD" returned: 0 in 0.828s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:50 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e2f70b05-6f68-4b2d-9b12-dccfabba5a52 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3a4c01e1-d261-4b05-870f-16fae0b2528e_vii0bebfdevstack@QuobyteHD {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:50 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-5b081b7f-6c55-43b1-8aee-49d45ca1712e tempest-CinderUnicodeTest-463139019 None] Acquiring lock "cinder-0a0f3db2-a33f-4084-81a2-5aea5e953fa8-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:59:50 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-5b081b7f-6c55-43b1-8aee-49d45ca1712e tempest-CinderUnicodeTest-463139019 None] Lock "cinder-0a0f3db2-a33f-4084-81a2-5aea5e953fa8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:59:50 devstack sudo[103781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3a4c01e1-d261-4b05-870f-16fae0b2528e_vii0bebfdevstack@QuobyteHD Jul 08 01:59:50 devstack sudo[103781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:50 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-5b081b7f-6c55-43b1-8aee-49d45ca1712e tempest-CinderUnicodeTest-463139019 None] Acquiring lock "cinder-quobyte-0a0f3db2-a33f-4084-81a2-5aea5e953fa8" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:59:50 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-5b081b7f-6c55-43b1-8aee-49d45ca1712e tempest-CinderUnicodeTest-463139019 None] Lock "cinder-quobyte-0a0f3db2-a33f-4084-81a2-5aea5e953fa8" acquired by "delete_volume" :: waited 0.022s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:59:50 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64753ae-5aae-4bcd-930c-131d0733a98b]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:59:50 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5b081b7f-6c55-43b1-8aee-49d45ca1712e tempest-CinderUnicodeTest-463139019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0a0f3db2-a33f-4084-81a2-5aea5e953fa8 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:50 devstack sudo[103783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0a0f3db2-a33f-4084-81a2-5aea5e953fa8 Jul 08 01:59:50 devstack sudo[103783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:50 devstack sudo[103777]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:50 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4ce41dd0-475f-4792-9a37-4db6cc2df221 tempest-CinderUnicodeTest-463139019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.700s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:50 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-4ce41dd0-475f-4792-9a37-4db6cc2df221 tempest-CinderUnicodeTest-463139019 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:59:50 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-4ce41dd0-475f-4792-9a37-4db6cc2df221 tempest-CinderUnicodeTest-463139019 None] Deleted volume successfully. Jul 08 01:59:50 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-4ce41dd0-475f-4792-9a37-4db6cc2df221 tempest-CinderUnicodeTest-463139019 None] Lock "cinder-1ea49fbe-4a15-4f58-96cf-9f60f46dc369-delete_volume" released by "delete_volume" :: held 2.652s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:59:51 devstack sudo[103781]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e2f70b05-6f68-4b2d-9b12-dccfabba5a52 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3a4c01e1-d261-4b05-870f-16fae0b2528e_vii0bebfdevstack@QuobyteHD" returned: 1 in 0.842s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e2f70b05-6f68-4b2d-9b12-dccfabba5a52 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3a4c01e1-d261-4b05-870f-16fae0b2528e_vii0bebfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:59:51 devstack cinder-volume[87134]: DEBUG cinder.image.image_utils [None req-e2f70b05-6f68-4b2d-9b12-dccfabba5a52 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] Temporary image 3a4c01e1-d261-4b05-870f-16fae0b2528e is fetched for user 694558d7ab724424b4d2fc65a7883082. {{(pid=87134) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 01:59:51 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[726bb5ed-13e5-48a7-817e-8c632295395b]: (4, 'raw') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:59:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e2f70b05-6f68-4b2d-9b12-dccfabba5a52 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3a4c01e1-d261-4b05-870f-16fae0b2528e_vii0bebfdevstack@QuobyteHD {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:51 devstack sudo[103789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3a4c01e1-d261-4b05-870f-16fae0b2528e_vii0bebfdevstack@QuobyteHD Jul 08 01:59:51 devstack sudo[103789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:51 devstack sudo[103783]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5b081b7f-6c55-43b1-8aee-49d45ca1712e tempest-CinderUnicodeTest-463139019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0a0f3db2-a33f-4084-81a2-5aea5e953fa8" returned: 0 in 0.893s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5b081b7f-6c55-43b1-8aee-49d45ca1712e tempest-CinderUnicodeTest-463139019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0a0f3db2-a33f-4084-81a2-5aea5e953fa8 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:51 devstack sudo[103795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0a0f3db2-a33f-4084-81a2-5aea5e953fa8 Jul 08 01:59:51 devstack sudo[103795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:52 devstack sudo[103789]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:52 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e2f70b05-6f68-4b2d-9b12-dccfabba5a52 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3a4c01e1-d261-4b05-870f-16fae0b2528e_vii0bebfdevstack@QuobyteHD" returned: 0 in 0.821s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:52 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e2f70b05-6f68-4b2d-9b12-dccfabba5a52 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3a4c01e1-d261-4b05-870f-16fae0b2528e_vii0bebfdevstack@QuobyteHD {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:52 devstack sudo[103795]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:52 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5b081b7f-6c55-43b1-8aee-49d45ca1712e tempest-CinderUnicodeTest-463139019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0a0f3db2-a33f-4084-81a2-5aea5e953fa8" returned: 0 in 0.700s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:52 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-5b081b7f-6c55-43b1-8aee-49d45ca1712e tempest-CinderUnicodeTest-463139019 None] Lock "cinder-quobyte-0a0f3db2-a33f-4084-81a2-5aea5e953fa8" released by "delete_volume" :: held 1.638s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:59:52 devstack sudo[103800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3a4c01e1-d261-4b05-870f-16fae0b2528e_vii0bebfdevstack@QuobyteHD Jul 08 01:59:52 devstack sudo[103800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:52 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-5b081b7f-6c55-43b1-8aee-49d45ca1712e tempest-CinderUnicodeTest-463139019 None] Created reservations ['a77e1d38-ed9c-4120-b416-79bd6632dad3', '562d9796-87fa-429e-b00a-3455435752d3', 'f868dc4f-4846-46fa-a323-11dbc28391e4', '4e99995e-7f95-4f61-a0ac-306f6d4d44a7'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:59:52 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5b081b7f-6c55-43b1-8aee-49d45ca1712e tempest-CinderUnicodeTest-463139019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:59:52 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5b081b7f-6c55-43b1-8aee-49d45ca1712e tempest-CinderUnicodeTest-463139019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:59:52 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-5b081b7f-6c55-43b1-8aee-49d45ca1712e tempest-CinderUnicodeTest-463139019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:59:52 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-5b081b7f-6c55-43b1-8aee-49d45ca1712e tempest-CinderUnicodeTest-463139019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:59:52 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5b081b7f-6c55-43b1-8aee-49d45ca1712e tempest-CinderUnicodeTest-463139019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:59:52 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5b081b7f-6c55-43b1-8aee-49d45ca1712e tempest-CinderUnicodeTest-463139019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:52 devstack sudo[103802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 01:59:52 devstack sudo[103802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:52 devstack sudo[103800]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:52 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e2f70b05-6f68-4b2d-9b12-dccfabba5a52 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3a4c01e1-d261-4b05-870f-16fae0b2528e_vii0bebfdevstack@QuobyteHD" returned: 1 in 0.828s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:52 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e2f70b05-6f68-4b2d-9b12-dccfabba5a52 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3a4c01e1-d261-4b05-870f-16fae0b2528e_vii0bebfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:59:52 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e2f70b05-6f68-4b2d-9b12-dccfabba5a52 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:59:52 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e2f70b05-6f68-4b2d-9b12-dccfabba5a52 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:59:52 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-e2f70b05-6f68-4b2d-9b12-dccfabba5a52 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:59:49Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d04cbd2-0d2f-40ae-b3eb-29c4be9f3673,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='499c3c4597144f778497457ec80c0052',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:59:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:59:49Z,use_quota=True,user_id='694558d7ab724424b4d2fc65a7883082',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1c0f019-13a2-467a-a8db-357169086812),volume_type_id=c1c0f019-13a2-467a-a8db-357169086812)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:59:52 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-e2f70b05-6f68-4b2d-9b12-dccfabba5a52 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] Creating volume 0d04cbd2-0d2f-40ae-b3eb-29c4be9f3673 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:59:52 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e2f70b05-6f68-4b2d-9b12-dccfabba5a52 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:59:52 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e2f70b05-6f68-4b2d-9b12-dccfabba5a52 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:59:52 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-e2f70b05-6f68-4b2d-9b12-dccfabba5a52 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:59:52 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-e2f70b05-6f68-4b2d-9b12-dccfabba5a52 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:59:52 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e2f70b05-6f68-4b2d-9b12-dccfabba5a52 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:59:52 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-e2f70b05-6f68-4b2d-9b12-dccfabba5a52 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:59:52 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-e2f70b05-6f68-4b2d-9b12-dccfabba5a52 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 01:59:52 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e2f70b05-6f68-4b2d-9b12-dccfabba5a52 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0d04cbd2-0d2f-40ae-b3eb-29c4be9f3673 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:52 devstack sudo[103808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0d04cbd2-0d2f-40ae-b3eb-29c4be9f3673 1073741824 Jul 08 01:59:52 devstack sudo[103808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:53 devstack sudo[103802]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5b081b7f-6c55-43b1-8aee-49d45ca1712e tempest-CinderUnicodeTest-463139019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.878s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:53 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-5b081b7f-6c55-43b1-8aee-49d45ca1712e tempest-CinderUnicodeTest-463139019 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:59:53 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-5b081b7f-6c55-43b1-8aee-49d45ca1712e tempest-CinderUnicodeTest-463139019 None] Deleted volume successfully. Jul 08 01:59:53 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-5b081b7f-6c55-43b1-8aee-49d45ca1712e tempest-CinderUnicodeTest-463139019 None] Lock "cinder-0a0f3db2-a33f-4084-81a2-5aea5e953fa8-delete_volume" released by "delete_volume" :: held 2.818s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:59:53 devstack sudo[103808]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e2f70b05-6f68-4b2d-9b12-dccfabba5a52 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0d04cbd2-0d2f-40ae-b3eb-29c4be9f3673 1073741824" returned: 0 in 1.061s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e2f70b05-6f68-4b2d-9b12-dccfabba5a52 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0d04cbd2-0d2f-40ae-b3eb-29c4be9f3673 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:54 devstack sudo[103815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0d04cbd2-0d2f-40ae-b3eb-29c4be9f3673 Jul 08 01:59:54 devstack sudo[103815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:54 devstack sudo[103815]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e2f70b05-6f68-4b2d-9b12-dccfabba5a52 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0d04cbd2-0d2f-40ae-b3eb-29c4be9f3673" returned: 0 in 0.752s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:54 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-e2f70b05-6f68-4b2d-9b12-dccfabba5a52 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] <== create_volume: return (1874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:59:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e2f70b05-6f68-4b2d-9b12-dccfabba5a52 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.881s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:59:54 devstack cinder-volume[87134]: DEBUG cinder.volume.volume_utils [None req-e2f70b05-6f68-4b2d-9b12-dccfabba5a52 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] Attempting download of 3a4c01e1-d261-4b05-870f-16fae0b2528e ((None, [{'url': 'file:///opt/stack/data/glance/images/3a4c01e1-d261-4b05-870f-16fae0b2528e', 'metadata': {}}])) to volume 0d04cbd2-0d2f-40ae-b3eb-29c4be9f3673. {{(pid=87134) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 01:59:54 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f89ce6-d481-481c-bbc7-6c17db69d937]: (4, 'raw') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:59:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e2f70b05-6f68-4b2d-9b12-dccfabba5a52 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3a4c01e1-d261-4b05-870f-16fae0b2528e_voynu0t0 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:54 devstack sudo[103818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3a4c01e1-d261-4b05-870f-16fae0b2528e_voynu0t0 Jul 08 01:59:54 devstack sudo[103818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:55 devstack sudo[103818]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:55 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e2f70b05-6f68-4b2d-9b12-dccfabba5a52 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3a4c01e1-d261-4b05-870f-16fae0b2528e_voynu0t0" returned: 0 in 0.765s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:55 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e2f70b05-6f68-4b2d-9b12-dccfabba5a52 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3a4c01e1-d261-4b05-870f-16fae0b2528e_voynu0t0 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:55 devstack sudo[103824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3a4c01e1-d261-4b05-870f-16fae0b2528e_voynu0t0 Jul 08 01:59:55 devstack sudo[103824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:56 devstack sudo[103824]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:56 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e2f70b05-6f68-4b2d-9b12-dccfabba5a52 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3a4c01e1-d261-4b05-870f-16fae0b2528e_voynu0t0" returned: 1 in 0.817s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:56 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e2f70b05-6f68-4b2d-9b12-dccfabba5a52 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3a4c01e1-d261-4b05-870f-16fae0b2528e_voynu0t0' failed. Not Retrying. {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:59:56 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[3573a73e-cbf3-4c01-b219-e63e598fe89f]: (4, 'raw') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:59:56 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e2f70b05-6f68-4b2d-9b12-dccfabba5a52 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3a4c01e1-d261-4b05-870f-16fae0b2528e_vii0bebfdevstack@QuobyteHD {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:56 devstack sudo[103828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3a4c01e1-d261-4b05-870f-16fae0b2528e_vii0bebfdevstack@QuobyteHD Jul 08 01:59:56 devstack sudo[103828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:57 devstack sudo[103828]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:57 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e2f70b05-6f68-4b2d-9b12-dccfabba5a52 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3a4c01e1-d261-4b05-870f-16fae0b2528e_vii0bebfdevstack@QuobyteHD" returned: 0 in 0.921s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:57 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e2f70b05-6f68-4b2d-9b12-dccfabba5a52 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3a4c01e1-d261-4b05-870f-16fae0b2528e_vii0bebfdevstack@QuobyteHD {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:57 devstack sudo[103832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3a4c01e1-d261-4b05-870f-16fae0b2528e_vii0bebfdevstack@QuobyteHD Jul 08 01:59:57 devstack sudo[103832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:58 devstack sudo[103832]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:58 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e2f70b05-6f68-4b2d-9b12-dccfabba5a52 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3a4c01e1-d261-4b05-870f-16fae0b2528e_vii0bebfdevstack@QuobyteHD" returned: 1 in 0.806s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:58 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e2f70b05-6f68-4b2d-9b12-dccfabba5a52 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3a4c01e1-d261-4b05-870f-16fae0b2528e_vii0bebfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:59:58 devstack cinder-volume[87134]: DEBUG cinder.image.image_utils [None req-e2f70b05-6f68-4b2d-9b12-dccfabba5a52 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] 3a4c01e1-d261-4b05-870f-16fae0b2528e was raw, converting to raw {{(pid=87134) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 01:59:58 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e2f70b05-6f68-4b2d-9b12-dccfabba5a52 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_3a4c01e1-d261-4b05-870f-16fae0b2528e_vii0bebfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0d04cbd2-0d2f-40ae-b3eb-29c4be9f3673 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:58 devstack sudo[103837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_3a4c01e1-d261-4b05-870f-16fae0b2528e_vii0bebfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0d04cbd2-0d2f-40ae-b3eb-29c4be9f3673 Jul 08 01:59:58 devstack sudo[103837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:59 devstack sudo[103837]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e2f70b05-6f68-4b2d-9b12-dccfabba5a52 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_3a4c01e1-d261-4b05-870f-16fae0b2528e_vii0bebfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0d04cbd2-0d2f-40ae-b3eb-29c4be9f3673" returned: 0 in 0.925s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:59 devstack cinder-volume[87134]: DEBUG cinder.image.image_utils [None req-e2f70b05-6f68-4b2d-9b12-dccfabba5a52 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3a4c01e1-d261-4b05-870f-16fae0b2528e_vii0bebfdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0d04cbd2-0d2f-40ae-b3eb-29c4be9f3673 {{(pid=87134) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:59:59 devstack cinder-volume[87134]: INFO cinder.image.image_utils [None req-e2f70b05-6f68-4b2d-9b12-dccfabba5a52 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] Converted 0.00 MB image at 0.00 MB/s Jul 08 01:59:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e2f70b05-6f68-4b2d-9b12-dccfabba5a52 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0d04cbd2-0d2f-40ae-b3eb-29c4be9f3673 1G {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:59 devstack sudo[103842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0d04cbd2-0d2f-40ae-b3eb-29c4be9f3673 1G Jul 08 01:59:59 devstack sudo[103842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:59 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-20a85ffe-2f17-4b19-85b7-343c859292ea tempest-VolumesNegativeTest-988989842 None] Acquiring lock "cinder-9da0e124-c0ec-4fa2-a3aa-452975eb16eb-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:59:59 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-20a85ffe-2f17-4b19-85b7-343c859292ea tempest-VolumesNegativeTest-988989842 None] Lock "cinder-9da0e124-c0ec-4fa2-a3aa-452975eb16eb-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:59:59 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-20a85ffe-2f17-4b19-85b7-343c859292ea tempest-VolumesNegativeTest-988989842 None] Acquiring lock "cinder-quobyte-9da0e124-c0ec-4fa2-a3aa-452975eb16eb" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:59:59 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-20a85ffe-2f17-4b19-85b7-343c859292ea tempest-VolumesNegativeTest-988989842 None] Lock "cinder-quobyte-9da0e124-c0ec-4fa2-a3aa-452975eb16eb" acquired by "delete_volume" :: waited 0.023s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:59:59 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0d6c31-cf17-498b-808d-ae78cf105a14]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:59:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-20a85ffe-2f17-4b19-85b7-343c859292ea tempest-VolumesNegativeTest-988989842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9da0e124-c0ec-4fa2-a3aa-452975eb16eb {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:59:59 devstack sudo[103844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9da0e124-c0ec-4fa2-a3aa-452975eb16eb Jul 08 01:59:59 devstack sudo[103844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:59:59 devstack sudo[103842]: pam_unix(sudo:session): session closed for user root Jul 08 01:59:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e2f70b05-6f68-4b2d-9b12-dccfabba5a52 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0d04cbd2-0d2f-40ae-b3eb-29c4be9f3673 1G" returned: 0 in 0.798s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:59:59 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d6dc67-c08d-4af2-b7fe-cc4a360f3d7c]: (4, 'raw') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:59:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e2f70b05-6f68-4b2d-9b12-dccfabba5a52 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0d04cbd2-0d2f-40ae-b3eb-29c4be9f3673 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:00:00 devstack sudo[103849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0d04cbd2-0d2f-40ae-b3eb-29c4be9f3673 Jul 08 02:00:00 devstack sudo[103849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:00:00 devstack sudo[103844]: pam_unix(sudo:session): session closed for user root Jul 08 02:00:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-20a85ffe-2f17-4b19-85b7-343c859292ea tempest-VolumesNegativeTest-988989842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9da0e124-c0ec-4fa2-a3aa-452975eb16eb" returned: 0 in 0.869s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:00:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-20a85ffe-2f17-4b19-85b7-343c859292ea tempest-VolumesNegativeTest-988989842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9da0e124-c0ec-4fa2-a3aa-452975eb16eb {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:00:00 devstack sudo[103854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9da0e124-c0ec-4fa2-a3aa-452975eb16eb Jul 08 02:00:00 devstack sudo[103854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:00:00 devstack sudo[103849]: pam_unix(sudo:session): session closed for user root Jul 08 02:00:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e2f70b05-6f68-4b2d-9b12-dccfabba5a52 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0d04cbd2-0d2f-40ae-b3eb-29c4be9f3673" returned: 0 in 0.825s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:00:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e2f70b05-6f68-4b2d-9b12-dccfabba5a52 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0d04cbd2-0d2f-40ae-b3eb-29c4be9f3673 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:00:00 devstack sudo[103858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0d04cbd2-0d2f-40ae-b3eb-29c4be9f3673 Jul 08 02:00:00 devstack sudo[103858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:00:01 devstack sudo[103854]: pam_unix(sudo:session): session closed for user root Jul 08 02:00:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-20a85ffe-2f17-4b19-85b7-343c859292ea tempest-VolumesNegativeTest-988989842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9da0e124-c0ec-4fa2-a3aa-452975eb16eb" returned: 0 in 0.659s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:00:01 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-20a85ffe-2f17-4b19-85b7-343c859292ea tempest-VolumesNegativeTest-988989842 None] Lock "cinder-quobyte-9da0e124-c0ec-4fa2-a3aa-452975eb16eb" released by "delete_volume" :: held 1.576s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:00:01 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-20a85ffe-2f17-4b19-85b7-343c859292ea tempest-VolumesNegativeTest-988989842 None] Created reservations ['271c18d4-2740-452a-af14-4a17a3fc5ba3', '28776a76-3f0f-4a49-9799-2973b5939645', '06d72979-64da-4bab-b0bf-1c9fe999f33d', 'f515e59d-bb0a-4096-b21d-7e33856cccb0'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:00:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-20a85ffe-2f17-4b19-85b7-343c859292ea tempest-VolumesNegativeTest-988989842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:00:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-20a85ffe-2f17-4b19-85b7-343c859292ea tempest-VolumesNegativeTest-988989842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:00:01 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-20a85ffe-2f17-4b19-85b7-343c859292ea tempest-VolumesNegativeTest-988989842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:00:01 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-20a85ffe-2f17-4b19-85b7-343c859292ea tempest-VolumesNegativeTest-988989842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:00:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-20a85ffe-2f17-4b19-85b7-343c859292ea tempest-VolumesNegativeTest-988989842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:00:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-20a85ffe-2f17-4b19-85b7-343c859292ea tempest-VolumesNegativeTest-988989842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:00:01 devstack sudo[103861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 02:00:01 devstack sudo[103861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:00:01 devstack sudo[103858]: pam_unix(sudo:session): session closed for user root Jul 08 02:00:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e2f70b05-6f68-4b2d-9b12-dccfabba5a52 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0d04cbd2-0d2f-40ae-b3eb-29c4be9f3673" returned: 1 in 0.800s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:00:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e2f70b05-6f68-4b2d-9b12-dccfabba5a52 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0d04cbd2-0d2f-40ae-b3eb-29c4be9f3673' failed. Not Retrying. {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 02:00:01 devstack cinder-volume[87134]: DEBUG cinder.volume.volume_utils [None req-e2f70b05-6f68-4b2d-9b12-dccfabba5a52 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] Downloaded image 3a4c01e1-d261-4b05-870f-16fae0b2528e ((None, [{'url': 'file:///opt/stack/data/glance/images/3a4c01e1-d261-4b05-870f-16fae0b2528e', 'metadata': {}}])) to volume 0d04cbd2-0d2f-40ae-b3eb-29c4be9f3673 successfully. {{(pid=87134) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 02:00:01 devstack cinder-volume[87134]: DEBUG cinder.image.image_utils [None req-e2f70b05-6f68-4b2d-9b12-dccfabba5a52 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] Temporary image 3a4c01e1-d261-4b05-870f-16fae0b2528e for user 694558d7ab724424b4d2fc65a7883082 is deleted. {{(pid=87134) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 02:00:01 devstack cinder-volume[87134]: DEBUG cinder.volume.volume_utils [None req-e2f70b05-6f68-4b2d-9b12-dccfabba5a52 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] Marking volume 0d04cbd2-0d2f-40ae-b3eb-29c4be9f3673 as bootable. {{(pid=87134) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 02:00:01 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2f70b05-6f68-4b2d-9b12-dccfabba5a52 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] Copying metadata from image 3a4c01e1-d261-4b05-870f-16fae0b2528e to 0d04cbd2-0d2f-40ae-b3eb-29c4be9f3673. {{(pid=87134) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 02:00:01 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2f70b05-6f68-4b2d-9b12-dccfabba5a52 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] Creating volume glance metadata for volume 0d04cbd2-0d2f-40ae-b3eb-29c4be9f3673 backed by image 3a4c01e1-d261-4b05-870f-16fae0b2528e with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '3a4c01e1-d261-4b05-870f-16fae0b2528e', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '0952d21624805601332b15a01599d526', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87134) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 02:00:01 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e2f70b05-6f68-4b2d-9b12-dccfabba5a52 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3922ec83-90d7-4334-85a4-15933a050967) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d04cbd2-0d2f-40ae-b3eb-29c4be9f3673', 'volume_size': 1, 'image_id': '3a4c01e1-d261-4b05-870f-16fae0b2528e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3a4c01e1-d261-4b05-870f-16fae0b2528e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0952d21624805601332b15a01599d526', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '499c3c4597144f778497457ec80c0052', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '45c3446451e3fc0da4c4915cb1d86a9b5ae9ae57755c9f723e711bde1963030d2ca27493c908142e669658c0a123c94eed25145ad3573dc63b0e5384b949cecf', 'id': '3a4c01e1-d261-4b05-870f-16fae0b2528e', 'created_at': datetime.datetime(2026, 7, 7, 23, 59, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 59, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3a4c01e1-d261-4b05-870f-16fae0b2528e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:00:01 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e2f70b05-6f68-4b2d-9b12-dccfabba5a52 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3c861f4-f138-448c-8cec-98c49edf49de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:00:01 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-e2f70b05-6f68-4b2d-9b12-dccfabba5a52 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] Volume volume-0d04cbd2-0d2f-40ae-b3eb-29c4be9f3673 (0d04cbd2-0d2f-40ae-b3eb-29c4be9f3673): created successfully Jul 08 02:00:01 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e2f70b05-6f68-4b2d-9b12-dccfabba5a52 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3c861f4-f138-448c-8cec-98c49edf49de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:00:01 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e2f70b05-6f68-4b2d-9b12-dccfabba5a52 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] Flow 'volume_create_manager' (eae75eed-28df-4360-a53c-dcfdb3f5c9b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:00:01 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-e2f70b05-6f68-4b2d-9b12-dccfabba5a52 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] Created volume successfully. Jul 08 02:00:01 devstack sudo[103861]: pam_unix(sudo:session): session closed for user root Jul 08 02:00:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-20a85ffe-2f17-4b19-85b7-343c859292ea tempest-VolumesNegativeTest-988989842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.711s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:00:01 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-20a85ffe-2f17-4b19-85b7-343c859292ea tempest-VolumesNegativeTest-988989842 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:00:01 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-20a85ffe-2f17-4b19-85b7-343c859292ea tempest-VolumesNegativeTest-988989842 None] Deleted volume successfully. Jul 08 02:00:02 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-20a85ffe-2f17-4b19-85b7-343c859292ea tempest-VolumesNegativeTest-988989842 None] Lock "cinder-9da0e124-c0ec-4fa2-a3aa-452975eb16eb-delete_volume" released by "delete_volume" :: held 2.535s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:00:02 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-339d8c8c-955f-4f06-acf0-a4327891c2f0 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] Acquiring lock "cinder-0d04cbd2-0d2f-40ae-b3eb-29c4be9f3673-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:00:02 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-339d8c8c-955f-4f06-acf0-a4327891c2f0 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] Lock "cinder-0d04cbd2-0d2f-40ae-b3eb-29c4be9f3673-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:00:02 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-339d8c8c-955f-4f06-acf0-a4327891c2f0 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] Acquiring lock "cinder-quobyte-0d04cbd2-0d2f-40ae-b3eb-29c4be9f3673" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:00:02 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-339d8c8c-955f-4f06-acf0-a4327891c2f0 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] Lock "cinder-quobyte-0d04cbd2-0d2f-40ae-b3eb-29c4be9f3673" acquired by "delete_volume" :: waited 0.018s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:00:03 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73d624a-d1ce-496b-bc9d-4b0d0170b8bf]: (4, 'raw') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:00:03 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-339d8c8c-955f-4f06-acf0-a4327891c2f0 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0d04cbd2-0d2f-40ae-b3eb-29c4be9f3673 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:00:03 devstack sudo[103868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0d04cbd2-0d2f-40ae-b3eb-29c4be9f3673 Jul 08 02:00:03 devstack sudo[103868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:00:03 devstack sudo[103868]: pam_unix(sudo:session): session closed for user root Jul 08 02:00:03 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-339d8c8c-955f-4f06-acf0-a4327891c2f0 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0d04cbd2-0d2f-40ae-b3eb-29c4be9f3673" returned: 0 in 0.809s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:00:03 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-339d8c8c-955f-4f06-acf0-a4327891c2f0 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0d04cbd2-0d2f-40ae-b3eb-29c4be9f3673 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:00:03 devstack sudo[103872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0d04cbd2-0d2f-40ae-b3eb-29c4be9f3673 Jul 08 02:00:03 devstack sudo[103872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:00:04 devstack sudo[103872]: pam_unix(sudo:session): session closed for user root Jul 08 02:00:04 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-339d8c8c-955f-4f06-acf0-a4327891c2f0 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0d04cbd2-0d2f-40ae-b3eb-29c4be9f3673" returned: 1 in 0.822s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:00:04 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-339d8c8c-955f-4f06-acf0-a4327891c2f0 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0d04cbd2-0d2f-40ae-b3eb-29c4be9f3673' failed. Not Retrying. {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 02:00:04 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-339d8c8c-955f-4f06-acf0-a4327891c2f0 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0d04cbd2-0d2f-40ae-b3eb-29c4be9f3673 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:00:04 devstack sudo[103877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0d04cbd2-0d2f-40ae-b3eb-29c4be9f3673 Jul 08 02:00:04 devstack sudo[103877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:00:05 devstack sudo[103877]: pam_unix(sudo:session): session closed for user root Jul 08 02:00:05 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-339d8c8c-955f-4f06-acf0-a4327891c2f0 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0d04cbd2-0d2f-40ae-b3eb-29c4be9f3673" returned: 0 in 0.697s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:00:05 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-339d8c8c-955f-4f06-acf0-a4327891c2f0 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] Lock "cinder-quobyte-0d04cbd2-0d2f-40ae-b3eb-29c4be9f3673" released by "delete_volume" :: held 2.408s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:00:05 devstack cinder-volume[87134]: WARNING cinder.quota [None req-339d8c8c-955f-4f06-acf0-a4327891c2f0 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 08 02:00:05 devstack cinder-volume[87134]: WARNING cinder.quota [None req-339d8c8c-955f-4f06-acf0-a4327891c2f0 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 08 02:00:05 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-339d8c8c-955f-4f06-acf0-a4327891c2f0 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] Created reservations ['f7211927-2f6a-4319-bd09-39cb9372acfe', '1122e141-09a2-4e54-abc5-7c22ca83870a', '0b41d336-299e-4470-a397-5e7b798e4cf0', 'f0a900dd-8c41-4686-b193-b7c67ed6c40a'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:00:05 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-339d8c8c-955f-4f06-acf0-a4327891c2f0 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:00:05 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-339d8c8c-955f-4f06-acf0-a4327891c2f0 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:00:05 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-339d8c8c-955f-4f06-acf0-a4327891c2f0 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:00:05 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-339d8c8c-955f-4f06-acf0-a4327891c2f0 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:00:05 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-339d8c8c-955f-4f06-acf0-a4327891c2f0 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:00:05 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-339d8c8c-955f-4f06-acf0-a4327891c2f0 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:00:05 devstack sudo[103880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 02:00:05 devstack sudo[103880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:00:06 devstack sudo[103880]: pam_unix(sudo:session): session closed for user root Jul 08 02:00:06 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-339d8c8c-955f-4f06-acf0-a4327891c2f0 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.694s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:00:06 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-339d8c8c-955f-4f06-acf0-a4327891c2f0 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:00:06 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-339d8c8c-955f-4f06-acf0-a4327891c2f0 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] Deleted volume successfully. Jul 08 02:00:06 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-339d8c8c-955f-4f06-acf0-a4327891c2f0 tempest-VolumeAndVolumeTypeFromImageTest-413480038 None] Lock "cinder-0d04cbd2-0d2f-40ae-b3eb-29c4be9f3673-delete_volume" released by "delete_volume" :: held 3.333s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:00:11 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c110a5d-ac3c-4d8b-9be5-177c749fd2ae tempest-CreateVolumesFromImageTest-2003055711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:00:11 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5c110a5d-ac3c-4d8b-9be5-177c749fd2ae tempest-CreateVolumesFromImageTest-2003055711 None] Flow 'volume_create_manager' (e82c4daa-eb7f-4456-b072-82c392f4cb57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:00:11 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5c110a5d-ac3c-4d8b-9be5-177c749fd2ae tempest-CreateVolumesFromImageTest-2003055711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbfd12b0-09f0-47d0-8b49-272f66103ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:00:11 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5c110a5d-ac3c-4d8b-9be5-177c749fd2ae tempest-CreateVolumesFromImageTest-2003055711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbfd12b0-09f0-47d0-8b49-272f66103ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:00:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1590414235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d0320f1-7273-4ad8-9f3a-d596a83cc62e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bebb74b71e7491b9adb86ae74c6cc50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:00:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:00:11Z,use_quota=True,user_id='3522356b559948449e38dffebf1dfcbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:00:11 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5c110a5d-ac3c-4d8b-9be5-177c749fd2ae tempest-CreateVolumesFromImageTest-2003055711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c647019a-1f2f-4512-912a-f00b6b00f6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:00:11 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5c110a5d-ac3c-4d8b-9be5-177c749fd2ae tempest-CreateVolumesFromImageTest-2003055711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c647019a-1f2f-4512-912a-f00b6b00f6a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:00:11 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5c110a5d-ac3c-4d8b-9be5-177c749fd2ae tempest-CreateVolumesFromImageTest-2003055711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5ea1000-c21b-41a9-8ea8-51a5cf6f3bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:00:11 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5c110a5d-ac3c-4d8b-9be5-177c749fd2ae tempest-CreateVolumesFromImageTest-2003055711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5ea1000-c21b-41a9-8ea8-51a5cf6f3bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d0320f1-7273-4ad8-9f3a-d596a83cc62e', 'volume_name': 'volume-9d0320f1-7273-4ad8-9f3a-d596a83cc62e', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:00:11 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5c110a5d-ac3c-4d8b-9be5-177c749fd2ae tempest-CreateVolumesFromImageTest-2003055711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3538dc3d-afeb-4bd6-ab15-4df3cfaceca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:00:11 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5c110a5d-ac3c-4d8b-9be5-177c749fd2ae tempest-CreateVolumesFromImageTest-2003055711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3538dc3d-afeb-4bd6-ab15-4df3cfaceca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:00:11 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5c110a5d-ac3c-4d8b-9be5-177c749fd2ae tempest-CreateVolumesFromImageTest-2003055711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ec77ec6-f2de-4814-a63b-150a5c29bb5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:00:11 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-5c110a5d-ac3c-4d8b-9be5-177c749fd2ae tempest-CreateVolumesFromImageTest-2003055711 None] Volume 9d0320f1-7273-4ad8-9f3a-d596a83cc62e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d0320f1-7273-4ad8-9f3a-d596a83cc62e', 'volume_size': 1} Jul 08 02:00:11 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5c110a5d-ac3c-4d8b-9be5-177c749fd2ae tempest-CreateVolumesFromImageTest-2003055711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:00:11 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5c110a5d-ac3c-4d8b-9be5-177c749fd2ae tempest-CreateVolumesFromImageTest-2003055711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:00:11 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-5c110a5d-ac3c-4d8b-9be5-177c749fd2ae tempest-CreateVolumesFromImageTest-2003055711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:00:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1590414235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d0320f1-7273-4ad8-9f3a-d596a83cc62e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bebb74b71e7491b9adb86ae74c6cc50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:00:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:00:11Z,use_quota=True,user_id='3522356b559948449e38dffebf1dfcbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:00:11 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-5c110a5d-ac3c-4d8b-9be5-177c749fd2ae tempest-CreateVolumesFromImageTest-2003055711 None] Creating volume 9d0320f1-7273-4ad8-9f3a-d596a83cc62e {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:00:11 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5c110a5d-ac3c-4d8b-9be5-177c749fd2ae tempest-CreateVolumesFromImageTest-2003055711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:00:11 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5c110a5d-ac3c-4d8b-9be5-177c749fd2ae tempest-CreateVolumesFromImageTest-2003055711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:00:11 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-5c110a5d-ac3c-4d8b-9be5-177c749fd2ae tempest-CreateVolumesFromImageTest-2003055711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:00:11 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-5c110a5d-ac3c-4d8b-9be5-177c749fd2ae tempest-CreateVolumesFromImageTest-2003055711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:00:11 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5c110a5d-ac3c-4d8b-9be5-177c749fd2ae tempest-CreateVolumesFromImageTest-2003055711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:00:11 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-5c110a5d-ac3c-4d8b-9be5-177c749fd2ae tempest-CreateVolumesFromImageTest-2003055711 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:00:11 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-5c110a5d-ac3c-4d8b-9be5-177c749fd2ae tempest-CreateVolumesFromImageTest-2003055711 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 02:00:11 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5c110a5d-ac3c-4d8b-9be5-177c749fd2ae tempest-CreateVolumesFromImageTest-2003055711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9d0320f1-7273-4ad8-9f3a-d596a83cc62e 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:00:11 devstack sudo[103890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9d0320f1-7273-4ad8-9f3a-d596a83cc62e 1073741824 Jul 08 02:00:11 devstack sudo[103890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:00:11 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-04cc1572-cec0-4094-927a-53ca4d61e9db tempest-CreateVolumesFromImageTest-2003055711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:00:11 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-04cc1572-cec0-4094-927a-53ca4d61e9db tempest-CreateVolumesFromImageTest-2003055711 None] Flow 'volume_create_manager' (a388c0c0-52da-4875-816f-02f9d6d78887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:00:11 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-04cc1572-cec0-4094-927a-53ca4d61e9db tempest-CreateVolumesFromImageTest-2003055711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf40d04b-ebdc-43f0-88de-b2b5e81f3c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:00:11 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-04cc1572-cec0-4094-927a-53ca4d61e9db tempest-CreateVolumesFromImageTest-2003055711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf40d04b-ebdc-43f0-88de-b2b5e81f3c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:00:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-133662972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eacae33a-9278-4b38-a584-719fd70e6fdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bebb74b71e7491b9adb86ae74c6cc50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:00:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:00:12Z,use_quota=True,user_id='3522356b559948449e38dffebf1dfcbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:00:11 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-04cc1572-cec0-4094-927a-53ca4d61e9db tempest-CreateVolumesFromImageTest-2003055711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97b86f2a-7c90-4bbf-8edd-af85b0c6c7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:00:11 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-04cc1572-cec0-4094-927a-53ca4d61e9db tempest-CreateVolumesFromImageTest-2003055711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97b86f2a-7c90-4bbf-8edd-af85b0c6c7f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:00:11 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-04cc1572-cec0-4094-927a-53ca4d61e9db tempest-CreateVolumesFromImageTest-2003055711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4fe3b46-532e-4047-aedb-e905a636390c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:00:11 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-04cc1572-cec0-4094-927a-53ca4d61e9db tempest-CreateVolumesFromImageTest-2003055711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4fe3b46-532e-4047-aedb-e905a636390c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eacae33a-9278-4b38-a584-719fd70e6fdd', 'volume_name': 'volume-eacae33a-9278-4b38-a584-719fd70e6fdd', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:00:11 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-04cc1572-cec0-4094-927a-53ca4d61e9db tempest-CreateVolumesFromImageTest-2003055711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98409ff9-2b33-4df2-a17e-576397869c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:00:11 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-04cc1572-cec0-4094-927a-53ca4d61e9db tempest-CreateVolumesFromImageTest-2003055711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98409ff9-2b33-4df2-a17e-576397869c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:00:11 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-04cc1572-cec0-4094-927a-53ca4d61e9db tempest-CreateVolumesFromImageTest-2003055711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cfa91fa-a339-4e54-9cbc-93087f463080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:00:11 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-04cc1572-cec0-4094-927a-53ca4d61e9db tempest-CreateVolumesFromImageTest-2003055711 None] Volume eacae33a-9278-4b38-a584-719fd70e6fdd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eacae33a-9278-4b38-a584-719fd70e6fdd', 'volume_size': 1} Jul 08 02:00:11 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-04cc1572-cec0-4094-927a-53ca4d61e9db tempest-CreateVolumesFromImageTest-2003055711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:00:12 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-21c31319-e54e-4e2d-882b-29a3b8ed7c4c tempest-CreateVolumesFromImageTest-2003055711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:00:12 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-21c31319-e54e-4e2d-882b-29a3b8ed7c4c tempest-CreateVolumesFromImageTest-2003055711 None] Flow 'volume_create_manager' (e2269f48-c39b-4f7f-9e41-38a56ff19a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:00:12 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-21c31319-e54e-4e2d-882b-29a3b8ed7c4c tempest-CreateVolumesFromImageTest-2003055711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (801fb9c7-848d-4f63-b67a-0fe4eb5745e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:00:12 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-21c31319-e54e-4e2d-882b-29a3b8ed7c4c tempest-CreateVolumesFromImageTest-2003055711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (801fb9c7-848d-4f63-b67a-0fe4eb5745e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:00:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1787054544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a0fe696-10ab-49ab-907e-9254f3840e69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bebb74b71e7491b9adb86ae74c6cc50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:00:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:00:12Z,use_quota=True,user_id='3522356b559948449e38dffebf1dfcbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:00:12 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-21c31319-e54e-4e2d-882b-29a3b8ed7c4c tempest-CreateVolumesFromImageTest-2003055711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fc8f8d3-a67a-442e-ab58-379e14bf0012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:00:12 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-21c31319-e54e-4e2d-882b-29a3b8ed7c4c tempest-CreateVolumesFromImageTest-2003055711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fc8f8d3-a67a-442e-ab58-379e14bf0012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:00:12 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-21c31319-e54e-4e2d-882b-29a3b8ed7c4c tempest-CreateVolumesFromImageTest-2003055711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd70d998-58c3-49c1-9b02-89e21a382cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:00:12 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-21c31319-e54e-4e2d-882b-29a3b8ed7c4c tempest-CreateVolumesFromImageTest-2003055711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd70d998-58c3-49c1-9b02-89e21a382cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a0fe696-10ab-49ab-907e-9254f3840e69', 'volume_name': 'volume-7a0fe696-10ab-49ab-907e-9254f3840e69', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:00:12 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-21c31319-e54e-4e2d-882b-29a3b8ed7c4c tempest-CreateVolumesFromImageTest-2003055711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (780d56d0-17a3-462a-992e-32d72d42514c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:00:12 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-21c31319-e54e-4e2d-882b-29a3b8ed7c4c tempest-CreateVolumesFromImageTest-2003055711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (780d56d0-17a3-462a-992e-32d72d42514c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:00:12 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-21c31319-e54e-4e2d-882b-29a3b8ed7c4c tempest-CreateVolumesFromImageTest-2003055711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22d461f0-3c42-4e89-802f-7d0791dd1eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:00:12 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-21c31319-e54e-4e2d-882b-29a3b8ed7c4c tempest-CreateVolumesFromImageTest-2003055711 None] Volume 7a0fe696-10ab-49ab-907e-9254f3840e69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a0fe696-10ab-49ab-907e-9254f3840e69', 'volume_size': 1} Jul 08 02:00:12 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-21c31319-e54e-4e2d-882b-29a3b8ed7c4c tempest-CreateVolumesFromImageTest-2003055711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:00:12 devstack sudo[103890]: pam_unix(sudo:session): session closed for user root Jul 08 02:00:12 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5c110a5d-ac3c-4d8b-9be5-177c749fd2ae tempest-CreateVolumesFromImageTest-2003055711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9d0320f1-7273-4ad8-9f3a-d596a83cc62e 1073741824" returned: 0 in 1.467s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:00:12 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5c110a5d-ac3c-4d8b-9be5-177c749fd2ae tempest-CreateVolumesFromImageTest-2003055711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9d0320f1-7273-4ad8-9f3a-d596a83cc62e {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:00:12 devstack sudo[103896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9d0320f1-7273-4ad8-9f3a-d596a83cc62e Jul 08 02:00:12 devstack sudo[103896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:00:13 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e62689c-6007-457c-a420-028f525d89b5 tempest-CreateVolumesFromImageTest-2003055711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:00:13 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5e62689c-6007-457c-a420-028f525d89b5 tempest-CreateVolumesFromImageTest-2003055711 None] Flow 'volume_create_manager' (831cd68f-6ca3-4755-a286-a179613d9022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:00:13 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5e62689c-6007-457c-a420-028f525d89b5 tempest-CreateVolumesFromImageTest-2003055711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d793689-1abc-4204-bbb2-9c648f309be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:00:13 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5e62689c-6007-457c-a420-028f525d89b5 tempest-CreateVolumesFromImageTest-2003055711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d793689-1abc-4204-bbb2-9c648f309be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:00:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2051805209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=683bfb14-322b-40d8-b206-12b0643e2484,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bebb74b71e7491b9adb86ae74c6cc50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:00:13Z,use_quota=True,user_id='3522356b559948449e38dffebf1dfcbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:00:13 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5e62689c-6007-457c-a420-028f525d89b5 tempest-CreateVolumesFromImageTest-2003055711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48a56209-e864-4b85-b5d7-f839af64f8fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:00:13 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5e62689c-6007-457c-a420-028f525d89b5 tempest-CreateVolumesFromImageTest-2003055711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48a56209-e864-4b85-b5d7-f839af64f8fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:00:13 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5e62689c-6007-457c-a420-028f525d89b5 tempest-CreateVolumesFromImageTest-2003055711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (602648c7-db9a-41a5-8410-b5c2491c596c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:00:13 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5e62689c-6007-457c-a420-028f525d89b5 tempest-CreateVolumesFromImageTest-2003055711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (602648c7-db9a-41a5-8410-b5c2491c596c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '683bfb14-322b-40d8-b206-12b0643e2484', 'volume_name': 'volume-683bfb14-322b-40d8-b206-12b0643e2484', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:00:13 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5e62689c-6007-457c-a420-028f525d89b5 tempest-CreateVolumesFromImageTest-2003055711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (040026a7-33b6-4023-8ed8-bc8f658c1808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:00:13 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5e62689c-6007-457c-a420-028f525d89b5 tempest-CreateVolumesFromImageTest-2003055711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (040026a7-33b6-4023-8ed8-bc8f658c1808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:00:13 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5e62689c-6007-457c-a420-028f525d89b5 tempest-CreateVolumesFromImageTest-2003055711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd333f20-c9a4-40a6-b9c2-613f42699215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:00:13 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-5e62689c-6007-457c-a420-028f525d89b5 tempest-CreateVolumesFromImageTest-2003055711 None] Volume 683bfb14-322b-40d8-b206-12b0643e2484: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-683bfb14-322b-40d8-b206-12b0643e2484', 'volume_size': 1} Jul 08 02:00:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5e62689c-6007-457c-a420-028f525d89b5 tempest-CreateVolumesFromImageTest-2003055711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:00:13 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-27a46a48-5291-42aa-b4a5-e39c48087d53 tempest-CreateVolumesFromImageTest-2003055711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:00:13 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-27a46a48-5291-42aa-b4a5-e39c48087d53 tempest-CreateVolumesFromImageTest-2003055711 None] Flow 'volume_create_manager' (577f69a1-c83b-4ad2-9126-9e4b57b8ac58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:00:13 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-27a46a48-5291-42aa-b4a5-e39c48087d53 tempest-CreateVolumesFromImageTest-2003055711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05bd677e-26f7-4b84-9299-7de91ab46961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:00:13 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-27a46a48-5291-42aa-b4a5-e39c48087d53 tempest-CreateVolumesFromImageTest-2003055711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05bd677e-26f7-4b84-9299-7de91ab46961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:00:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-958964720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b25507de-5c75-483a-8073-dc9824ec7024,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bebb74b71e7491b9adb86ae74c6cc50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:00:13Z,use_quota=True,user_id='3522356b559948449e38dffebf1dfcbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:00:13 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-27a46a48-5291-42aa-b4a5-e39c48087d53 tempest-CreateVolumesFromImageTest-2003055711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea7c6e05-b456-4812-86f6-8ae851cfadaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:00:13 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-27a46a48-5291-42aa-b4a5-e39c48087d53 tempest-CreateVolumesFromImageTest-2003055711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea7c6e05-b456-4812-86f6-8ae851cfadaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:00:13 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-27a46a48-5291-42aa-b4a5-e39c48087d53 tempest-CreateVolumesFromImageTest-2003055711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7c704db-796f-47c5-b8d4-6bcd381d19df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:00:13 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-27a46a48-5291-42aa-b4a5-e39c48087d53 tempest-CreateVolumesFromImageTest-2003055711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7c704db-796f-47c5-b8d4-6bcd381d19df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b25507de-5c75-483a-8073-dc9824ec7024', 'volume_name': 'volume-b25507de-5c75-483a-8073-dc9824ec7024', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:00:13 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-27a46a48-5291-42aa-b4a5-e39c48087d53 tempest-CreateVolumesFromImageTest-2003055711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb02f820-0626-4434-b799-3e191b3735d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:00:13 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-27a46a48-5291-42aa-b4a5-e39c48087d53 tempest-CreateVolumesFromImageTest-2003055711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb02f820-0626-4434-b799-3e191b3735d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:00:13 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-27a46a48-5291-42aa-b4a5-e39c48087d53 tempest-CreateVolumesFromImageTest-2003055711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fec49580-b5c0-4f2e-8e73-76526ed577be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:00:13 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-27a46a48-5291-42aa-b4a5-e39c48087d53 tempest-CreateVolumesFromImageTest-2003055711 None] Volume b25507de-5c75-483a-8073-dc9824ec7024: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b25507de-5c75-483a-8073-dc9824ec7024', 'volume_size': 1} Jul 08 02:00:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-27a46a48-5291-42aa-b4a5-e39c48087d53 tempest-CreateVolumesFromImageTest-2003055711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:00:13 devstack sudo[103896]: pam_unix(sudo:session): session closed for user root Jul 08 02:00:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5c110a5d-ac3c-4d8b-9be5-177c749fd2ae tempest-CreateVolumesFromImageTest-2003055711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9d0320f1-7273-4ad8-9f3a-d596a83cc62e" returned: 0 in 0.969s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:00:13 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-5c110a5d-ac3c-4d8b-9be5-177c749fd2ae tempest-CreateVolumesFromImageTest-2003055711 None] <== create_volume: return (2511ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:00:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5c110a5d-ac3c-4d8b-9be5-177c749fd2ae tempest-CreateVolumesFromImageTest-2003055711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.514s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:00:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-04cc1572-cec0-4094-927a-53ca4d61e9db tempest-CreateVolumesFromImageTest-2003055711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.839s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:00:13 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-04cc1572-cec0-4094-927a-53ca4d61e9db tempest-CreateVolumesFromImageTest-2003055711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:00:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-133662972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eacae33a-9278-4b38-a584-719fd70e6fdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bebb74b71e7491b9adb86ae74c6cc50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:00:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:00:12Z,use_quota=True,user_id='3522356b559948449e38dffebf1dfcbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:00:13 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-04cc1572-cec0-4094-927a-53ca4d61e9db tempest-CreateVolumesFromImageTest-2003055711 None] Creating volume eacae33a-9278-4b38-a584-719fd70e6fdd {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:00:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-04cc1572-cec0-4094-927a-53ca4d61e9db tempest-CreateVolumesFromImageTest-2003055711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:00:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-04cc1572-cec0-4094-927a-53ca4d61e9db tempest-CreateVolumesFromImageTest-2003055711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:00:13 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-04cc1572-cec0-4094-927a-53ca4d61e9db tempest-CreateVolumesFromImageTest-2003055711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:00:13 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-04cc1572-cec0-4094-927a-53ca4d61e9db tempest-CreateVolumesFromImageTest-2003055711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:00:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-04cc1572-cec0-4094-927a-53ca4d61e9db tempest-CreateVolumesFromImageTest-2003055711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:00:13 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-04cc1572-cec0-4094-927a-53ca4d61e9db tempest-CreateVolumesFromImageTest-2003055711 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:00:13 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-04cc1572-cec0-4094-927a-53ca4d61e9db tempest-CreateVolumesFromImageTest-2003055711 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 02:00:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-04cc1572-cec0-4094-927a-53ca4d61e9db tempest-CreateVolumesFromImageTest-2003055711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-eacae33a-9278-4b38-a584-719fd70e6fdd 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:00:13 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5c110a5d-ac3c-4d8b-9be5-177c749fd2ae tempest-CreateVolumesFromImageTest-2003055711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ec77ec6-f2de-4814-a63b-150a5c29bb5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d0320f1-7273-4ad8-9f3a-d596a83cc62e', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:00:13 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5c110a5d-ac3c-4d8b-9be5-177c749fd2ae tempest-CreateVolumesFromImageTest-2003055711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0463af33-f3b9-4ed1-ad26-27c1b7ff0496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:00:13 devstack sudo[103900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-eacae33a-9278-4b38-a584-719fd70e6fdd 1073741824 Jul 08 02:00:13 devstack sudo[103900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:00:13 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-5c110a5d-ac3c-4d8b-9be5-177c749fd2ae tempest-CreateVolumesFromImageTest-2003055711 None] Volume volume-9d0320f1-7273-4ad8-9f3a-d596a83cc62e (9d0320f1-7273-4ad8-9f3a-d596a83cc62e): created successfully Jul 08 02:00:13 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5c110a5d-ac3c-4d8b-9be5-177c749fd2ae tempest-CreateVolumesFromImageTest-2003055711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0463af33-f3b9-4ed1-ad26-27c1b7ff0496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:00:13 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5c110a5d-ac3c-4d8b-9be5-177c749fd2ae tempest-CreateVolumesFromImageTest-2003055711 None] Flow 'volume_create_manager' (e82c4daa-eb7f-4456-b072-82c392f4cb57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:00:13 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-5c110a5d-ac3c-4d8b-9be5-177c749fd2ae tempest-CreateVolumesFromImageTest-2003055711 None] Created volume successfully. Jul 08 02:00:14 devstack sudo[103900]: pam_unix(sudo:session): session closed for user root Jul 08 02:00:14 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-04cc1572-cec0-4094-927a-53ca4d61e9db tempest-CreateVolumesFromImageTest-2003055711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-eacae33a-9278-4b38-a584-719fd70e6fdd 1073741824" returned: 0 in 0.999s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:00:14 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-04cc1572-cec0-4094-927a-53ca4d61e9db tempest-CreateVolumesFromImageTest-2003055711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-eacae33a-9278-4b38-a584-719fd70e6fdd {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:00:14 devstack sudo[103906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-eacae33a-9278-4b38-a584-719fd70e6fdd Jul 08 02:00:14 devstack sudo[103906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:00:15 devstack sudo[103906]: pam_unix(sudo:session): session closed for user root Jul 08 02:00:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-04cc1572-cec0-4094-927a-53ca4d61e9db tempest-CreateVolumesFromImageTest-2003055711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-eacae33a-9278-4b38-a584-719fd70e6fdd" returned: 0 in 0.844s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:00:15 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-04cc1572-cec0-4094-927a-53ca4d61e9db tempest-CreateVolumesFromImageTest-2003055711 None] <== create_volume: return (1893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:00:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-04cc1572-cec0-4094-927a-53ca4d61e9db tempest-CreateVolumesFromImageTest-2003055711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.896s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:00:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-21c31319-e54e-4e2d-882b-29a3b8ed7c4c tempest-CreateVolumesFromImageTest-2003055711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.161s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:00:15 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-21c31319-e54e-4e2d-882b-29a3b8ed7c4c tempest-CreateVolumesFromImageTest-2003055711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:00:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1787054544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a0fe696-10ab-49ab-907e-9254f3840e69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bebb74b71e7491b9adb86ae74c6cc50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:00:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:00:12Z,use_quota=True,user_id='3522356b559948449e38dffebf1dfcbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:00:15 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-21c31319-e54e-4e2d-882b-29a3b8ed7c4c tempest-CreateVolumesFromImageTest-2003055711 None] Creating volume 7a0fe696-10ab-49ab-907e-9254f3840e69 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:00:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-21c31319-e54e-4e2d-882b-29a3b8ed7c4c tempest-CreateVolumesFromImageTest-2003055711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:00:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-21c31319-e54e-4e2d-882b-29a3b8ed7c4c tempest-CreateVolumesFromImageTest-2003055711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:00:15 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-21c31319-e54e-4e2d-882b-29a3b8ed7c4c tempest-CreateVolumesFromImageTest-2003055711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:00:15 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-21c31319-e54e-4e2d-882b-29a3b8ed7c4c tempest-CreateVolumesFromImageTest-2003055711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:00:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-21c31319-e54e-4e2d-882b-29a3b8ed7c4c tempest-CreateVolumesFromImageTest-2003055711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:00:15 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-21c31319-e54e-4e2d-882b-29a3b8ed7c4c tempest-CreateVolumesFromImageTest-2003055711 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:00:15 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-21c31319-e54e-4e2d-882b-29a3b8ed7c4c tempest-CreateVolumesFromImageTest-2003055711 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 02:00:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-21c31319-e54e-4e2d-882b-29a3b8ed7c4c tempest-CreateVolumesFromImageTest-2003055711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7a0fe696-10ab-49ab-907e-9254f3840e69 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:00:15 devstack sudo[103909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7a0fe696-10ab-49ab-907e-9254f3840e69 1073741824 Jul 08 02:00:15 devstack sudo[103909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:00:15 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-04cc1572-cec0-4094-927a-53ca4d61e9db tempest-CreateVolumesFromImageTest-2003055711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cfa91fa-a339-4e54-9cbc-93087f463080) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eacae33a-9278-4b38-a584-719fd70e6fdd', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:00:15 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-04cc1572-cec0-4094-927a-53ca4d61e9db tempest-CreateVolumesFromImageTest-2003055711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7b49b2a-2285-4852-8fd1-f10c89b92c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:00:15 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-04cc1572-cec0-4094-927a-53ca4d61e9db tempest-CreateVolumesFromImageTest-2003055711 None] Volume volume-eacae33a-9278-4b38-a584-719fd70e6fdd (eacae33a-9278-4b38-a584-719fd70e6fdd): created successfully Jul 08 02:00:15 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-04cc1572-cec0-4094-927a-53ca4d61e9db tempest-CreateVolumesFromImageTest-2003055711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7b49b2a-2285-4852-8fd1-f10c89b92c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:00:15 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-04cc1572-cec0-4094-927a-53ca4d61e9db tempest-CreateVolumesFromImageTest-2003055711 None] Flow 'volume_create_manager' (a388c0c0-52da-4875-816f-02f9d6d78887) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:00:15 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-04cc1572-cec0-4094-927a-53ca4d61e9db tempest-CreateVolumesFromImageTest-2003055711 None] Created volume successfully. Jul 08 02:00:16 devstack sudo[103909]: pam_unix(sudo:session): session closed for user root Jul 08 02:00:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-21c31319-e54e-4e2d-882b-29a3b8ed7c4c tempest-CreateVolumesFromImageTest-2003055711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7a0fe696-10ab-49ab-907e-9254f3840e69 1073741824" returned: 0 in 0.937s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:00:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-21c31319-e54e-4e2d-882b-29a3b8ed7c4c tempest-CreateVolumesFromImageTest-2003055711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7a0fe696-10ab-49ab-907e-9254f3840e69 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:00:16 devstack sudo[103915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7a0fe696-10ab-49ab-907e-9254f3840e69 Jul 08 02:00:16 devstack sudo[103915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:00:17 devstack sudo[103915]: pam_unix(sudo:session): session closed for user root Jul 08 02:00:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-21c31319-e54e-4e2d-882b-29a3b8ed7c4c tempest-CreateVolumesFromImageTest-2003055711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7a0fe696-10ab-49ab-907e-9254f3840e69" returned: 0 in 0.708s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:00:17 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-21c31319-e54e-4e2d-882b-29a3b8ed7c4c tempest-CreateVolumesFromImageTest-2003055711 None] <== create_volume: return (1692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:00:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-21c31319-e54e-4e2d-882b-29a3b8ed7c4c tempest-CreateVolumesFromImageTest-2003055711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.696s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:00:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5e62689c-6007-457c-a420-028f525d89b5 tempest-CreateVolumesFromImageTest-2003055711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.096s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:00:17 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-5e62689c-6007-457c-a420-028f525d89b5 tempest-CreateVolumesFromImageTest-2003055711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:00:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2051805209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=683bfb14-322b-40d8-b206-12b0643e2484,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bebb74b71e7491b9adb86ae74c6cc50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:00:13Z,use_quota=True,user_id='3522356b559948449e38dffebf1dfcbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:00:17 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-5e62689c-6007-457c-a420-028f525d89b5 tempest-CreateVolumesFromImageTest-2003055711 None] Creating volume 683bfb14-322b-40d8-b206-12b0643e2484 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:00:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5e62689c-6007-457c-a420-028f525d89b5 tempest-CreateVolumesFromImageTest-2003055711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:00:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5e62689c-6007-457c-a420-028f525d89b5 tempest-CreateVolumesFromImageTest-2003055711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:00:17 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-5e62689c-6007-457c-a420-028f525d89b5 tempest-CreateVolumesFromImageTest-2003055711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:00:17 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-5e62689c-6007-457c-a420-028f525d89b5 tempest-CreateVolumesFromImageTest-2003055711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:00:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5e62689c-6007-457c-a420-028f525d89b5 tempest-CreateVolumesFromImageTest-2003055711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:00:17 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-5e62689c-6007-457c-a420-028f525d89b5 tempest-CreateVolumesFromImageTest-2003055711 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:00:17 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-5e62689c-6007-457c-a420-028f525d89b5 tempest-CreateVolumesFromImageTest-2003055711 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 02:00:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5e62689c-6007-457c-a420-028f525d89b5 tempest-CreateVolumesFromImageTest-2003055711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-683bfb14-322b-40d8-b206-12b0643e2484 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:00:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-21c31319-e54e-4e2d-882b-29a3b8ed7c4c tempest-CreateVolumesFromImageTest-2003055711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22d461f0-3c42-4e89-802f-7d0791dd1eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a0fe696-10ab-49ab-907e-9254f3840e69', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:00:17 devstack sudo[103918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-683bfb14-322b-40d8-b206-12b0643e2484 1073741824 Jul 08 02:00:17 devstack sudo[103918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:00:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-21c31319-e54e-4e2d-882b-29a3b8ed7c4c tempest-CreateVolumesFromImageTest-2003055711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f211f576-5889-4d0a-83fb-8c586866c0ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:00:17 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-21c31319-e54e-4e2d-882b-29a3b8ed7c4c tempest-CreateVolumesFromImageTest-2003055711 None] Volume volume-7a0fe696-10ab-49ab-907e-9254f3840e69 (7a0fe696-10ab-49ab-907e-9254f3840e69): created successfully Jul 08 02:00:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-21c31319-e54e-4e2d-882b-29a3b8ed7c4c tempest-CreateVolumesFromImageTest-2003055711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f211f576-5889-4d0a-83fb-8c586866c0ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:00:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-21c31319-e54e-4e2d-882b-29a3b8ed7c4c tempest-CreateVolumesFromImageTest-2003055711 None] Flow 'volume_create_manager' (e2269f48-c39b-4f7f-9e41-38a56ff19a1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:00:17 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-21c31319-e54e-4e2d-882b-29a3b8ed7c4c tempest-CreateVolumesFromImageTest-2003055711 None] Created volume successfully. Jul 08 02:00:18 devstack sudo[103918]: pam_unix(sudo:session): session closed for user root Jul 08 02:00:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5e62689c-6007-457c-a420-028f525d89b5 tempest-CreateVolumesFromImageTest-2003055711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-683bfb14-322b-40d8-b206-12b0643e2484 1073741824" returned: 0 in 0.984s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:00:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5e62689c-6007-457c-a420-028f525d89b5 tempest-CreateVolumesFromImageTest-2003055711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-683bfb14-322b-40d8-b206-12b0643e2484 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:00:18 devstack sudo[103923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-683bfb14-322b-40d8-b206-12b0643e2484 Jul 08 02:00:18 devstack sudo[103923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:00:19 devstack sudo[103923]: pam_unix(sudo:session): session closed for user root Jul 08 02:00:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5e62689c-6007-457c-a420-028f525d89b5 tempest-CreateVolumesFromImageTest-2003055711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-683bfb14-322b-40d8-b206-12b0643e2484" returned: 0 in 0.699s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:00:19 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-5e62689c-6007-457c-a420-028f525d89b5 tempest-CreateVolumesFromImageTest-2003055711 None] <== create_volume: return (1733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:00:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5e62689c-6007-457c-a420-028f525d89b5 tempest-CreateVolumesFromImageTest-2003055711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.737s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:00:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-27a46a48-5291-42aa-b4a5-e39c48087d53 tempest-CreateVolumesFromImageTest-2003055711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.467s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:00:19 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-27a46a48-5291-42aa-b4a5-e39c48087d53 tempest-CreateVolumesFromImageTest-2003055711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:00:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-958964720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b25507de-5c75-483a-8073-dc9824ec7024,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bebb74b71e7491b9adb86ae74c6cc50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:00:13Z,use_quota=True,user_id='3522356b559948449e38dffebf1dfcbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:00:19 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-27a46a48-5291-42aa-b4a5-e39c48087d53 tempest-CreateVolumesFromImageTest-2003055711 None] Creating volume b25507de-5c75-483a-8073-dc9824ec7024 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:00:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-27a46a48-5291-42aa-b4a5-e39c48087d53 tempest-CreateVolumesFromImageTest-2003055711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:00:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-27a46a48-5291-42aa-b4a5-e39c48087d53 tempest-CreateVolumesFromImageTest-2003055711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:00:19 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-27a46a48-5291-42aa-b4a5-e39c48087d53 tempest-CreateVolumesFromImageTest-2003055711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:00:19 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-27a46a48-5291-42aa-b4a5-e39c48087d53 tempest-CreateVolumesFromImageTest-2003055711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:00:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-27a46a48-5291-42aa-b4a5-e39c48087d53 tempest-CreateVolumesFromImageTest-2003055711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:00:19 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-27a46a48-5291-42aa-b4a5-e39c48087d53 tempest-CreateVolumesFromImageTest-2003055711 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:00:19 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-27a46a48-5291-42aa-b4a5-e39c48087d53 tempest-CreateVolumesFromImageTest-2003055711 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 02:00:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-27a46a48-5291-42aa-b4a5-e39c48087d53 tempest-CreateVolumesFromImageTest-2003055711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b25507de-5c75-483a-8073-dc9824ec7024 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:00:19 devstack sudo[103926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b25507de-5c75-483a-8073-dc9824ec7024 1073741824 Jul 08 02:00:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5e62689c-6007-457c-a420-028f525d89b5 tempest-CreateVolumesFromImageTest-2003055711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd333f20-c9a4-40a6-b9c2-613f42699215) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-683bfb14-322b-40d8-b206-12b0643e2484', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:00:19 devstack sudo[103926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:00:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5e62689c-6007-457c-a420-028f525d89b5 tempest-CreateVolumesFromImageTest-2003055711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (210694dd-0d5e-42c1-bdaa-102ef317fa8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:00:19 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-5e62689c-6007-457c-a420-028f525d89b5 tempest-CreateVolumesFromImageTest-2003055711 None] Volume volume-683bfb14-322b-40d8-b206-12b0643e2484 (683bfb14-322b-40d8-b206-12b0643e2484): created successfully Jul 08 02:00:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5e62689c-6007-457c-a420-028f525d89b5 tempest-CreateVolumesFromImageTest-2003055711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (210694dd-0d5e-42c1-bdaa-102ef317fa8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:00:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5e62689c-6007-457c-a420-028f525d89b5 tempest-CreateVolumesFromImageTest-2003055711 None] Flow 'volume_create_manager' (831cd68f-6ca3-4755-a286-a179613d9022) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:00:19 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-5e62689c-6007-457c-a420-028f525d89b5 tempest-CreateVolumesFromImageTest-2003055711 None] Created volume successfully. Jul 08 02:00:20 devstack sudo[103926]: pam_unix(sudo:session): session closed for user root Jul 08 02:00:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-27a46a48-5291-42aa-b4a5-e39c48087d53 tempest-CreateVolumesFromImageTest-2003055711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b25507de-5c75-483a-8073-dc9824ec7024 1073741824" returned: 0 in 0.995s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:00:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-27a46a48-5291-42aa-b4a5-e39c48087d53 tempest-CreateVolumesFromImageTest-2003055711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b25507de-5c75-483a-8073-dc9824ec7024 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:00:20 devstack sudo[103932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b25507de-5c75-483a-8073-dc9824ec7024 Jul 08 02:00:20 devstack sudo[103932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:00:20 devstack sudo[103932]: pam_unix(sudo:session): session closed for user root Jul 08 02:00:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-27a46a48-5291-42aa-b4a5-e39c48087d53 tempest-CreateVolumesFromImageTest-2003055711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b25507de-5c75-483a-8073-dc9824ec7024" returned: 0 in 0.715s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:00:20 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-27a46a48-5291-42aa-b4a5-e39c48087d53 tempest-CreateVolumesFromImageTest-2003055711 None] <== create_volume: return (1773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:00:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-27a46a48-5291-42aa-b4a5-e39c48087d53 tempest-CreateVolumesFromImageTest-2003055711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.779s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:00:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-27a46a48-5291-42aa-b4a5-e39c48087d53 tempest-CreateVolumesFromImageTest-2003055711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fec49580-b5c0-4f2e-8e73-76526ed577be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b25507de-5c75-483a-8073-dc9824ec7024', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:00:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-27a46a48-5291-42aa-b4a5-e39c48087d53 tempest-CreateVolumesFromImageTest-2003055711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ea3b13b-513d-4bab-b4e4-937af628ea70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:00:20 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-27a46a48-5291-42aa-b4a5-e39c48087d53 tempest-CreateVolumesFromImageTest-2003055711 None] Volume volume-b25507de-5c75-483a-8073-dc9824ec7024 (b25507de-5c75-483a-8073-dc9824ec7024): created successfully Jul 08 02:00:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-27a46a48-5291-42aa-b4a5-e39c48087d53 tempest-CreateVolumesFromImageTest-2003055711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ea3b13b-513d-4bab-b4e4-937af628ea70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:00:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-27a46a48-5291-42aa-b4a5-e39c48087d53 tempest-CreateVolumesFromImageTest-2003055711 None] Flow 'volume_create_manager' (577f69a1-c83b-4ad2-9126-9e4b57b8ac58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:00:20 devstack cinder-volume[87134]: DEBUG oslo_service.periodic_task [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87134) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 02:00:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:00:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:00:20 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:00:20 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:00:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:00:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:00:20 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-27a46a48-5291-42aa-b4a5-e39c48087d53 tempest-CreateVolumesFromImageTest-2003055711 None] Created volume successfully. Jul 08 02:00:20 devstack sudo[103935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 02:00:20 devstack sudo[103935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:00:21 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-ca5a90ef-0267-46f4-8fe0-38b1a4424842 tempest-CreateVolumesFromImageTest-2003055711 None] Acquiring lock "cinder-b25507de-5c75-483a-8073-dc9824ec7024-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:00:21 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-ca5a90ef-0267-46f4-8fe0-38b1a4424842 tempest-CreateVolumesFromImageTest-2003055711 None] Lock "cinder-b25507de-5c75-483a-8073-dc9824ec7024-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:00:21 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-ca5a90ef-0267-46f4-8fe0-38b1a4424842 tempest-CreateVolumesFromImageTest-2003055711 None] Acquiring lock "cinder-quobyte-b25507de-5c75-483a-8073-dc9824ec7024" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:00:21 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-ca5a90ef-0267-46f4-8fe0-38b1a4424842 tempest-CreateVolumesFromImageTest-2003055711 None] Lock "cinder-quobyte-b25507de-5c75-483a-8073-dc9824ec7024" acquired by "delete_volume" :: waited 0.019s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:00:21 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[5041e672-0fc6-41bc-9e44-58806820bbe9]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:00:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ca5a90ef-0267-46f4-8fe0-38b1a4424842 tempest-CreateVolumesFromImageTest-2003055711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b25507de-5c75-483a-8073-dc9824ec7024 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:00:21 devstack sudo[103937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b25507de-5c75-483a-8073-dc9824ec7024 Jul 08 02:00:21 devstack sudo[103937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:00:21 devstack sudo[103935]: pam_unix(sudo:session): session closed for user root Jul 08 02:00:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.950s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:00:21 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:00:21 devstack cinder-volume[87134]: DEBUG oslo_service.periodic_task [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running periodic task VolumeManager._thread_info {{(pid=87134) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 02:00:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] thread count: 28 {{(pid=87134) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 02:00:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] thread info: [<_MainThread(MainThread, started 129378964615296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87134) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 02:00:22 devstack sudo[103937]: pam_unix(sudo:session): session closed for user root Jul 08 02:00:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ca5a90ef-0267-46f4-8fe0-38b1a4424842 tempest-CreateVolumesFromImageTest-2003055711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b25507de-5c75-483a-8073-dc9824ec7024" returned: 0 in 0.957s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:00:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ca5a90ef-0267-46f4-8fe0-38b1a4424842 tempest-CreateVolumesFromImageTest-2003055711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b25507de-5c75-483a-8073-dc9824ec7024 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:00:22 devstack sudo[103943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b25507de-5c75-483a-8073-dc9824ec7024 Jul 08 02:00:22 devstack sudo[103943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:00:23 devstack sudo[103943]: pam_unix(sudo:session): session closed for user root Jul 08 02:00:23 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ca5a90ef-0267-46f4-8fe0-38b1a4424842 tempest-CreateVolumesFromImageTest-2003055711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b25507de-5c75-483a-8073-dc9824ec7024" returned: 0 in 0.726s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:00:23 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-ca5a90ef-0267-46f4-8fe0-38b1a4424842 tempest-CreateVolumesFromImageTest-2003055711 None] Lock "cinder-quobyte-b25507de-5c75-483a-8073-dc9824ec7024" released by "delete_volume" :: held 1.741s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:00:23 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-ca5a90ef-0267-46f4-8fe0-38b1a4424842 tempest-CreateVolumesFromImageTest-2003055711 None] Created reservations ['04092dd7-d383-4848-acde-3b8d8ffe8685', '92c2cf6c-8a11-4bc5-84a5-37375d8bde68', 'a10a4e3e-ccd7-4dcd-99e4-3dfef44c9f13', '2a624821-8bc7-414f-98e8-1e8f704ffd1f'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:00:23 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-ca5a90ef-0267-46f4-8fe0-38b1a4424842 tempest-CreateVolumesFromImageTest-2003055711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:00:23 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-ca5a90ef-0267-46f4-8fe0-38b1a4424842 tempest-CreateVolumesFromImageTest-2003055711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:00:23 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-ca5a90ef-0267-46f4-8fe0-38b1a4424842 tempest-CreateVolumesFromImageTest-2003055711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:00:23 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-ca5a90ef-0267-46f4-8fe0-38b1a4424842 tempest-CreateVolumesFromImageTest-2003055711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:00:23 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-ca5a90ef-0267-46f4-8fe0-38b1a4424842 tempest-CreateVolumesFromImageTest-2003055711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:00:23 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ca5a90ef-0267-46f4-8fe0-38b1a4424842 tempest-CreateVolumesFromImageTest-2003055711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:00:23 devstack sudo[103947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 02:00:23 devstack sudo[103947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:00:23 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-c49ace0e-af8d-4ea6-8671-537fa42ed7ae tempest-CreateVolumesFromImageTest-2003055711 None] Acquiring lock "cinder-683bfb14-322b-40d8-b206-12b0643e2484-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:00:23 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-c49ace0e-af8d-4ea6-8671-537fa42ed7ae tempest-CreateVolumesFromImageTest-2003055711 None] Lock "cinder-683bfb14-322b-40d8-b206-12b0643e2484-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:00:23 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-c49ace0e-af8d-4ea6-8671-537fa42ed7ae tempest-CreateVolumesFromImageTest-2003055711 None] Acquiring lock "cinder-quobyte-683bfb14-322b-40d8-b206-12b0643e2484" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:00:23 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-c49ace0e-af8d-4ea6-8671-537fa42ed7ae tempest-CreateVolumesFromImageTest-2003055711 None] Lock "cinder-quobyte-683bfb14-322b-40d8-b206-12b0643e2484" acquired by "delete_volume" :: waited 0.019s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:00:23 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ddb9d2-548e-4e5a-808b-f9543e74dcf1]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:00:23 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c49ace0e-af8d-4ea6-8671-537fa42ed7ae tempest-CreateVolumesFromImageTest-2003055711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-683bfb14-322b-40d8-b206-12b0643e2484 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:00:24 devstack sudo[103949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-683bfb14-322b-40d8-b206-12b0643e2484 Jul 08 02:00:24 devstack sudo[103949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:00:24 devstack sudo[103947]: pam_unix(sudo:session): session closed for user root Jul 08 02:00:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ca5a90ef-0267-46f4-8fe0-38b1a4424842 tempest-CreateVolumesFromImageTest-2003055711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.805s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:00:24 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-ca5a90ef-0267-46f4-8fe0-38b1a4424842 tempest-CreateVolumesFromImageTest-2003055711 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:00:24 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-ca5a90ef-0267-46f4-8fe0-38b1a4424842 tempest-CreateVolumesFromImageTest-2003055711 None] Deleted volume successfully. Jul 08 02:00:24 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-ca5a90ef-0267-46f4-8fe0-38b1a4424842 tempest-CreateVolumesFromImageTest-2003055711 None] Lock "cinder-b25507de-5c75-483a-8073-dc9824ec7024-delete_volume" released by "delete_volume" :: held 2.788s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:00:24 devstack sudo[103949]: pam_unix(sudo:session): session closed for user root Jul 08 02:00:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c49ace0e-af8d-4ea6-8671-537fa42ed7ae tempest-CreateVolumesFromImageTest-2003055711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-683bfb14-322b-40d8-b206-12b0643e2484" returned: 0 in 0.913s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:00:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c49ace0e-af8d-4ea6-8671-537fa42ed7ae tempest-CreateVolumesFromImageTest-2003055711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-683bfb14-322b-40d8-b206-12b0643e2484 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:00:24 devstack sudo[103956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-683bfb14-322b-40d8-b206-12b0643e2484 Jul 08 02:00:24 devstack sudo[103956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:00:25 devstack sudo[103956]: pam_unix(sudo:session): session closed for user root Jul 08 02:00:25 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c49ace0e-af8d-4ea6-8671-537fa42ed7ae tempest-CreateVolumesFromImageTest-2003055711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-683bfb14-322b-40d8-b206-12b0643e2484" returned: 0 in 0.697s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:00:25 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-c49ace0e-af8d-4ea6-8671-537fa42ed7ae tempest-CreateVolumesFromImageTest-2003055711 None] Lock "cinder-quobyte-683bfb14-322b-40d8-b206-12b0643e2484" released by "delete_volume" :: held 1.669s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:00:25 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-c49ace0e-af8d-4ea6-8671-537fa42ed7ae tempest-CreateVolumesFromImageTest-2003055711 None] Created reservations ['90eb2f7f-fc18-4512-9034-dd84e9a409dc', '51e8e341-8c3f-4b1d-bd01-7c94d4db7205', '6705b00d-e166-4a5c-858b-8b2c725caf2d', 'aa3b8d42-6424-48bf-b12e-b70c2d389f1c'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:00:25 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c49ace0e-af8d-4ea6-8671-537fa42ed7ae tempest-CreateVolumesFromImageTest-2003055711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:00:25 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c49ace0e-af8d-4ea6-8671-537fa42ed7ae tempest-CreateVolumesFromImageTest-2003055711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:00:25 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-c49ace0e-af8d-4ea6-8671-537fa42ed7ae tempest-CreateVolumesFromImageTest-2003055711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:00:25 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-c49ace0e-af8d-4ea6-8671-537fa42ed7ae tempest-CreateVolumesFromImageTest-2003055711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:00:25 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c49ace0e-af8d-4ea6-8671-537fa42ed7ae tempest-CreateVolumesFromImageTest-2003055711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:00:25 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c49ace0e-af8d-4ea6-8671-537fa42ed7ae tempest-CreateVolumesFromImageTest-2003055711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:00:25 devstack sudo[103960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 02:00:25 devstack sudo[103960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:00:25 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-0fc06550-1a97-4230-a6d8-0235154e4775 tempest-CreateVolumesFromImageTest-2003055711 None] Acquiring lock "cinder-7a0fe696-10ab-49ab-907e-9254f3840e69-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:00:25 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-0fc06550-1a97-4230-a6d8-0235154e4775 tempest-CreateVolumesFromImageTest-2003055711 None] Lock "cinder-7a0fe696-10ab-49ab-907e-9254f3840e69-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:00:26 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-0fc06550-1a97-4230-a6d8-0235154e4775 tempest-CreateVolumesFromImageTest-2003055711 None] Acquiring lock "cinder-quobyte-7a0fe696-10ab-49ab-907e-9254f3840e69" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:00:26 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-0fc06550-1a97-4230-a6d8-0235154e4775 tempest-CreateVolumesFromImageTest-2003055711 None] Lock "cinder-quobyte-7a0fe696-10ab-49ab-907e-9254f3840e69" acquired by "delete_volume" :: waited 0.028s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:00:26 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b94206-79ce-416f-ba11-235e7bc4d989]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:00:26 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-0fc06550-1a97-4230-a6d8-0235154e4775 tempest-CreateVolumesFromImageTest-2003055711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7a0fe696-10ab-49ab-907e-9254f3840e69 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:00:26 devstack sudo[103962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7a0fe696-10ab-49ab-907e-9254f3840e69 Jul 08 02:00:26 devstack sudo[103962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:00:26 devstack sudo[103960]: pam_unix(sudo:session): session closed for user root Jul 08 02:00:26 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c49ace0e-af8d-4ea6-8671-537fa42ed7ae tempest-CreateVolumesFromImageTest-2003055711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.739s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:00:26 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-c49ace0e-af8d-4ea6-8671-537fa42ed7ae tempest-CreateVolumesFromImageTest-2003055711 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:00:26 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-c49ace0e-af8d-4ea6-8671-537fa42ed7ae tempest-CreateVolumesFromImageTest-2003055711 None] Deleted volume successfully. Jul 08 02:00:26 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-c49ace0e-af8d-4ea6-8671-537fa42ed7ae tempest-CreateVolumesFromImageTest-2003055711 None] Lock "cinder-683bfb14-322b-40d8-b206-12b0643e2484-delete_volume" released by "delete_volume" :: held 2.684s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:00:26 devstack sudo[103962]: pam_unix(sudo:session): session closed for user root Jul 08 02:00:26 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-0fc06550-1a97-4230-a6d8-0235154e4775 tempest-CreateVolumesFromImageTest-2003055711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7a0fe696-10ab-49ab-907e-9254f3840e69" returned: 0 in 0.854s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:00:26 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-0fc06550-1a97-4230-a6d8-0235154e4775 tempest-CreateVolumesFromImageTest-2003055711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7a0fe696-10ab-49ab-907e-9254f3840e69 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:00:26 devstack sudo[103968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7a0fe696-10ab-49ab-907e-9254f3840e69 Jul 08 02:00:26 devstack sudo[103968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:00:27 devstack sudo[103968]: pam_unix(sudo:session): session closed for user root Jul 08 02:00:27 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-0fc06550-1a97-4230-a6d8-0235154e4775 tempest-CreateVolumesFromImageTest-2003055711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7a0fe696-10ab-49ab-907e-9254f3840e69" returned: 0 in 0.730s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:00:27 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-0fc06550-1a97-4230-a6d8-0235154e4775 tempest-CreateVolumesFromImageTest-2003055711 None] Lock "cinder-quobyte-7a0fe696-10ab-49ab-907e-9254f3840e69" released by "delete_volume" :: held 1.648s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:00:27 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-0fc06550-1a97-4230-a6d8-0235154e4775 tempest-CreateVolumesFromImageTest-2003055711 None] Created reservations ['b46a595c-f92d-4658-b264-408ef24dc2b8', 'a700427b-9c10-4a05-b7bf-228989d4ae98', '903c5c6c-15f6-4bd8-841e-dc0db800ae02', '49871ac3-c585-496a-bc24-74a9a9f29933'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:00:27 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-0fc06550-1a97-4230-a6d8-0235154e4775 tempest-CreateVolumesFromImageTest-2003055711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:00:27 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-0fc06550-1a97-4230-a6d8-0235154e4775 tempest-CreateVolumesFromImageTest-2003055711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:00:27 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-0fc06550-1a97-4230-a6d8-0235154e4775 tempest-CreateVolumesFromImageTest-2003055711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:00:27 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-0fc06550-1a97-4230-a6d8-0235154e4775 tempest-CreateVolumesFromImageTest-2003055711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:00:27 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-0fc06550-1a97-4230-a6d8-0235154e4775 tempest-CreateVolumesFromImageTest-2003055711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:00:27 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-0fc06550-1a97-4230-a6d8-0235154e4775 tempest-CreateVolumesFromImageTest-2003055711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:00:27 devstack sudo[103971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 02:00:27 devstack sudo[103971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:00:28 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-802ec2c5-8850-4008-af7e-5415da45cf07 tempest-CreateVolumesFromImageTest-2003055711 None] Acquiring lock "cinder-eacae33a-9278-4b38-a584-719fd70e6fdd-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:00:28 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-802ec2c5-8850-4008-af7e-5415da45cf07 tempest-CreateVolumesFromImageTest-2003055711 None] Lock "cinder-eacae33a-9278-4b38-a584-719fd70e6fdd-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:00:28 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-802ec2c5-8850-4008-af7e-5415da45cf07 tempest-CreateVolumesFromImageTest-2003055711 None] Acquiring lock "cinder-quobyte-eacae33a-9278-4b38-a584-719fd70e6fdd" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:00:28 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-802ec2c5-8850-4008-af7e-5415da45cf07 tempest-CreateVolumesFromImageTest-2003055711 None] Lock "cinder-quobyte-eacae33a-9278-4b38-a584-719fd70e6fdd" acquired by "delete_volume" :: waited 0.029s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:00:28 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd069915-3a97-40e1-ae59-8d6306cb41c1]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:00:28 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-802ec2c5-8850-4008-af7e-5415da45cf07 tempest-CreateVolumesFromImageTest-2003055711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-eacae33a-9278-4b38-a584-719fd70e6fdd {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:00:28 devstack sudo[103973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-eacae33a-9278-4b38-a584-719fd70e6fdd Jul 08 02:00:28 devstack sudo[103973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:00:28 devstack sudo[103971]: pam_unix(sudo:session): session closed for user root Jul 08 02:00:28 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-0fc06550-1a97-4230-a6d8-0235154e4775 tempest-CreateVolumesFromImageTest-2003055711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.730s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:00:28 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-0fc06550-1a97-4230-a6d8-0235154e4775 tempest-CreateVolumesFromImageTest-2003055711 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:00:28 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-0fc06550-1a97-4230-a6d8-0235154e4775 tempest-CreateVolumesFromImageTest-2003055711 None] Deleted volume successfully. Jul 08 02:00:28 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-0fc06550-1a97-4230-a6d8-0235154e4775 tempest-CreateVolumesFromImageTest-2003055711 None] Lock "cinder-7a0fe696-10ab-49ab-907e-9254f3840e69-delete_volume" released by "delete_volume" :: held 2.632s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:00:29 devstack sudo[103973]: pam_unix(sudo:session): session closed for user root Jul 08 02:00:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-802ec2c5-8850-4008-af7e-5415da45cf07 tempest-CreateVolumesFromImageTest-2003055711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-eacae33a-9278-4b38-a584-719fd70e6fdd" returned: 0 in 0.855s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:00:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-802ec2c5-8850-4008-af7e-5415da45cf07 tempest-CreateVolumesFromImageTest-2003055711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-eacae33a-9278-4b38-a584-719fd70e6fdd {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:00:29 devstack sudo[103982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-eacae33a-9278-4b38-a584-719fd70e6fdd Jul 08 02:00:29 devstack sudo[103982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:00:30 devstack sudo[103982]: pam_unix(sudo:session): session closed for user root Jul 08 02:00:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-802ec2c5-8850-4008-af7e-5415da45cf07 tempest-CreateVolumesFromImageTest-2003055711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-eacae33a-9278-4b38-a584-719fd70e6fdd" returned: 0 in 0.846s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:00:30 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-802ec2c5-8850-4008-af7e-5415da45cf07 tempest-CreateVolumesFromImageTest-2003055711 None] Lock "cinder-quobyte-eacae33a-9278-4b38-a584-719fd70e6fdd" released by "delete_volume" :: held 1.756s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:00:30 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-802ec2c5-8850-4008-af7e-5415da45cf07 tempest-CreateVolumesFromImageTest-2003055711 None] Created reservations ['627fc405-2004-46a4-b2c1-730cabe77930', '2cafca5c-aa30-41c1-ace9-0cfea308c7b2', '8a7d5369-5229-49ab-98c5-cf39d1bff19f', '4393a7a7-6c1e-43ad-a11c-1abac76cf624'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:00:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-802ec2c5-8850-4008-af7e-5415da45cf07 tempest-CreateVolumesFromImageTest-2003055711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:00:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-802ec2c5-8850-4008-af7e-5415da45cf07 tempest-CreateVolumesFromImageTest-2003055711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:00:30 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-802ec2c5-8850-4008-af7e-5415da45cf07 tempest-CreateVolumesFromImageTest-2003055711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:00:30 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-802ec2c5-8850-4008-af7e-5415da45cf07 tempest-CreateVolumesFromImageTest-2003055711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:00:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-802ec2c5-8850-4008-af7e-5415da45cf07 tempest-CreateVolumesFromImageTest-2003055711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:00:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-802ec2c5-8850-4008-af7e-5415da45cf07 tempest-CreateVolumesFromImageTest-2003055711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:00:30 devstack sudo[103985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 02:00:30 devstack sudo[103985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:00:30 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-07f0ff76-d518-4fb2-9eb0-73ff2f592182 tempest-CreateVolumesFromImageTest-2003055711 None] Acquiring lock "cinder-9d0320f1-7273-4ad8-9f3a-d596a83cc62e-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:00:30 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-07f0ff76-d518-4fb2-9eb0-73ff2f592182 tempest-CreateVolumesFromImageTest-2003055711 None] Lock "cinder-9d0320f1-7273-4ad8-9f3a-d596a83cc62e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:00:30 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-07f0ff76-d518-4fb2-9eb0-73ff2f592182 tempest-CreateVolumesFromImageTest-2003055711 None] Acquiring lock "cinder-quobyte-9d0320f1-7273-4ad8-9f3a-d596a83cc62e" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:00:30 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-07f0ff76-d518-4fb2-9eb0-73ff2f592182 tempest-CreateVolumesFromImageTest-2003055711 None] Lock "cinder-quobyte-9d0320f1-7273-4ad8-9f3a-d596a83cc62e" acquired by "delete_volume" :: waited 0.020s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:00:30 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6af5c2-4393-43aa-93e6-01243ba5e08a]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:00:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-07f0ff76-d518-4fb2-9eb0-73ff2f592182 tempest-CreateVolumesFromImageTest-2003055711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9d0320f1-7273-4ad8-9f3a-d596a83cc62e {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:00:30 devstack sudo[103987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9d0320f1-7273-4ad8-9f3a-d596a83cc62e Jul 08 02:00:30 devstack sudo[103987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:00:31 devstack sudo[103985]: pam_unix(sudo:session): session closed for user root Jul 08 02:00:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-802ec2c5-8850-4008-af7e-5415da45cf07 tempest-CreateVolumesFromImageTest-2003055711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.797s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:00:31 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-802ec2c5-8850-4008-af7e-5415da45cf07 tempest-CreateVolumesFromImageTest-2003055711 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:00:31 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-802ec2c5-8850-4008-af7e-5415da45cf07 tempest-CreateVolumesFromImageTest-2003055711 None] Deleted volume successfully. Jul 08 02:00:31 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-802ec2c5-8850-4008-af7e-5415da45cf07 tempest-CreateVolumesFromImageTest-2003055711 None] Lock "cinder-eacae33a-9278-4b38-a584-719fd70e6fdd-delete_volume" released by "delete_volume" :: held 2.814s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:00:31 devstack sudo[103987]: pam_unix(sudo:session): session closed for user root Jul 08 02:00:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-07f0ff76-d518-4fb2-9eb0-73ff2f592182 tempest-CreateVolumesFromImageTest-2003055711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9d0320f1-7273-4ad8-9f3a-d596a83cc62e" returned: 0 in 0.856s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:00:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-07f0ff76-d518-4fb2-9eb0-73ff2f592182 tempest-CreateVolumesFromImageTest-2003055711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9d0320f1-7273-4ad8-9f3a-d596a83cc62e {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:00:31 devstack sudo[103999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9d0320f1-7273-4ad8-9f3a-d596a83cc62e Jul 08 02:00:31 devstack sudo[103999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:00:32 devstack sudo[103999]: pam_unix(sudo:session): session closed for user root Jul 08 02:00:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-07f0ff76-d518-4fb2-9eb0-73ff2f592182 tempest-CreateVolumesFromImageTest-2003055711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-9d0320f1-7273-4ad8-9f3a-d596a83cc62e" returned: 0 in 0.776s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:00:32 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-07f0ff76-d518-4fb2-9eb0-73ff2f592182 tempest-CreateVolumesFromImageTest-2003055711 None] Lock "cinder-quobyte-9d0320f1-7273-4ad8-9f3a-d596a83cc62e" released by "delete_volume" :: held 1.677s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:00:32 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-07f0ff76-d518-4fb2-9eb0-73ff2f592182 tempest-CreateVolumesFromImageTest-2003055711 None] Created reservations ['217c3dec-1492-467e-a7d1-8e1ac4c29e37', 'ecb91a3a-d543-41aa-92b7-0e1685676683', '666fc07b-9a87-4721-9fe9-43b029f07185', 'bf65c13f-98bf-483b-b559-312b8f753a3a'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:00:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-07f0ff76-d518-4fb2-9eb0-73ff2f592182 tempest-CreateVolumesFromImageTest-2003055711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:00:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-07f0ff76-d518-4fb2-9eb0-73ff2f592182 tempest-CreateVolumesFromImageTest-2003055711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:00:32 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-07f0ff76-d518-4fb2-9eb0-73ff2f592182 tempest-CreateVolumesFromImageTest-2003055711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:00:32 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-07f0ff76-d518-4fb2-9eb0-73ff2f592182 tempest-CreateVolumesFromImageTest-2003055711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:00:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-07f0ff76-d518-4fb2-9eb0-73ff2f592182 tempest-CreateVolumesFromImageTest-2003055711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:00:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-07f0ff76-d518-4fb2-9eb0-73ff2f592182 tempest-CreateVolumesFromImageTest-2003055711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:00:32 devstack sudo[104038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 02:00:32 devstack sudo[104038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:00:33 devstack sudo[104038]: pam_unix(sudo:session): session closed for user root Jul 08 02:00:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-07f0ff76-d518-4fb2-9eb0-73ff2f592182 tempest-CreateVolumesFromImageTest-2003055711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.736s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:00:33 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-07f0ff76-d518-4fb2-9eb0-73ff2f592182 tempest-CreateVolumesFromImageTest-2003055711 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:00:33 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-07f0ff76-d518-4fb2-9eb0-73ff2f592182 tempest-CreateVolumesFromImageTest-2003055711 None] Deleted volume successfully. Jul 08 02:00:33 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-07f0ff76-d518-4fb2-9eb0-73ff2f592182 tempest-CreateVolumesFromImageTest-2003055711 None] Lock "cinder-9d0320f1-7273-4ad8-9f3a-d596a83cc62e-delete_volume" released by "delete_volume" :: held 2.663s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:00:36 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-db735efc-d6d2-4ae0-96e8-c904d9069259 tempest-VolumeDependencyTests-1168741681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:00:36 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-db735efc-d6d2-4ae0-96e8-c904d9069259 tempest-VolumeDependencyTests-1168741681 None] Flow 'volume_create_manager' (0d340305-a57b-4ec0-b5fe-d7e42a0ac9ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:00:36 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-db735efc-d6d2-4ae0-96e8-c904d9069259 tempest-VolumeDependencyTests-1168741681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b308019-a33e-4517-a593-be6e48e7062b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:00:36 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-db735efc-d6d2-4ae0-96e8-c904d9069259 tempest-VolumeDependencyTests-1168741681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b308019-a33e-4517-a593-be6e48e7062b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:00:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1861137435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=339b61b6-eddc-476d-9486-cb26a35190d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27826802aebe42bd8e853490362d2bfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:00:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:00:37Z,use_quota=True,user_id='fccfe85ec1f643bf8a18829c117f9181',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:00:36 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-db735efc-d6d2-4ae0-96e8-c904d9069259 tempest-VolumeDependencyTests-1168741681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b14b2712-7359-4986-85bd-791ce4222305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:00:36 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-db735efc-d6d2-4ae0-96e8-c904d9069259 tempest-VolumeDependencyTests-1168741681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b14b2712-7359-4986-85bd-791ce4222305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:00:36 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-db735efc-d6d2-4ae0-96e8-c904d9069259 tempest-VolumeDependencyTests-1168741681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (072c4c3f-a071-460f-a5b1-0cb987cb7970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:00:36 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-db735efc-d6d2-4ae0-96e8-c904d9069259 tempest-VolumeDependencyTests-1168741681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (072c4c3f-a071-460f-a5b1-0cb987cb7970) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '339b61b6-eddc-476d-9486-cb26a35190d2', 'volume_name': 'volume-339b61b6-eddc-476d-9486-cb26a35190d2', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:00:36 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-db735efc-d6d2-4ae0-96e8-c904d9069259 tempest-VolumeDependencyTests-1168741681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f107a27-45d6-4bbf-9eff-82ed056c61a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:00:36 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-db735efc-d6d2-4ae0-96e8-c904d9069259 tempest-VolumeDependencyTests-1168741681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f107a27-45d6-4bbf-9eff-82ed056c61a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:00:36 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-db735efc-d6d2-4ae0-96e8-c904d9069259 tempest-VolumeDependencyTests-1168741681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb00154f-5b9c-4f10-9a81-9ecfb64eebeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:00:36 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-db735efc-d6d2-4ae0-96e8-c904d9069259 tempest-VolumeDependencyTests-1168741681 None] Volume 339b61b6-eddc-476d-9486-cb26a35190d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-339b61b6-eddc-476d-9486-cb26a35190d2', 'volume_size': 1} Jul 08 02:00:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-db735efc-d6d2-4ae0-96e8-c904d9069259 tempest-VolumeDependencyTests-1168741681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:00:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-db735efc-d6d2-4ae0-96e8-c904d9069259 tempest-VolumeDependencyTests-1168741681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:00:36 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-db735efc-d6d2-4ae0-96e8-c904d9069259 tempest-VolumeDependencyTests-1168741681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:00:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1861137435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=339b61b6-eddc-476d-9486-cb26a35190d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27826802aebe42bd8e853490362d2bfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:00:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:00:37Z,use_quota=True,user_id='fccfe85ec1f643bf8a18829c117f9181',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:00:36 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-db735efc-d6d2-4ae0-96e8-c904d9069259 tempest-VolumeDependencyTests-1168741681 None] Creating volume 339b61b6-eddc-476d-9486-cb26a35190d2 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:00:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-db735efc-d6d2-4ae0-96e8-c904d9069259 tempest-VolumeDependencyTests-1168741681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:00:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-db735efc-d6d2-4ae0-96e8-c904d9069259 tempest-VolumeDependencyTests-1168741681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:00:36 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-db735efc-d6d2-4ae0-96e8-c904d9069259 tempest-VolumeDependencyTests-1168741681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:00:36 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-db735efc-d6d2-4ae0-96e8-c904d9069259 tempest-VolumeDependencyTests-1168741681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:00:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-db735efc-d6d2-4ae0-96e8-c904d9069259 tempest-VolumeDependencyTests-1168741681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:00:36 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-db735efc-d6d2-4ae0-96e8-c904d9069259 tempest-VolumeDependencyTests-1168741681 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:00:36 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-db735efc-d6d2-4ae0-96e8-c904d9069259 tempest-VolumeDependencyTests-1168741681 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 02:00:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-db735efc-d6d2-4ae0-96e8-c904d9069259 tempest-VolumeDependencyTests-1168741681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-339b61b6-eddc-476d-9486-cb26a35190d2 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:00:36 devstack sudo[104065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-339b61b6-eddc-476d-9486-cb26a35190d2 1073741824 Jul 08 02:00:36 devstack sudo[104065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:00:37 devstack sudo[104065]: pam_unix(sudo:session): session closed for user root Jul 08 02:00:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-db735efc-d6d2-4ae0-96e8-c904d9069259 tempest-VolumeDependencyTests-1168741681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-339b61b6-eddc-476d-9486-cb26a35190d2 1073741824" returned: 0 in 0.913s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:00:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-db735efc-d6d2-4ae0-96e8-c904d9069259 tempest-VolumeDependencyTests-1168741681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-339b61b6-eddc-476d-9486-cb26a35190d2 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:00:37 devstack sudo[104082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-339b61b6-eddc-476d-9486-cb26a35190d2 Jul 08 02:00:37 devstack sudo[104082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:00:38 devstack sudo[104082]: pam_unix(sudo:session): session closed for user root Jul 08 02:00:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-db735efc-d6d2-4ae0-96e8-c904d9069259 tempest-VolumeDependencyTests-1168741681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-339b61b6-eddc-476d-9486-cb26a35190d2" returned: 0 in 0.638s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:00:38 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-db735efc-d6d2-4ae0-96e8-c904d9069259 tempest-VolumeDependencyTests-1168741681 None] <== create_volume: return (1596ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:00:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-db735efc-d6d2-4ae0-96e8-c904d9069259 tempest-VolumeDependencyTests-1168741681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.599s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:00:38 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-db735efc-d6d2-4ae0-96e8-c904d9069259 tempest-VolumeDependencyTests-1168741681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb00154f-5b9c-4f10-9a81-9ecfb64eebeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-339b61b6-eddc-476d-9486-cb26a35190d2', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:00:38 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-db735efc-d6d2-4ae0-96e8-c904d9069259 tempest-VolumeDependencyTests-1168741681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31e22fd8-2043-4a9b-8b24-19f578ca0807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:00:38 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-db735efc-d6d2-4ae0-96e8-c904d9069259 tempest-VolumeDependencyTests-1168741681 None] Volume volume-339b61b6-eddc-476d-9486-cb26a35190d2 (339b61b6-eddc-476d-9486-cb26a35190d2): created successfully Jul 08 02:00:38 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-db735efc-d6d2-4ae0-96e8-c904d9069259 tempest-VolumeDependencyTests-1168741681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31e22fd8-2043-4a9b-8b24-19f578ca0807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:00:38 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-db735efc-d6d2-4ae0-96e8-c904d9069259 tempest-VolumeDependencyTests-1168741681 None] Flow 'volume_create_manager' (0d340305-a57b-4ec0-b5fe-d7e42a0ac9ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:00:38 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-db735efc-d6d2-4ae0-96e8-c904d9069259 tempest-VolumeDependencyTests-1168741681 None] Created volume successfully. Jul 08 02:00:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-dad1b4fb-027a-4d5a-9587-7a55f781f78e tempest-VolumeDependencyTests-1168741681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:00:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-dad1b4fb-027a-4d5a-9587-7a55f781f78e tempest-VolumeDependencyTests-1168741681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:00:38 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-dad1b4fb-027a-4d5a-9587-7a55f781f78e tempest-VolumeDependencyTests-1168741681 None] Creating offline snapshot c2ac030d-98b3-4f44-8b9d-81fb14c37bd2 of volume 339b61b6-eddc-476d-9486-cb26a35190d2 {{(pid=87134) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 02:00:39 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[db115a52-fa6d-4500-8d19-cd58e89b106b]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:00:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-dad1b4fb-027a-4d5a-9587-7a55f781f78e tempest-VolumeDependencyTests-1168741681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-339b61b6-eddc-476d-9486-cb26a35190d2 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:00:39 devstack sudo[104114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-339b61b6-eddc-476d-9486-cb26a35190d2 Jul 08 02:00:39 devstack sudo[104114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:00:39 devstack sudo[104114]: pam_unix(sudo:session): session closed for user root Jul 08 02:00:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-dad1b4fb-027a-4d5a-9587-7a55f781f78e tempest-VolumeDependencyTests-1168741681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-339b61b6-eddc-476d-9486-cb26a35190d2" returned: 0 in 0.877s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:00:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-dad1b4fb-027a-4d5a-9587-7a55f781f78e tempest-VolumeDependencyTests-1168741681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-339b61b6-eddc-476d-9486-cb26a35190d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-339b61b6-eddc-476d-9486-cb26a35190d2.c2ac030d-98b3-4f44-8b9d-81fb14c37bd2 1G {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:00:39 devstack sudo[104136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-339b61b6-eddc-476d-9486-cb26a35190d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-339b61b6-eddc-476d-9486-cb26a35190d2.c2ac030d-98b3-4f44-8b9d-81fb14c37bd2 1G Jul 08 02:00:39 devstack sudo[104136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:00:40 devstack sudo[104136]: pam_unix(sudo:session): session closed for user root Jul 08 02:00:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-dad1b4fb-027a-4d5a-9587-7a55f781f78e tempest-VolumeDependencyTests-1168741681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-339b61b6-eddc-476d-9486-cb26a35190d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-339b61b6-eddc-476d-9486-cb26a35190d2.c2ac030d-98b3-4f44-8b9d-81fb14c37bd2 1G" returned: 0 in 0.871s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:00:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-dad1b4fb-027a-4d5a-9587-7a55f781f78e tempest-VolumeDependencyTests-1168741681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-339b61b6-eddc-476d-9486-cb26a35190d2 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-339b61b6-eddc-476d-9486-cb26a35190d2.c2ac030d-98b3-4f44-8b9d-81fb14c37bd2 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:00:40 devstack sudo[104161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-339b61b6-eddc-476d-9486-cb26a35190d2 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-339b61b6-eddc-476d-9486-cb26a35190d2.c2ac030d-98b3-4f44-8b9d-81fb14c37bd2 Jul 08 02:00:40 devstack sudo[104161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:00:41 devstack sudo[104161]: pam_unix(sudo:session): session closed for user root Jul 08 02:00:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-dad1b4fb-027a-4d5a-9587-7a55f781f78e tempest-VolumeDependencyTests-1168741681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-339b61b6-eddc-476d-9486-cb26a35190d2 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-339b61b6-eddc-476d-9486-cb26a35190d2.c2ac030d-98b3-4f44-8b9d-81fb14c37bd2" returned: 0 in 0.748s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:00:41 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-dad1b4fb-027a-4d5a-9587-7a55f781f78e tempest-VolumeDependencyTests-1168741681 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-339b61b6-eddc-476d-9486-cb26a35190d2.c2ac030d-98b3-4f44-8b9d-81fb14c37bd2 is being set with open permissions: ugo+rw Jul 08 02:00:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-dad1b4fb-027a-4d5a-9587-7a55f781f78e tempest-VolumeDependencyTests-1168741681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-339b61b6-eddc-476d-9486-cb26a35190d2.c2ac030d-98b3-4f44-8b9d-81fb14c37bd2 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:00:41 devstack sudo[104169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-339b61b6-eddc-476d-9486-cb26a35190d2.c2ac030d-98b3-4f44-8b9d-81fb14c37bd2 Jul 08 02:00:41 devstack sudo[104169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:00:42 devstack sudo[104169]: pam_unix(sudo:session): session closed for user root Jul 08 02:00:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-dad1b4fb-027a-4d5a-9587-7a55f781f78e tempest-VolumeDependencyTests-1168741681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-339b61b6-eddc-476d-9486-cb26a35190d2.c2ac030d-98b3-4f44-8b9d-81fb14c37bd2" returned: 0 in 0.753s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:00:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-dad1b4fb-027a-4d5a-9587-7a55f781f78e tempest-VolumeDependencyTests-1168741681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-339b61b6-eddc-476d-9486-cb26a35190d2.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:00:42 devstack sudo[104172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-339b61b6-eddc-476d-9486-cb26a35190d2.info Jul 08 02:00:42 devstack sudo[104172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:00:43 devstack sudo[104172]: pam_unix(sudo:session): session closed for user root Jul 08 02:00:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-dad1b4fb-027a-4d5a-9587-7a55f781f78e tempest-VolumeDependencyTests-1168741681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-339b61b6-eddc-476d-9486-cb26a35190d2.info" returned: 0 in 0.785s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:00:43 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-dad1b4fb-027a-4d5a-9587-7a55f781f78e tempest-VolumeDependencyTests-1168741681 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-339b61b6-eddc-476d-9486-cb26a35190d2.info is being set with open permissions: ugo+rw Jul 08 02:00:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-dad1b4fb-027a-4d5a-9587-7a55f781f78e tempest-VolumeDependencyTests-1168741681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-339b61b6-eddc-476d-9486-cb26a35190d2.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:00:43 devstack sudo[104176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-339b61b6-eddc-476d-9486-cb26a35190d2.info Jul 08 02:00:43 devstack sudo[104176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:00:43 devstack sudo[104176]: pam_unix(sudo:session): session closed for user root Jul 08 02:00:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-dad1b4fb-027a-4d5a-9587-7a55f781f78e tempest-VolumeDependencyTests-1168741681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-339b61b6-eddc-476d-9486-cb26a35190d2.info" returned: 0 in 0.779s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:00:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-dad1b4fb-027a-4d5a-9587-7a55f781f78e tempest-VolumeDependencyTests-1168741681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.948s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:00:43 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-dad1b4fb-027a-4d5a-9587-7a55f781f78e tempest-VolumeDependencyTests-1168741681 None] Create snapshot completed successfully Jul 08 02:00:44 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ec95b7f-fd5b-415d-8c8f-a29d276479f5 tempest-VolumeDependencyTests-1168741681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:00:44 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-3ec95b7f-fd5b-415d-8c8f-a29d276479f5 tempest-VolumeDependencyTests-1168741681 None] Flow 'volume_create_manager' (054b7fb2-ba52-4b85-925b-e6314c3cada3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:00:44 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-3ec95b7f-fd5b-415d-8c8f-a29d276479f5 tempest-VolumeDependencyTests-1168741681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a6626bf-875a-405c-bcfa-dc4a620e92e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:00:44 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-3ec95b7f-fd5b-415d-8c8f-a29d276479f5 tempest-VolumeDependencyTests-1168741681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a6626bf-875a-405c-bcfa-dc4a620e92e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:00:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-362681617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=339654f5-1fe3-4842-a87c-93c794092f6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27826802aebe42bd8e853490362d2bfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:00:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c2ac030d-98b3-4f44-8b9d-81fb14c37bd2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:00:45Z,use_quota=True,user_id='fccfe85ec1f643bf8a18829c117f9181',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:00:44 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-3ec95b7f-fd5b-415d-8c8f-a29d276479f5 tempest-VolumeDependencyTests-1168741681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9a35ea8-60f5-4719-867e-58e1b7349b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:00:45 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-3ec95b7f-fd5b-415d-8c8f-a29d276479f5 tempest-VolumeDependencyTests-1168741681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9a35ea8-60f5-4719-867e-58e1b7349b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:00:45 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-3ec95b7f-fd5b-415d-8c8f-a29d276479f5 tempest-VolumeDependencyTests-1168741681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3b4fbbb-3f02-4dea-9a53-f0c5a98c58fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:00:45 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-3ec95b7f-fd5b-415d-8c8f-a29d276479f5 tempest-VolumeDependencyTests-1168741681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3b4fbbb-3f02-4dea-9a53-f0c5a98c58fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '339654f5-1fe3-4842-a87c-93c794092f6c', 'volume_name': 'volume-339654f5-1fe3-4842-a87c-93c794092f6c', 'volume_size': 1, 'snapshot_id': 'c2ac030d-98b3-4f44-8b9d-81fb14c37bd2'}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:00:45 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-3ec95b7f-fd5b-415d-8c8f-a29d276479f5 tempest-VolumeDependencyTests-1168741681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9c27d27-f603-49fd-b39e-055cc2237b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:00:45 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-3ec95b7f-fd5b-415d-8c8f-a29d276479f5 tempest-VolumeDependencyTests-1168741681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9c27d27-f603-49fd-b39e-055cc2237b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:00:45 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-3ec95b7f-fd5b-415d-8c8f-a29d276479f5 tempest-VolumeDependencyTests-1168741681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6bd8e50-d0c2-4269-ab7b-5abfff2c8233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:00:45 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-3ec95b7f-fd5b-415d-8c8f-a29d276479f5 tempest-VolumeDependencyTests-1168741681 None] Volume 339654f5-1fe3-4842-a87c-93c794092f6c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-339654f5-1fe3-4842-a87c-93c794092f6c', 'volume_size': 1, 'snapshot_id': 'c2ac030d-98b3-4f44-8b9d-81fb14c37bd2'} Jul 08 02:00:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-3ec95b7f-fd5b-415d-8c8f-a29d276479f5 tempest-VolumeDependencyTests-1168741681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:00:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-3ec95b7f-fd5b-415d-8c8f-a29d276479f5 tempest-VolumeDependencyTests-1168741681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:00:45 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-3ec95b7f-fd5b-415d-8c8f-a29d276479f5 tempest-VolumeDependencyTests-1168741681 None] Acquiring lock "cinder-quobyte-c2ac030d-98b3-4f44-8b9d-81fb14c37bd2-339654f5-1fe3-4842-a87c-93c794092f6c" by "_create_volume_from_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:00:45 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-3ec95b7f-fd5b-415d-8c8f-a29d276479f5 tempest-VolumeDependencyTests-1168741681 None] Lock "cinder-quobyte-c2ac030d-98b3-4f44-8b9d-81fb14c37bd2-339654f5-1fe3-4842-a87c-93c794092f6c" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:00:45 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-3ec95b7f-fd5b-415d-8c8f-a29d276479f5 tempest-VolumeDependencyTests-1168741681 None] Creating volume 339654f5-1fe3-4842-a87c-93c794092f6c from snapshot c2ac030d-98b3-4f44-8b9d-81fb14c37bd2 {{(pid=87134) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 02:00:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-3ec95b7f-fd5b-415d-8c8f-a29d276479f5 tempest-VolumeDependencyTests-1168741681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:00:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-3ec95b7f-fd5b-415d-8c8f-a29d276479f5 tempest-VolumeDependencyTests-1168741681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:00:45 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-3ec95b7f-fd5b-415d-8c8f-a29d276479f5 tempest-VolumeDependencyTests-1168741681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:00:45 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-3ec95b7f-fd5b-415d-8c8f-a29d276479f5 tempest-VolumeDependencyTests-1168741681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:00:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-3ec95b7f-fd5b-415d-8c8f-a29d276479f5 tempest-VolumeDependencyTests-1168741681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:00:45 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-3ec95b7f-fd5b-415d-8c8f-a29d276479f5 tempest-VolumeDependencyTests-1168741681 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:00:45 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-3ec95b7f-fd5b-415d-8c8f-a29d276479f5 tempest-VolumeDependencyTests-1168741681 None] Acquiring lock "cinder-quobyte-339654f5-1fe3-4842-a87c-93c794092f6c" by "_copy_volume_from_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:00:45 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-3ec95b7f-fd5b-415d-8c8f-a29d276479f5 tempest-VolumeDependencyTests-1168741681 None] Lock "cinder-quobyte-339654f5-1fe3-4842-a87c-93c794092f6c" acquired by "_copy_volume_from_snapshot" :: waited 0.040s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:00:45 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-3ec95b7f-fd5b-415d-8c8f-a29d276479f5 tempest-VolumeDependencyTests-1168741681 None] snapshot: c2ac030d-98b3-4f44-8b9d-81fb14c37bd2, volume: 339654f5-1fe3-4842-a87c-93c794092f6c, {{(pid=87134) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 02:00:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-3ec95b7f-fd5b-415d-8c8f-a29d276479f5 tempest-VolumeDependencyTests-1168741681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:00:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-3ec95b7f-fd5b-415d-8c8f-a29d276479f5 tempest-VolumeDependencyTests-1168741681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:00:45 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-3ec95b7f-fd5b-415d-8c8f-a29d276479f5 tempest-VolumeDependencyTests-1168741681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:00:45 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-3ec95b7f-fd5b-415d-8c8f-a29d276479f5 tempest-VolumeDependencyTests-1168741681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:00:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-3ec95b7f-fd5b-415d-8c8f-a29d276479f5 tempest-VolumeDependencyTests-1168741681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:00:45 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c8b2c0-39b4-463e-8560-2e910533c862]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:00:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-3ec95b7f-fd5b-415d-8c8f-a29d276479f5 tempest-VolumeDependencyTests-1168741681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-339b61b6-eddc-476d-9486-cb26a35190d2.c2ac030d-98b3-4f44-8b9d-81fb14c37bd2 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:00:45 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-74201682-febb-40f3-a5d7-f8e617ad4764 tempest-TestMinimumBasicScenario-1410073213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:00:45 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-74201682-febb-40f3-a5d7-f8e617ad4764 tempest-TestMinimumBasicScenario-1410073213 None] Flow 'volume_create_manager' (98bd1d16-489a-41c2-ba33-02b8c5473bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:00:45 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-74201682-febb-40f3-a5d7-f8e617ad4764 tempest-TestMinimumBasicScenario-1410073213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f508dada-a8a3-49eb-a81d-979ef8771455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:00:45 devstack sudo[104179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-339b61b6-eddc-476d-9486-cb26a35190d2.c2ac030d-98b3-4f44-8b9d-81fb14c37bd2 Jul 08 02:00:45 devstack sudo[104179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:00:45 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-74201682-febb-40f3-a5d7-f8e617ad4764 tempest-TestMinimumBasicScenario-1410073213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f508dada-a8a3-49eb-a81d-979ef8771455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:00:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1469103899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab0de315-914a-45b7-a181-3b78b270970c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22861bc26f83446ca758892e9f2d5ee3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:00:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:00:45Z,use_quota=True,user_id='5fc8c2d2ec6a4e08a5c926c5f9369545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:00:45 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-74201682-febb-40f3-a5d7-f8e617ad4764 tempest-TestMinimumBasicScenario-1410073213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e36437a1-3b78-4020-93ae-26847bf77df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:00:45 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-74201682-febb-40f3-a5d7-f8e617ad4764 tempest-TestMinimumBasicScenario-1410073213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e36437a1-3b78-4020-93ae-26847bf77df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:00:45 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-74201682-febb-40f3-a5d7-f8e617ad4764 tempest-TestMinimumBasicScenario-1410073213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec93efd5-7853-4ace-99f1-da6cf6e4198a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:00:45 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-74201682-febb-40f3-a5d7-f8e617ad4764 tempest-TestMinimumBasicScenario-1410073213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec93efd5-7853-4ace-99f1-da6cf6e4198a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab0de315-914a-45b7-a181-3b78b270970c', 'volume_name': 'volume-ab0de315-914a-45b7-a181-3b78b270970c', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:00:45 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-74201682-febb-40f3-a5d7-f8e617ad4764 tempest-TestMinimumBasicScenario-1410073213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ded5273-0498-4223-b016-2d67f3ca5804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:00:45 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-74201682-febb-40f3-a5d7-f8e617ad4764 tempest-TestMinimumBasicScenario-1410073213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ded5273-0498-4223-b016-2d67f3ca5804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:00:45 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-74201682-febb-40f3-a5d7-f8e617ad4764 tempest-TestMinimumBasicScenario-1410073213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb2eb8ad-7d28-495b-ae22-c91529b607a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:00:45 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-74201682-febb-40f3-a5d7-f8e617ad4764 tempest-TestMinimumBasicScenario-1410073213 None] Volume ab0de315-914a-45b7-a181-3b78b270970c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab0de315-914a-45b7-a181-3b78b270970c', 'volume_size': 1} Jul 08 02:00:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-74201682-febb-40f3-a5d7-f8e617ad4764 tempest-TestMinimumBasicScenario-1410073213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:00:46 devstack sudo[104179]: pam_unix(sudo:session): session closed for user root Jul 08 02:00:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-3ec95b7f-fd5b-415d-8c8f-a29d276479f5 tempest-VolumeDependencyTests-1168741681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-339b61b6-eddc-476d-9486-cb26a35190d2.c2ac030d-98b3-4f44-8b9d-81fb14c37bd2" returned: 0 in 0.841s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:00:46 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-3ec95b7f-fd5b-415d-8c8f-a29d276479f5 tempest-VolumeDependencyTests-1168741681 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-339b61b6-eddc-476d-9486-cb26a35190d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:00:46 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-3ec95b7f-fd5b-415d-8c8f-a29d276479f5 tempest-VolumeDependencyTests-1168741681 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-339b61b6-eddc-476d-9486-cb26a35190d2 {{(pid=87134) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 02:00:46 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-3ec95b7f-fd5b-415d-8c8f-a29d276479f5 tempest-VolumeDependencyTests-1168741681 None] Creating direct copy from snapshot {{(pid=87134) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 02:00:46 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16ff2a3-55ab-494d-8837-310fc013db4e]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:00:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-3ec95b7f-fd5b-415d-8c8f-a29d276479f5 tempest-VolumeDependencyTests-1168741681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-339b61b6-eddc-476d-9486-cb26a35190d2 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:00:46 devstack sudo[104184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-339b61b6-eddc-476d-9486-cb26a35190d2 Jul 08 02:00:46 devstack sudo[104184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:00:46 devstack sudo[104184]: pam_unix(sudo:session): session closed for user root Jul 08 02:00:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-3ec95b7f-fd5b-415d-8c8f-a29d276479f5 tempest-VolumeDependencyTests-1168741681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-339b61b6-eddc-476d-9486-cb26a35190d2" returned: 0 in 0.756s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:00:46 devstack cinder-volume[87134]: DEBUG cinder.utils [None req-3ec95b7f-fd5b-415d-8c8f-a29d276479f5 tempest-VolumeDependencyTests-1168741681 None] Path /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-339654f5-1fe3-4842-a87c-93c794092f6c not found in is_blk_device check {{(pid=87134) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 02:00:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-3ec95b7f-fd5b-415d-8c8f-a29d276479f5 tempest-VolumeDependencyTests-1168741681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-339b61b6-eddc-476d-9486-cb26a35190d2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-339654f5-1fe3-4842-a87c-93c794092f6c {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:00:46 devstack sudo[104189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-339b61b6-eddc-476d-9486-cb26a35190d2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-339654f5-1fe3-4842-a87c-93c794092f6c Jul 08 02:00:46 devstack sudo[104189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:00:52 devstack sudo[104189]: pam_unix(sudo:session): session closed for user root Jul 08 02:00:52 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-3ec95b7f-fd5b-415d-8c8f-a29d276479f5 tempest-VolumeDependencyTests-1168741681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-339b61b6-eddc-476d-9486-cb26a35190d2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-339654f5-1fe3-4842-a87c-93c794092f6c" returned: 0 in 5.362s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:00:52 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a624e9-efad-4e1e-800b-8b1e6e66800e]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:00:52 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-3ec95b7f-fd5b-415d-8c8f-a29d276479f5 tempest-VolumeDependencyTests-1168741681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-339b61b6-eddc-476d-9486-cb26a35190d2 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:00:52 devstack sudo[104202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-339b61b6-eddc-476d-9486-cb26a35190d2 Jul 08 02:00:52 devstack sudo[104202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:00:53 devstack sudo[104202]: pam_unix(sudo:session): session closed for user root Jul 08 02:00:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-3ec95b7f-fd5b-415d-8c8f-a29d276479f5 tempest-VolumeDependencyTests-1168741681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-339b61b6-eddc-476d-9486-cb26a35190d2" returned: 0 in 0.896s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:00:53 devstack cinder-volume[87134]: DEBUG cinder.image.image_utils [None req-3ec95b7f-fd5b-415d-8c8f-a29d276479f5 tempest-VolumeDependencyTests-1168741681 None] Image conversion details: src /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-339b61b6-eddc-476d-9486-cb26a35190d2, size 1024.00 MB, duration 5.36 sec, destination /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-339654f5-1fe3-4842-a87c-93c794092f6c {{(pid=87134) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 02:00:53 devstack cinder-volume[87134]: INFO cinder.image.image_utils [None req-3ec95b7f-fd5b-415d-8c8f-a29d276479f5 tempest-VolumeDependencyTests-1168741681 None] Converted 1024.00 MB image at 190.94 MB/s Jul 08 02:00:53 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-3ec95b7f-fd5b-415d-8c8f-a29d276479f5 tempest-VolumeDependencyTests-1168741681 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-339654f5-1fe3-4842-a87c-93c794092f6c is being set with open permissions: ugo+rw Jul 08 02:00:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-3ec95b7f-fd5b-415d-8c8f-a29d276479f5 tempest-VolumeDependencyTests-1168741681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-339654f5-1fe3-4842-a87c-93c794092f6c {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:00:53 devstack sudo[104208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-339654f5-1fe3-4842-a87c-93c794092f6c Jul 08 02:00:53 devstack sudo[104208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:00:53 devstack sudo[104208]: pam_unix(sudo:session): session closed for user root Jul 08 02:00:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-3ec95b7f-fd5b-415d-8c8f-a29d276479f5 tempest-VolumeDependencyTests-1168741681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-339654f5-1fe3-4842-a87c-93c794092f6c" returned: 0 in 0.669s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:00:53 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-3ec95b7f-fd5b-415d-8c8f-a29d276479f5 tempest-VolumeDependencyTests-1168741681 None] Lock "cinder-quobyte-339654f5-1fe3-4842-a87c-93c794092f6c" released by "_copy_volume_from_snapshot" :: held 8.645s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:00:53 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-3ec95b7f-fd5b-415d-8c8f-a29d276479f5 tempest-VolumeDependencyTests-1168741681 None] Lock "cinder-quobyte-c2ac030d-98b3-4f44-8b9d-81fb14c37bd2-339654f5-1fe3-4842-a87c-93c794092f6c" released by "_create_volume_from_snapshot" :: held 8.711s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:00:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-3ec95b7f-fd5b-415d-8c8f-a29d276479f5 tempest-VolumeDependencyTests-1168741681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.736s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:00:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-74201682-febb-40f3-a5d7-f8e617ad4764 tempest-TestMinimumBasicScenario-1410073213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.411s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:00:53 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-74201682-febb-40f3-a5d7-f8e617ad4764 tempest-TestMinimumBasicScenario-1410073213 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:00:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1469103899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab0de315-914a-45b7-a181-3b78b270970c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22861bc26f83446ca758892e9f2d5ee3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:00:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:00:45Z,use_quota=True,user_id='5fc8c2d2ec6a4e08a5c926c5f9369545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:00:53 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-74201682-febb-40f3-a5d7-f8e617ad4764 tempest-TestMinimumBasicScenario-1410073213 None] Creating volume ab0de315-914a-45b7-a181-3b78b270970c {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:00:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-74201682-febb-40f3-a5d7-f8e617ad4764 tempest-TestMinimumBasicScenario-1410073213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:00:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-74201682-febb-40f3-a5d7-f8e617ad4764 tempest-TestMinimumBasicScenario-1410073213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:00:53 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-74201682-febb-40f3-a5d7-f8e617ad4764 tempest-TestMinimumBasicScenario-1410073213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:00:53 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-74201682-febb-40f3-a5d7-f8e617ad4764 tempest-TestMinimumBasicScenario-1410073213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:00:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-74201682-febb-40f3-a5d7-f8e617ad4764 tempest-TestMinimumBasicScenario-1410073213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:00:53 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-74201682-febb-40f3-a5d7-f8e617ad4764 tempest-TestMinimumBasicScenario-1410073213 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:00:53 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-74201682-febb-40f3-a5d7-f8e617ad4764 tempest-TestMinimumBasicScenario-1410073213 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 02:00:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-74201682-febb-40f3-a5d7-f8e617ad4764 tempest-TestMinimumBasicScenario-1410073213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ab0de315-914a-45b7-a181-3b78b270970c 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:00:53 devstack cinder-volume[87134]: DEBUG dbcounter [-] [87134] Writing DB stats cinder:SELECT=85,cinder:INSERT=27,cinder:UPDATE=103,cinder:DELETE=5 {{(pid=87134) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:00:53 devstack cinder-volume[87134]: DEBUG dbcounter [-] [87134] Writing DB stats cinder:SELECT=69,cinder:INSERT=31,cinder:UPDATE=104,cinder:DELETE=12 {{(pid=87134) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:00:53 devstack sudo[104236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ab0de315-914a-45b7-a181-3b78b270970c 1073741824 Jul 08 02:00:53 devstack sudo[104236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:00:53 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-3ec95b7f-fd5b-415d-8c8f-a29d276479f5 tempest-VolumeDependencyTests-1168741681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6bd8e50-d0c2-4269-ab7b-5abfff2c8233) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-339654f5-1fe3-4842-a87c-93c794092f6c', 'volume_size': 1, 'snapshot_id': 'c2ac030d-98b3-4f44-8b9d-81fb14c37bd2'}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:00:53 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-3ec95b7f-fd5b-415d-8c8f-a29d276479f5 tempest-VolumeDependencyTests-1168741681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (873c4a21-8164-42a0-b891-6e0131fd0e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:00:53 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-3ec95b7f-fd5b-415d-8c8f-a29d276479f5 tempest-VolumeDependencyTests-1168741681 None] Volume volume-339654f5-1fe3-4842-a87c-93c794092f6c (339654f5-1fe3-4842-a87c-93c794092f6c): created successfully Jul 08 02:00:53 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-3ec95b7f-fd5b-415d-8c8f-a29d276479f5 tempest-VolumeDependencyTests-1168741681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (873c4a21-8164-42a0-b891-6e0131fd0e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:00:53 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-3ec95b7f-fd5b-415d-8c8f-a29d276479f5 tempest-VolumeDependencyTests-1168741681 None] Flow 'volume_create_manager' (054b7fb2-ba52-4b85-925b-e6314c3cada3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:00:53 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-3ec95b7f-fd5b-415d-8c8f-a29d276479f5 tempest-VolumeDependencyTests-1168741681 None] Created volume successfully. Jul 08 02:00:54 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-e4078769-6c59-421c-89e1-76f74c7875f0 tempest-VolumeDependencyTests-1168741681 None] Acquiring lock "cinder-c2ac030d-98b3-4f44-8b9d-81fb14c37bd2-delete_snapshot" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:00:54 devstack sudo[104236]: pam_unix(sudo:session): session closed for user root Jul 08 02:00:54 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-e4078769-6c59-421c-89e1-76f74c7875f0 tempest-VolumeDependencyTests-1168741681 None] Lock "cinder-c2ac030d-98b3-4f44-8b9d-81fb14c37bd2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:00:54 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-e4078769-6c59-421c-89e1-76f74c7875f0 tempest-VolumeDependencyTests-1168741681 None] Acquiring lock "cinder-quobyte-339b61b6-eddc-476d-9486-cb26a35190d2" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:00:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-74201682-febb-40f3-a5d7-f8e617ad4764 tempest-TestMinimumBasicScenario-1410073213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ab0de315-914a-45b7-a181-3b78b270970c 1073741824" returned: 0 in 0.978s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:00:54 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-e4078769-6c59-421c-89e1-76f74c7875f0 tempest-VolumeDependencyTests-1168741681 None] Lock "cinder-quobyte-339b61b6-eddc-476d-9486-cb26a35190d2" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:00:54 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-e4078769-6c59-421c-89e1-76f74c7875f0 tempest-VolumeDependencyTests-1168741681 None] Acquiring lock "cinder-quobyte-c2ac030d-98b3-4f44-8b9d-81fb14c37bd2" by "_delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:00:54 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-e4078769-6c59-421c-89e1-76f74c7875f0 tempest-VolumeDependencyTests-1168741681 None] Lock "cinder-quobyte-c2ac030d-98b3-4f44-8b9d-81fb14c37bd2" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:00:54 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-e4078769-6c59-421c-89e1-76f74c7875f0 tempest-VolumeDependencyTests-1168741681 None] Deleting offline snapshot c2ac030d-98b3-4f44-8b9d-81fb14c37bd2 of volume 339b61b6-eddc-476d-9486-cb26a35190d2 {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 02:00:54 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-e4078769-6c59-421c-89e1-76f74c7875f0 tempest-VolumeDependencyTests-1168741681 None] snapshot_file for this snap is: volume-339b61b6-eddc-476d-9486-cb26a35190d2.c2ac030d-98b3-4f44-8b9d-81fb14c37bd2 {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 02:00:54 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[14fd0994-5a05-4251-ad35-325106abc110]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:00:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e4078769-6c59-421c-89e1-76f74c7875f0 tempest-VolumeDependencyTests-1168741681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-339b61b6-eddc-476d-9486-cb26a35190d2.c2ac030d-98b3-4f44-8b9d-81fb14c37bd2 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:00:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-74201682-febb-40f3-a5d7-f8e617ad4764 tempest-TestMinimumBasicScenario-1410073213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ab0de315-914a-45b7-a181-3b78b270970c {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:00:54 devstack sudo[104243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ab0de315-914a-45b7-a181-3b78b270970c Jul 08 02:00:54 devstack sudo[104243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:00:54 devstack sudo[104242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-339b61b6-eddc-476d-9486-cb26a35190d2.c2ac030d-98b3-4f44-8b9d-81fb14c37bd2 Jul 08 02:00:55 devstack sudo[104242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:00:55 devstack sudo[104243]: pam_unix(sudo:session): session closed for user root Jul 08 02:00:55 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-74201682-febb-40f3-a5d7-f8e617ad4764 tempest-TestMinimumBasicScenario-1410073213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ab0de315-914a-45b7-a181-3b78b270970c" returned: 0 in 0.672s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:00:55 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-74201682-febb-40f3-a5d7-f8e617ad4764 tempest-TestMinimumBasicScenario-1410073213 None] <== create_volume: return (1745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:00:55 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-74201682-febb-40f3-a5d7-f8e617ad4764 tempest-TestMinimumBasicScenario-1410073213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.749s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:00:55 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-74201682-febb-40f3-a5d7-f8e617ad4764 tempest-TestMinimumBasicScenario-1410073213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb2eb8ad-7d28-495b-ae22-c91529b607a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab0de315-914a-45b7-a181-3b78b270970c', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:00:55 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-74201682-febb-40f3-a5d7-f8e617ad4764 tempest-TestMinimumBasicScenario-1410073213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d9923df-2ba7-47e0-b14b-a3b8401dd3bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:00:55 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-74201682-febb-40f3-a5d7-f8e617ad4764 tempest-TestMinimumBasicScenario-1410073213 None] Volume volume-ab0de315-914a-45b7-a181-3b78b270970c (ab0de315-914a-45b7-a181-3b78b270970c): created successfully Jul 08 02:00:55 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-74201682-febb-40f3-a5d7-f8e617ad4764 tempest-TestMinimumBasicScenario-1410073213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d9923df-2ba7-47e0-b14b-a3b8401dd3bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:00:55 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-74201682-febb-40f3-a5d7-f8e617ad4764 tempest-TestMinimumBasicScenario-1410073213 None] Flow 'volume_create_manager' (98bd1d16-489a-41c2-ba33-02b8c5473bc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:00:55 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-74201682-febb-40f3-a5d7-f8e617ad4764 tempest-TestMinimumBasicScenario-1410073213 None] Created volume successfully. Jul 08 02:00:55 devstack sudo[104242]: pam_unix(sudo:session): session closed for user root Jul 08 02:00:55 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e4078769-6c59-421c-89e1-76f74c7875f0 tempest-VolumeDependencyTests-1168741681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-339b61b6-eddc-476d-9486-cb26a35190d2.c2ac030d-98b3-4f44-8b9d-81fb14c37bd2" returned: 0 in 0.850s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:00:55 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-e4078769-6c59-421c-89e1-76f74c7875f0 tempest-VolumeDependencyTests-1168741681 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-339b61b6-eddc-476d-9486-cb26a35190d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:00:55 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[17844841-d636-4f10-bd8b-b6276c910d22]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:00:55 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e4078769-6c59-421c-89e1-76f74c7875f0 tempest-VolumeDependencyTests-1168741681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-339b61b6-eddc-476d-9486-cb26a35190d2 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:00:55 devstack sudo[104250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-339b61b6-eddc-476d-9486-cb26a35190d2 Jul 08 02:00:55 devstack sudo[104250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:00:56 devstack sudo[104250]: pam_unix(sudo:session): session closed for user root Jul 08 02:00:56 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e4078769-6c59-421c-89e1-76f74c7875f0 tempest-VolumeDependencyTests-1168741681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-339b61b6-eddc-476d-9486-cb26a35190d2" returned: 0 in 0.778s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:00:56 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e4078769-6c59-421c-89e1-76f74c7875f0 tempest-VolumeDependencyTests-1168741681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-339b61b6-eddc-476d-9486-cb26a35190d2.c2ac030d-98b3-4f44-8b9d-81fb14c37bd2 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:00:56 devstack sudo[104258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-339b61b6-eddc-476d-9486-cb26a35190d2.c2ac030d-98b3-4f44-8b9d-81fb14c37bd2 Jul 08 02:00:56 devstack sudo[104258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:00:57 devstack sudo[104258]: pam_unix(sudo:session): session closed for user root Jul 08 02:00:57 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e4078769-6c59-421c-89e1-76f74c7875f0 tempest-VolumeDependencyTests-1168741681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-339b61b6-eddc-476d-9486-cb26a35190d2.c2ac030d-98b3-4f44-8b9d-81fb14c37bd2" returned: 0 in 0.762s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:00:57 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e4078769-6c59-421c-89e1-76f74c7875f0 tempest-VolumeDependencyTests-1168741681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-339b61b6-eddc-476d-9486-cb26a35190d2.c2ac030d-98b3-4f44-8b9d-81fb14c37bd2 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:00:57 devstack sudo[104263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-339b61b6-eddc-476d-9486-cb26a35190d2.c2ac030d-98b3-4f44-8b9d-81fb14c37bd2 Jul 08 02:00:57 devstack sudo[104263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:00:57 devstack sudo[104263]: pam_unix(sudo:session): session closed for user root Jul 08 02:00:57 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e4078769-6c59-421c-89e1-76f74c7875f0 tempest-VolumeDependencyTests-1168741681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-339b61b6-eddc-476d-9486-cb26a35190d2.c2ac030d-98b3-4f44-8b9d-81fb14c37bd2" returned: 0 in 0.644s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:00:57 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-e4078769-6c59-421c-89e1-76f74c7875f0 tempest-VolumeDependencyTests-1168741681 None] Lock "cinder-quobyte-c2ac030d-98b3-4f44-8b9d-81fb14c37bd2" released by "_delete_snapshot" :: held 3.129s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:00:57 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-e4078769-6c59-421c-89e1-76f74c7875f0 tempest-VolumeDependencyTests-1168741681 None] Lock "cinder-quobyte-339b61b6-eddc-476d-9486-cb26a35190d2" released by "delete_snapshot" :: held 3.152s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:00:58 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-e4078769-6c59-421c-89e1-76f74c7875f0 tempest-VolumeDependencyTests-1168741681 None] Created reservations ['4d89ae2b-90e7-4a2d-bda6-b97a16698f49', '0995f34a-9b2e-4992-b05f-c90601a847b0', 'f0cc9134-8390-48b2-90a1-ee443cb465b6', '536cb8ad-e1bd-44db-be3d-d5950628f4e2'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:00:58 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-e4078769-6c59-421c-89e1-76f74c7875f0 tempest-VolumeDependencyTests-1168741681 None] Delete snapshot completed successfully. Jul 08 02:00:58 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-e4078769-6c59-421c-89e1-76f74c7875f0 tempest-VolumeDependencyTests-1168741681 None] Lock "cinder-c2ac030d-98b3-4f44-8b9d-81fb14c37bd2-delete_snapshot" released by "delete_snapshot" :: held 3.300s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:00:59 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-483e885c-437b-4d64-9ef4-a521bf730a00 tempest-VolumeDependencyTests-1168741681 None] Acquiring lock "cinder-339b61b6-eddc-476d-9486-cb26a35190d2-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:00:59 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-483e885c-437b-4d64-9ef4-a521bf730a00 tempest-VolumeDependencyTests-1168741681 None] Lock "cinder-339b61b6-eddc-476d-9486-cb26a35190d2-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:00:59 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-483e885c-437b-4d64-9ef4-a521bf730a00 tempest-VolumeDependencyTests-1168741681 None] Acquiring lock "cinder-quobyte-339b61b6-eddc-476d-9486-cb26a35190d2" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:00:59 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-483e885c-437b-4d64-9ef4-a521bf730a00 tempest-VolumeDependencyTests-1168741681 None] Lock "cinder-quobyte-339b61b6-eddc-476d-9486-cb26a35190d2" acquired by "delete_volume" :: waited 0.016s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:00:59 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c525a1d-b6a7-41bf-85f8-e6c5c72874b0]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:00:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-483e885c-437b-4d64-9ef4-a521bf730a00 tempest-VolumeDependencyTests-1168741681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-339b61b6-eddc-476d-9486-cb26a35190d2 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:00:59 devstack sudo[104266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-339b61b6-eddc-476d-9486-cb26a35190d2 Jul 08 02:00:59 devstack sudo[104266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:00:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-256eaa6c-8101-4719-a9e8-8bac828d929c req-2934b8ad-52ca-4062-9873-dc9392f33132 tempest-TestMinimumBasicScenario-1410073213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:00:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-256eaa6c-8101-4719-a9e8-8bac828d929c req-2934b8ad-52ca-4062-9873-dc9392f33132 tempest-TestMinimumBasicScenario-1410073213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:00:59 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4419d7a-2233-493c-bb0f-31caea4d1f4a]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:00:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-256eaa6c-8101-4719-a9e8-8bac828d929c req-2934b8ad-52ca-4062-9873-dc9392f33132 tempest-TestMinimumBasicScenario-1410073213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ab0de315-914a-45b7-a181-3b78b270970c {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:00:59 devstack sudo[104276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ab0de315-914a-45b7-a181-3b78b270970c Jul 08 02:00:59 devstack sudo[104276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:00:59 devstack sudo[104266]: pam_unix(sudo:session): session closed for user root Jul 08 02:00:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-483e885c-437b-4d64-9ef4-a521bf730a00 tempest-VolumeDependencyTests-1168741681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-339b61b6-eddc-476d-9486-cb26a35190d2" returned: 0 in 0.777s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:00:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-483e885c-437b-4d64-9ef4-a521bf730a00 tempest-VolumeDependencyTests-1168741681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-339b61b6-eddc-476d-9486-cb26a35190d2 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:00:59 devstack sudo[104281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-339b61b6-eddc-476d-9486-cb26a35190d2 Jul 08 02:00:59 devstack sudo[104281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:01:00 devstack sudo[104276]: pam_unix(sudo:session): session closed for user root Jul 08 02:01:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-256eaa6c-8101-4719-a9e8-8bac828d929c req-2934b8ad-52ca-4062-9873-dc9392f33132 tempest-TestMinimumBasicScenario-1410073213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ab0de315-914a-45b7-a181-3b78b270970c" returned: 0 in 0.813s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:01:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-256eaa6c-8101-4719-a9e8-8bac828d929c req-2934b8ad-52ca-4062-9873-dc9392f33132 tempest-TestMinimumBasicScenario-1410073213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.832s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:01:00 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [req-256eaa6c-8101-4719-a9e8-8bac828d929c req-2934b8ad-52ca-4062-9873-dc9392f33132 tempest-TestMinimumBasicScenario-1410073213 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17', 'name': 'volume-ab0de315-914a-45b7-a181-3b78b270970c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ce211be8-0f30-4cbe-9f36-2dfc47480b19', 'enforce_multipath': True} {{(pid=87134) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 02:01:00 devstack cinder-volume[87134]: INFO cinder.volume.manager [req-256eaa6c-8101-4719-a9e8-8bac828d929c req-2934b8ad-52ca-4062-9873-dc9392f33132 tempest-TestMinimumBasicScenario-1410073213 None] attachment_update completed successfully. Jul 08 02:01:00 devstack sudo[104281]: pam_unix(sudo:session): session closed for user root Jul 08 02:01:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-483e885c-437b-4d64-9ef4-a521bf730a00 tempest-VolumeDependencyTests-1168741681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-339b61b6-eddc-476d-9486-cb26a35190d2" returned: 0 in 0.705s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:01:00 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-483e885c-437b-4d64-9ef4-a521bf730a00 tempest-VolumeDependencyTests-1168741681 None] Lock "cinder-quobyte-339b61b6-eddc-476d-9486-cb26a35190d2" released by "delete_volume" :: held 1.545s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:01:00 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-483e885c-437b-4d64-9ef4-a521bf730a00 tempest-VolumeDependencyTests-1168741681 None] Created reservations ['01cc1093-a467-4c51-bb05-63ca7b3e7711', 'a8afa6a3-34ab-4ace-81af-b5275c640773', '7537abcd-a528-46bd-a27c-0881e2b8f943', '21de8974-49c1-4e27-933b-d28bdac0940b'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:01:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-483e885c-437b-4d64-9ef4-a521bf730a00 tempest-VolumeDependencyTests-1168741681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:01:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-483e885c-437b-4d64-9ef4-a521bf730a00 tempest-VolumeDependencyTests-1168741681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:01:00 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-483e885c-437b-4d64-9ef4-a521bf730a00 tempest-VolumeDependencyTests-1168741681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:01:00 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-483e885c-437b-4d64-9ef4-a521bf730a00 tempest-VolumeDependencyTests-1168741681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:01:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-483e885c-437b-4d64-9ef4-a521bf730a00 tempest-VolumeDependencyTests-1168741681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:01:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-483e885c-437b-4d64-9ef4-a521bf730a00 tempest-VolumeDependencyTests-1168741681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:01:00 devstack sudo[104667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 02:01:00 devstack sudo[104667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:01:01 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-e179083e-70ad-4f2f-8316-2688048b04ca tempest-VolumeDependencyTests-1168741681 None] Acquiring lock "cinder-339654f5-1fe3-4842-a87c-93c794092f6c-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:01:01 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-e179083e-70ad-4f2f-8316-2688048b04ca tempest-VolumeDependencyTests-1168741681 None] Lock "cinder-339654f5-1fe3-4842-a87c-93c794092f6c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:01:01 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-e179083e-70ad-4f2f-8316-2688048b04ca tempest-VolumeDependencyTests-1168741681 None] Acquiring lock "cinder-quobyte-339654f5-1fe3-4842-a87c-93c794092f6c" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:01:01 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-e179083e-70ad-4f2f-8316-2688048b04ca tempest-VolumeDependencyTests-1168741681 None] Lock "cinder-quobyte-339654f5-1fe3-4842-a87c-93c794092f6c" acquired by "delete_volume" :: waited 0.023s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:01:01 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[8625dd1c-04ff-410b-b43d-5bc1511ec933]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:01:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e179083e-70ad-4f2f-8316-2688048b04ca tempest-VolumeDependencyTests-1168741681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-339654f5-1fe3-4842-a87c-93c794092f6c {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:01:01 devstack sudo[104667]: pam_unix(sudo:session): session closed for user root Jul 08 02:01:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-483e885c-437b-4d64-9ef4-a521bf730a00 tempest-VolumeDependencyTests-1168741681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.795s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:01:01 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-483e885c-437b-4d64-9ef4-a521bf730a00 tempest-VolumeDependencyTests-1168741681 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:01:01 devstack sudo[104672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-339654f5-1fe3-4842-a87c-93c794092f6c Jul 08 02:01:01 devstack sudo[104672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:01:01 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-483e885c-437b-4d64-9ef4-a521bf730a00 tempest-VolumeDependencyTests-1168741681 None] Deleted volume successfully. Jul 08 02:01:01 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-483e885c-437b-4d64-9ef4-a521bf730a00 tempest-VolumeDependencyTests-1168741681 None] Lock "cinder-339b61b6-eddc-476d-9486-cb26a35190d2-delete_volume" released by "delete_volume" :: held 2.610s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:01:02 devstack sudo[104672]: pam_unix(sudo:session): session closed for user root Jul 08 02:01:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e179083e-70ad-4f2f-8316-2688048b04ca tempest-VolumeDependencyTests-1168741681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-339654f5-1fe3-4842-a87c-93c794092f6c" returned: 0 in 0.894s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:01:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e179083e-70ad-4f2f-8316-2688048b04ca tempest-VolumeDependencyTests-1168741681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-339654f5-1fe3-4842-a87c-93c794092f6c {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:01:02 devstack sudo[104682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-339654f5-1fe3-4842-a87c-93c794092f6c Jul 08 02:01:02 devstack sudo[104682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:01:03 devstack sudo[104682]: pam_unix(sudo:session): session closed for user root Jul 08 02:01:03 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e179083e-70ad-4f2f-8316-2688048b04ca tempest-VolumeDependencyTests-1168741681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-339654f5-1fe3-4842-a87c-93c794092f6c" returned: 0 in 0.719s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:01:03 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-e179083e-70ad-4f2f-8316-2688048b04ca tempest-VolumeDependencyTests-1168741681 None] Lock "cinder-quobyte-339654f5-1fe3-4842-a87c-93c794092f6c" released by "delete_volume" :: held 1.672s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:01:03 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-e179083e-70ad-4f2f-8316-2688048b04ca tempest-VolumeDependencyTests-1168741681 None] Created reservations ['1f2c59bf-63c3-4ca2-9bed-85f06363b6a4', 'dad6aa0f-14fa-4975-b098-c8d4d222dd90', 'aedc9220-e102-4d24-aa07-228b108c58d3', '85670202-2d2d-4ff1-8269-2d978fe9c775'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:01:03 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e179083e-70ad-4f2f-8316-2688048b04ca tempest-VolumeDependencyTests-1168741681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:01:03 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e179083e-70ad-4f2f-8316-2688048b04ca tempest-VolumeDependencyTests-1168741681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:01:03 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-e179083e-70ad-4f2f-8316-2688048b04ca tempest-VolumeDependencyTests-1168741681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:01:03 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-e179083e-70ad-4f2f-8316-2688048b04ca tempest-VolumeDependencyTests-1168741681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:01:03 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e179083e-70ad-4f2f-8316-2688048b04ca tempest-VolumeDependencyTests-1168741681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:01:03 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e179083e-70ad-4f2f-8316-2688048b04ca tempest-VolumeDependencyTests-1168741681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:01:03 devstack sudo[104686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 02:01:03 devstack sudo[104686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:01:03 devstack sudo[104686]: pam_unix(sudo:session): session closed for user root Jul 08 02:01:03 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e179083e-70ad-4f2f-8316-2688048b04ca tempest-VolumeDependencyTests-1168741681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.711s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:01:03 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-e179083e-70ad-4f2f-8316-2688048b04ca tempest-VolumeDependencyTests-1168741681 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:01:03 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-e179083e-70ad-4f2f-8316-2688048b04ca tempest-VolumeDependencyTests-1168741681 None] Deleted volume successfully. Jul 08 02:01:03 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-e179083e-70ad-4f2f-8316-2688048b04ca tempest-VolumeDependencyTests-1168741681 None] Lock "cinder-339654f5-1fe3-4842-a87c-93c794092f6c-delete_volume" released by "delete_volume" :: held 2.651s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:01:07 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd09decf-e32b-4b30-aa0c-37119ccf2ae8 tempest-ProjectReaderTests-711911046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:01:07 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-dd09decf-e32b-4b30-aa0c-37119ccf2ae8 tempest-ProjectReaderTests-711911046 None] Flow 'volume_create_manager' (5d6cee46-caec-4d8f-93ed-da43b111ea86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:01:07 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-dd09decf-e32b-4b30-aa0c-37119ccf2ae8 tempest-ProjectReaderTests-711911046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cd2003d-b364-49f2-ad8a-372c8c642759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:01:07 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-dd09decf-e32b-4b30-aa0c-37119ccf2ae8 tempest-ProjectReaderTests-711911046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cd2003d-b364-49f2-ad8a-372c8c642759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:01:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1329725492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f57c7f1a-a456-41de-91a9-dbd61409832a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a48ca13c5744b789d52c0b4964d2647',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:01:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:01:07Z,use_quota=True,user_id='d627f0164ad347c09518ddf4e1940db9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:01:07 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-dd09decf-e32b-4b30-aa0c-37119ccf2ae8 tempest-ProjectReaderTests-711911046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (267a69ce-3520-495b-99c9-d9bbb06cb45e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:01:07 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-dd09decf-e32b-4b30-aa0c-37119ccf2ae8 tempest-ProjectReaderTests-711911046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (267a69ce-3520-495b-99c9-d9bbb06cb45e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:01:07 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-dd09decf-e32b-4b30-aa0c-37119ccf2ae8 tempest-ProjectReaderTests-711911046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e69a2ad8-304f-4fd7-91b1-9aee54b09de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:01:07 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-dd09decf-e32b-4b30-aa0c-37119ccf2ae8 tempest-ProjectReaderTests-711911046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e69a2ad8-304f-4fd7-91b1-9aee54b09de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f57c7f1a-a456-41de-91a9-dbd61409832a', 'volume_name': 'volume-f57c7f1a-a456-41de-91a9-dbd61409832a', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:01:07 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-dd09decf-e32b-4b30-aa0c-37119ccf2ae8 tempest-ProjectReaderTests-711911046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad89c85b-1039-49c4-b4ad-fa0dd883313f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:01:07 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-dd09decf-e32b-4b30-aa0c-37119ccf2ae8 tempest-ProjectReaderTests-711911046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad89c85b-1039-49c4-b4ad-fa0dd883313f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:01:07 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-dd09decf-e32b-4b30-aa0c-37119ccf2ae8 tempest-ProjectReaderTests-711911046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67e5d2f4-827f-4f27-b099-5f48c1ab6c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:01:07 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-dd09decf-e32b-4b30-aa0c-37119ccf2ae8 tempest-ProjectReaderTests-711911046 None] Volume f57c7f1a-a456-41de-91a9-dbd61409832a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f57c7f1a-a456-41de-91a9-dbd61409832a', 'volume_size': 1} Jul 08 02:01:07 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-dd09decf-e32b-4b30-aa0c-37119ccf2ae8 tempest-ProjectReaderTests-711911046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:01:07 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-dd09decf-e32b-4b30-aa0c-37119ccf2ae8 tempest-ProjectReaderTests-711911046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:01:07 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-dd09decf-e32b-4b30-aa0c-37119ccf2ae8 tempest-ProjectReaderTests-711911046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:01:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1329725492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f57c7f1a-a456-41de-91a9-dbd61409832a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a48ca13c5744b789d52c0b4964d2647',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:01:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:01:07Z,use_quota=True,user_id='d627f0164ad347c09518ddf4e1940db9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:01:07 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-dd09decf-e32b-4b30-aa0c-37119ccf2ae8 tempest-ProjectReaderTests-711911046 None] Creating volume f57c7f1a-a456-41de-91a9-dbd61409832a {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:01:07 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-dd09decf-e32b-4b30-aa0c-37119ccf2ae8 tempest-ProjectReaderTests-711911046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:01:07 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-dd09decf-e32b-4b30-aa0c-37119ccf2ae8 tempest-ProjectReaderTests-711911046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:01:07 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-dd09decf-e32b-4b30-aa0c-37119ccf2ae8 tempest-ProjectReaderTests-711911046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:01:07 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-dd09decf-e32b-4b30-aa0c-37119ccf2ae8 tempest-ProjectReaderTests-711911046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:01:07 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-dd09decf-e32b-4b30-aa0c-37119ccf2ae8 tempest-ProjectReaderTests-711911046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:01:07 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-dd09decf-e32b-4b30-aa0c-37119ccf2ae8 tempest-ProjectReaderTests-711911046 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:01:07 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-dd09decf-e32b-4b30-aa0c-37119ccf2ae8 tempest-ProjectReaderTests-711911046 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 02:01:07 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-dd09decf-e32b-4b30-aa0c-37119ccf2ae8 tempest-ProjectReaderTests-711911046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f57c7f1a-a456-41de-91a9-dbd61409832a 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:01:07 devstack sudo[104691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f57c7f1a-a456-41de-91a9-dbd61409832a 1073741824 Jul 08 02:01:07 devstack sudo[104691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:01:08 devstack sudo[104691]: pam_unix(sudo:session): session closed for user root Jul 08 02:01:08 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-dd09decf-e32b-4b30-aa0c-37119ccf2ae8 tempest-ProjectReaderTests-711911046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f57c7f1a-a456-41de-91a9-dbd61409832a 1073741824" returned: 0 in 0.953s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:01:08 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-dd09decf-e32b-4b30-aa0c-37119ccf2ae8 tempest-ProjectReaderTests-711911046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f57c7f1a-a456-41de-91a9-dbd61409832a {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:01:08 devstack sudo[104699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f57c7f1a-a456-41de-91a9-dbd61409832a Jul 08 02:01:08 devstack sudo[104699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:01:09 devstack sudo[104699]: pam_unix(sudo:session): session closed for user root Jul 08 02:01:09 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-dd09decf-e32b-4b30-aa0c-37119ccf2ae8 tempest-ProjectReaderTests-711911046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f57c7f1a-a456-41de-91a9-dbd61409832a" returned: 0 in 0.672s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:01:09 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-dd09decf-e32b-4b30-aa0c-37119ccf2ae8 tempest-ProjectReaderTests-711911046 None] <== create_volume: return (1681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:01:09 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-dd09decf-e32b-4b30-aa0c-37119ccf2ae8 tempest-ProjectReaderTests-711911046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.683s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:01:09 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-dd09decf-e32b-4b30-aa0c-37119ccf2ae8 tempest-ProjectReaderTests-711911046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67e5d2f4-827f-4f27-b099-5f48c1ab6c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f57c7f1a-a456-41de-91a9-dbd61409832a', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:01:09 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-dd09decf-e32b-4b30-aa0c-37119ccf2ae8 tempest-ProjectReaderTests-711911046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df627d55-945b-47f3-ba95-d3ad234d1c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:01:09 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-dd09decf-e32b-4b30-aa0c-37119ccf2ae8 tempest-ProjectReaderTests-711911046 None] Volume volume-f57c7f1a-a456-41de-91a9-dbd61409832a (f57c7f1a-a456-41de-91a9-dbd61409832a): created successfully Jul 08 02:01:09 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-dd09decf-e32b-4b30-aa0c-37119ccf2ae8 tempest-ProjectReaderTests-711911046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df627d55-945b-47f3-ba95-d3ad234d1c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:01:09 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-dd09decf-e32b-4b30-aa0c-37119ccf2ae8 tempest-ProjectReaderTests-711911046 None] Flow 'volume_create_manager' (5d6cee46-caec-4d8f-93ed-da43b111ea86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:01:09 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-dd09decf-e32b-4b30-aa0c-37119ccf2ae8 tempest-ProjectReaderTests-711911046 None] Created volume successfully. Jul 08 02:01:09 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-f018f722-6761-44da-a78d-69be3d0314b5 tempest-ProjectReaderTests-711911046 None] Acquiring lock "cinder-f57c7f1a-a456-41de-91a9-dbd61409832a-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:01:09 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-f018f722-6761-44da-a78d-69be3d0314b5 tempest-ProjectReaderTests-711911046 None] Lock "cinder-f57c7f1a-a456-41de-91a9-dbd61409832a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:01:09 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-f018f722-6761-44da-a78d-69be3d0314b5 tempest-ProjectReaderTests-711911046 None] Acquiring lock "cinder-quobyte-f57c7f1a-a456-41de-91a9-dbd61409832a" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:01:09 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-f018f722-6761-44da-a78d-69be3d0314b5 tempest-ProjectReaderTests-711911046 None] Lock "cinder-quobyte-f57c7f1a-a456-41de-91a9-dbd61409832a" acquired by "delete_volume" :: waited 0.017s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:01:09 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37b8cc3-c877-41a4-a48b-a35df4d1f2e7]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:01:09 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f018f722-6761-44da-a78d-69be3d0314b5 tempest-ProjectReaderTests-711911046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f57c7f1a-a456-41de-91a9-dbd61409832a {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:01:09 devstack sudo[104702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f57c7f1a-a456-41de-91a9-dbd61409832a Jul 08 02:01:09 devstack sudo[104702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:01:10 devstack sudo[104702]: pam_unix(sudo:session): session closed for user root Jul 08 02:01:10 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f018f722-6761-44da-a78d-69be3d0314b5 tempest-ProjectReaderTests-711911046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f57c7f1a-a456-41de-91a9-dbd61409832a" returned: 0 in 0.822s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:01:10 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f018f722-6761-44da-a78d-69be3d0314b5 tempest-ProjectReaderTests-711911046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f57c7f1a-a456-41de-91a9-dbd61409832a {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:01:10 devstack sudo[104708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f57c7f1a-a456-41de-91a9-dbd61409832a Jul 08 02:01:10 devstack sudo[104708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:01:11 devstack sudo[104708]: pam_unix(sudo:session): session closed for user root Jul 08 02:01:11 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f018f722-6761-44da-a78d-69be3d0314b5 tempest-ProjectReaderTests-711911046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f57c7f1a-a456-41de-91a9-dbd61409832a" returned: 0 in 0.777s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:01:11 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-f018f722-6761-44da-a78d-69be3d0314b5 tempest-ProjectReaderTests-711911046 None] Lock "cinder-quobyte-f57c7f1a-a456-41de-91a9-dbd61409832a" released by "delete_volume" :: held 1.641s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:01:11 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-f018f722-6761-44da-a78d-69be3d0314b5 tempest-ProjectReaderTests-711911046 None] Created reservations ['6b86f63d-e1e1-4e23-87d2-c22746cf9eb3', '23cb011e-3e99-4311-9df1-1c3fa55d077a', '7f6b84be-fa75-4109-85cb-27aa33c90f69', 'e96a32ff-9e1d-4dc7-9a45-81695a7eabb3'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:01:11 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-f018f722-6761-44da-a78d-69be3d0314b5 tempest-ProjectReaderTests-711911046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:01:11 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-f018f722-6761-44da-a78d-69be3d0314b5 tempest-ProjectReaderTests-711911046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:01:11 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-f018f722-6761-44da-a78d-69be3d0314b5 tempest-ProjectReaderTests-711911046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:01:11 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-f018f722-6761-44da-a78d-69be3d0314b5 tempest-ProjectReaderTests-711911046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:01:11 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-f018f722-6761-44da-a78d-69be3d0314b5 tempest-ProjectReaderTests-711911046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:01:11 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f018f722-6761-44da-a78d-69be3d0314b5 tempest-ProjectReaderTests-711911046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:01:11 devstack sudo[104716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 02:01:11 devstack sudo[104716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:01:12 devstack sudo[104716]: pam_unix(sudo:session): session closed for user root Jul 08 02:01:12 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f018f722-6761-44da-a78d-69be3d0314b5 tempest-ProjectReaderTests-711911046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.787s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:01:12 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-f018f722-6761-44da-a78d-69be3d0314b5 tempest-ProjectReaderTests-711911046 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:01:12 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-f018f722-6761-44da-a78d-69be3d0314b5 tempest-ProjectReaderTests-711911046 None] Deleted volume successfully. Jul 08 02:01:12 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-f018f722-6761-44da-a78d-69be3d0314b5 tempest-ProjectReaderTests-711911046 None] Lock "cinder-f57c7f1a-a456-41de-91a9-dbd61409832a-delete_volume" released by "delete_volume" :: held 2.679s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:01:12 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a1c3c5b-3442-4cd2-b0d0-faca0f958af9 tempest-ProjectReaderTests-711911046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:01:12 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6a1c3c5b-3442-4cd2-b0d0-faca0f958af9 tempest-ProjectReaderTests-711911046 None] Flow 'volume_create_manager' (86594a83-7bbd-4f39-b8e1-595d18c78b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:01:12 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6a1c3c5b-3442-4cd2-b0d0-faca0f958af9 tempest-ProjectReaderTests-711911046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63189c0c-f52a-414d-a9a5-9c01b304de19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:01:12 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6a1c3c5b-3442-4cd2-b0d0-faca0f958af9 tempest-ProjectReaderTests-711911046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63189c0c-f52a-414d-a9a5-9c01b304de19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:01:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2082202283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f220154-0530-4e9a-a6ec-62fa79877dfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a48ca13c5744b789d52c0b4964d2647',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:01:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:01:12Z,use_quota=True,user_id='d627f0164ad347c09518ddf4e1940db9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:01:12 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6a1c3c5b-3442-4cd2-b0d0-faca0f958af9 tempest-ProjectReaderTests-711911046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84e18c62-8fe4-4ca4-96a2-fc51db17887b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:01:12 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6a1c3c5b-3442-4cd2-b0d0-faca0f958af9 tempest-ProjectReaderTests-711911046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84e18c62-8fe4-4ca4-96a2-fc51db17887b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:01:12 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6a1c3c5b-3442-4cd2-b0d0-faca0f958af9 tempest-ProjectReaderTests-711911046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2548a1d6-be58-4dd5-9398-385acd2b3ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:01:12 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6a1c3c5b-3442-4cd2-b0d0-faca0f958af9 tempest-ProjectReaderTests-711911046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2548a1d6-be58-4dd5-9398-385acd2b3ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f220154-0530-4e9a-a6ec-62fa79877dfb', 'volume_name': 'volume-2f220154-0530-4e9a-a6ec-62fa79877dfb', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:01:12 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6a1c3c5b-3442-4cd2-b0d0-faca0f958af9 tempest-ProjectReaderTests-711911046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1955a09c-e55a-4848-a07d-52eb724225ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:01:12 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6a1c3c5b-3442-4cd2-b0d0-faca0f958af9 tempest-ProjectReaderTests-711911046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1955a09c-e55a-4848-a07d-52eb724225ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:01:12 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6a1c3c5b-3442-4cd2-b0d0-faca0f958af9 tempest-ProjectReaderTests-711911046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42649d69-8b4c-4083-afec-7981b056bc70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:01:12 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-6a1c3c5b-3442-4cd2-b0d0-faca0f958af9 tempest-ProjectReaderTests-711911046 None] Volume 2f220154-0530-4e9a-a6ec-62fa79877dfb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f220154-0530-4e9a-a6ec-62fa79877dfb', 'volume_size': 1} Jul 08 02:01:12 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6a1c3c5b-3442-4cd2-b0d0-faca0f958af9 tempest-ProjectReaderTests-711911046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:01:12 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6a1c3c5b-3442-4cd2-b0d0-faca0f958af9 tempest-ProjectReaderTests-711911046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:01:12 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-6a1c3c5b-3442-4cd2-b0d0-faca0f958af9 tempest-ProjectReaderTests-711911046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:01:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2082202283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f220154-0530-4e9a-a6ec-62fa79877dfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a48ca13c5744b789d52c0b4964d2647',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:01:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:01:12Z,use_quota=True,user_id='d627f0164ad347c09518ddf4e1940db9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:01:12 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-6a1c3c5b-3442-4cd2-b0d0-faca0f958af9 tempest-ProjectReaderTests-711911046 None] Creating volume 2f220154-0530-4e9a-a6ec-62fa79877dfb {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:01:12 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6a1c3c5b-3442-4cd2-b0d0-faca0f958af9 tempest-ProjectReaderTests-711911046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:01:12 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6a1c3c5b-3442-4cd2-b0d0-faca0f958af9 tempest-ProjectReaderTests-711911046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:01:12 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-6a1c3c5b-3442-4cd2-b0d0-faca0f958af9 tempest-ProjectReaderTests-711911046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:01:12 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-6a1c3c5b-3442-4cd2-b0d0-faca0f958af9 tempest-ProjectReaderTests-711911046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:01:12 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6a1c3c5b-3442-4cd2-b0d0-faca0f958af9 tempest-ProjectReaderTests-711911046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:01:12 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-6a1c3c5b-3442-4cd2-b0d0-faca0f958af9 tempest-ProjectReaderTests-711911046 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:01:12 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-6a1c3c5b-3442-4cd2-b0d0-faca0f958af9 tempest-ProjectReaderTests-711911046 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 02:01:12 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6a1c3c5b-3442-4cd2-b0d0-faca0f958af9 tempest-ProjectReaderTests-711911046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-2f220154-0530-4e9a-a6ec-62fa79877dfb 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:01:12 devstack sudo[104726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-2f220154-0530-4e9a-a6ec-62fa79877dfb 1073741824 Jul 08 02:01:12 devstack sudo[104726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:01:13 devstack sudo[104726]: pam_unix(sudo:session): session closed for user root Jul 08 02:01:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6a1c3c5b-3442-4cd2-b0d0-faca0f958af9 tempest-ProjectReaderTests-711911046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-2f220154-0530-4e9a-a6ec-62fa79877dfb 1073741824" returned: 0 in 0.879s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:01:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6a1c3c5b-3442-4cd2-b0d0-faca0f958af9 tempest-ProjectReaderTests-711911046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-2f220154-0530-4e9a-a6ec-62fa79877dfb {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:01:13 devstack sudo[104733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-2f220154-0530-4e9a-a6ec-62fa79877dfb Jul 08 02:01:13 devstack sudo[104733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:01:14 devstack sudo[104733]: pam_unix(sudo:session): session closed for user root Jul 08 02:01:14 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6a1c3c5b-3442-4cd2-b0d0-faca0f958af9 tempest-ProjectReaderTests-711911046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-2f220154-0530-4e9a-a6ec-62fa79877dfb" returned: 0 in 0.673s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:01:14 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-6a1c3c5b-3442-4cd2-b0d0-faca0f958af9 tempest-ProjectReaderTests-711911046 None] <== create_volume: return (1592ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:01:14 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6a1c3c5b-3442-4cd2-b0d0-faca0f958af9 tempest-ProjectReaderTests-711911046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.595s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:01:14 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6a1c3c5b-3442-4cd2-b0d0-faca0f958af9 tempest-ProjectReaderTests-711911046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42649d69-8b4c-4083-afec-7981b056bc70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f220154-0530-4e9a-a6ec-62fa79877dfb', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:01:14 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6a1c3c5b-3442-4cd2-b0d0-faca0f958af9 tempest-ProjectReaderTests-711911046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c043d1bb-904b-45cf-8393-1130a46327e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:01:14 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-6a1c3c5b-3442-4cd2-b0d0-faca0f958af9 tempest-ProjectReaderTests-711911046 None] Volume volume-2f220154-0530-4e9a-a6ec-62fa79877dfb (2f220154-0530-4e9a-a6ec-62fa79877dfb): created successfully Jul 08 02:01:14 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6a1c3c5b-3442-4cd2-b0d0-faca0f958af9 tempest-ProjectReaderTests-711911046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c043d1bb-904b-45cf-8393-1130a46327e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:01:14 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6a1c3c5b-3442-4cd2-b0d0-faca0f958af9 tempest-ProjectReaderTests-711911046 None] Flow 'volume_create_manager' (86594a83-7bbd-4f39-b8e1-595d18c78b9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:01:14 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-6a1c3c5b-3442-4cd2-b0d0-faca0f958af9 tempest-ProjectReaderTests-711911046 None] Created volume successfully. Jul 08 02:01:14 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7685337d-7dfa-4e70-856e-371ffc6934a3 tempest-ProjectReaderTests-711911046 None] Acquiring lock "cinder-2f220154-0530-4e9a-a6ec-62fa79877dfb-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:01:14 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7685337d-7dfa-4e70-856e-371ffc6934a3 tempest-ProjectReaderTests-711911046 None] Lock "cinder-2f220154-0530-4e9a-a6ec-62fa79877dfb-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:01:14 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7685337d-7dfa-4e70-856e-371ffc6934a3 tempest-ProjectReaderTests-711911046 None] Acquiring lock "cinder-quobyte-2f220154-0530-4e9a-a6ec-62fa79877dfb" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:01:14 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7685337d-7dfa-4e70-856e-371ffc6934a3 tempest-ProjectReaderTests-711911046 None] Lock "cinder-quobyte-2f220154-0530-4e9a-a6ec-62fa79877dfb" acquired by "delete_volume" :: waited 0.013s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:01:14 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d130a50-79e1-4113-9548-607ad64486cc]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:01:14 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7685337d-7dfa-4e70-856e-371ffc6934a3 tempest-ProjectReaderTests-711911046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-2f220154-0530-4e9a-a6ec-62fa79877dfb {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:01:14 devstack sudo[104736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-2f220154-0530-4e9a-a6ec-62fa79877dfb Jul 08 02:01:14 devstack sudo[104736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:01:15 devstack sudo[104736]: pam_unix(sudo:session): session closed for user root Jul 08 02:01:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7685337d-7dfa-4e70-856e-371ffc6934a3 tempest-ProjectReaderTests-711911046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-2f220154-0530-4e9a-a6ec-62fa79877dfb" returned: 0 in 0.810s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:01:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7685337d-7dfa-4e70-856e-371ffc6934a3 tempest-ProjectReaderTests-711911046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-2f220154-0530-4e9a-a6ec-62fa79877dfb {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:01:15 devstack sudo[104741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-2f220154-0530-4e9a-a6ec-62fa79877dfb Jul 08 02:01:15 devstack sudo[104741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:01:16 devstack sudo[104741]: pam_unix(sudo:session): session closed for user root Jul 08 02:01:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7685337d-7dfa-4e70-856e-371ffc6934a3 tempest-ProjectReaderTests-711911046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-2f220154-0530-4e9a-a6ec-62fa79877dfb" returned: 0 in 0.646s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:01:16 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7685337d-7dfa-4e70-856e-371ffc6934a3 tempest-ProjectReaderTests-711911046 None] Lock "cinder-quobyte-2f220154-0530-4e9a-a6ec-62fa79877dfb" released by "delete_volume" :: held 1.495s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:01:16 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-7685337d-7dfa-4e70-856e-371ffc6934a3 tempest-ProjectReaderTests-711911046 None] Created reservations ['bec507a9-16a2-4433-887c-2ff96491bb70', 'd43f6b0b-bcc6-4cd6-9e20-c928f9800f5b', '230ef00c-34fc-4874-a06e-e994f1d32028', '0bddcf85-bdce-43a2-8f4f-185d934a6298'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:01:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7685337d-7dfa-4e70-856e-371ffc6934a3 tempest-ProjectReaderTests-711911046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:01:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7685337d-7dfa-4e70-856e-371ffc6934a3 tempest-ProjectReaderTests-711911046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:01:16 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-7685337d-7dfa-4e70-856e-371ffc6934a3 tempest-ProjectReaderTests-711911046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:01:16 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-7685337d-7dfa-4e70-856e-371ffc6934a3 tempest-ProjectReaderTests-711911046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:01:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7685337d-7dfa-4e70-856e-371ffc6934a3 tempest-ProjectReaderTests-711911046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:01:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7685337d-7dfa-4e70-856e-371ffc6934a3 tempest-ProjectReaderTests-711911046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:01:16 devstack sudo[104744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 02:01:16 devstack sudo[104744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:01:16 devstack sudo[104744]: pam_unix(sudo:session): session closed for user root Jul 08 02:01:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7685337d-7dfa-4e70-856e-371ffc6934a3 tempest-ProjectReaderTests-711911046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.673s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:01:16 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-7685337d-7dfa-4e70-856e-371ffc6934a3 tempest-ProjectReaderTests-711911046 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:01:16 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-7685337d-7dfa-4e70-856e-371ffc6934a3 tempest-ProjectReaderTests-711911046 None] Deleted volume successfully. Jul 08 02:01:17 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7685337d-7dfa-4e70-856e-371ffc6934a3 tempest-ProjectReaderTests-711911046 None] Lock "cinder-2f220154-0530-4e9a-a6ec-62fa79877dfb-delete_volume" released by "delete_volume" :: held 2.475s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:01:20 devstack cinder-volume[87134]: DEBUG oslo_service.periodic_task [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87134) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 02:01:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:01:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:01:20 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:01:20 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:01:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:01:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:01:20 devstack sudo[104771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 02:01:20 devstack sudo[104771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:01:21 devstack sudo[104771]: pam_unix(sudo:session): session closed for user root Jul 08 02:01:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.714s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:01:21 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:01:21 devstack cinder-volume[87134]: DEBUG oslo_service.periodic_task [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running periodic task VolumeManager._thread_info {{(pid=87134) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 02:01:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] thread count: 28 {{(pid=87134) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 02:01:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] thread info: [<_MainThread(MainThread, started 129378964615296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87134) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 02:01:26 devstack cinder-volume[87134]: DEBUG dbcounter [-] [87134] Writing DB stats cinder:SELECT=37,cinder:UPDATE=48,cinder:INSERT=11,cinder:DELETE=3 {{(pid=87134) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:01:26 devstack cinder-volume[87134]: DEBUG dbcounter [-] [87134] Writing DB stats cinder:UPDATE=49,cinder:DELETE=5,cinder:INSERT=12,cinder:SELECT=35 {{(pid=87134) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:01:29 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-0696188d-5768-4f3c-b28c-d0506375349c tempest-ProjectReaderTests-1722681123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:01:29 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-0696188d-5768-4f3c-b28c-d0506375349c tempest-ProjectReaderTests-1722681123 None] Flow 'volume_create_manager' (c8d4d0c2-979e-441f-a45d-505afb48d5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:01:29 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-0696188d-5768-4f3c-b28c-d0506375349c tempest-ProjectReaderTests-1722681123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49bccc6c-cf18-4b4f-85d8-f5e97817481f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:01:29 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-0696188d-5768-4f3c-b28c-d0506375349c tempest-ProjectReaderTests-1722681123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49bccc6c-cf18-4b4f-85d8-f5e97817481f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:01:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1093424809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19b69c46-284f-4f8e-8162-028090898fe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9166d541f9a941e9aa4a3173ff87b9cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:01:29Z,use_quota=True,user_id='053e9df9b7514b0ba7fa68bc23b8e420',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:01:29 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-0696188d-5768-4f3c-b28c-d0506375349c tempest-ProjectReaderTests-1722681123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (478ea051-1a57-438c-88ec-30eeadf913cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:01:29 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-0696188d-5768-4f3c-b28c-d0506375349c tempest-ProjectReaderTests-1722681123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (478ea051-1a57-438c-88ec-30eeadf913cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:01:29 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-0696188d-5768-4f3c-b28c-d0506375349c tempest-ProjectReaderTests-1722681123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a81c974d-b4d9-47bc-9a57-ca490b0ce275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:01:29 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-0696188d-5768-4f3c-b28c-d0506375349c tempest-ProjectReaderTests-1722681123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a81c974d-b4d9-47bc-9a57-ca490b0ce275) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19b69c46-284f-4f8e-8162-028090898fe8', 'volume_name': 'volume-19b69c46-284f-4f8e-8162-028090898fe8', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:01:29 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-0696188d-5768-4f3c-b28c-d0506375349c tempest-ProjectReaderTests-1722681123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f360cd5-0a0e-41c2-8488-4e144b19607a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:01:29 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-0696188d-5768-4f3c-b28c-d0506375349c tempest-ProjectReaderTests-1722681123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f360cd5-0a0e-41c2-8488-4e144b19607a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:01:29 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-0696188d-5768-4f3c-b28c-d0506375349c tempest-ProjectReaderTests-1722681123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a74271d0-6471-4f50-925f-bd7fc6293cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:01:29 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-0696188d-5768-4f3c-b28c-d0506375349c tempest-ProjectReaderTests-1722681123 None] Volume 19b69c46-284f-4f8e-8162-028090898fe8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19b69c46-284f-4f8e-8162-028090898fe8', 'volume_size': 1} Jul 08 02:01:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-0696188d-5768-4f3c-b28c-d0506375349c tempest-ProjectReaderTests-1722681123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:01:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-0696188d-5768-4f3c-b28c-d0506375349c tempest-ProjectReaderTests-1722681123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:01:29 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-0696188d-5768-4f3c-b28c-d0506375349c tempest-ProjectReaderTests-1722681123 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:01:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1093424809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19b69c46-284f-4f8e-8162-028090898fe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9166d541f9a941e9aa4a3173ff87b9cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:01:29Z,use_quota=True,user_id='053e9df9b7514b0ba7fa68bc23b8e420',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:01:29 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-0696188d-5768-4f3c-b28c-d0506375349c tempest-ProjectReaderTests-1722681123 None] Creating volume 19b69c46-284f-4f8e-8162-028090898fe8 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:01:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-0696188d-5768-4f3c-b28c-d0506375349c tempest-ProjectReaderTests-1722681123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:01:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-0696188d-5768-4f3c-b28c-d0506375349c tempest-ProjectReaderTests-1722681123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:01:29 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-0696188d-5768-4f3c-b28c-d0506375349c tempest-ProjectReaderTests-1722681123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:01:29 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-0696188d-5768-4f3c-b28c-d0506375349c tempest-ProjectReaderTests-1722681123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:01:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-0696188d-5768-4f3c-b28c-d0506375349c tempest-ProjectReaderTests-1722681123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:01:29 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-0696188d-5768-4f3c-b28c-d0506375349c tempest-ProjectReaderTests-1722681123 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:01:29 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-0696188d-5768-4f3c-b28c-d0506375349c tempest-ProjectReaderTests-1722681123 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 02:01:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-0696188d-5768-4f3c-b28c-d0506375349c tempest-ProjectReaderTests-1722681123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-19b69c46-284f-4f8e-8162-028090898fe8 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:01:29 devstack sudo[104804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-19b69c46-284f-4f8e-8162-028090898fe8 1073741824 Jul 08 02:01:29 devstack sudo[104804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:01:30 devstack sudo[104804]: pam_unix(sudo:session): session closed for user root Jul 08 02:01:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-0696188d-5768-4f3c-b28c-d0506375349c tempest-ProjectReaderTests-1722681123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-19b69c46-284f-4f8e-8162-028090898fe8 1073741824" returned: 0 in 0.998s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:01:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-0696188d-5768-4f3c-b28c-d0506375349c tempest-ProjectReaderTests-1722681123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-19b69c46-284f-4f8e-8162-028090898fe8 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:01:30 devstack sudo[104812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-19b69c46-284f-4f8e-8162-028090898fe8 Jul 08 02:01:30 devstack sudo[104812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:01:31 devstack sudo[104812]: pam_unix(sudo:session): session closed for user root Jul 08 02:01:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-0696188d-5768-4f3c-b28c-d0506375349c tempest-ProjectReaderTests-1722681123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-19b69c46-284f-4f8e-8162-028090898fe8" returned: 0 in 0.666s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:01:31 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-0696188d-5768-4f3c-b28c-d0506375349c tempest-ProjectReaderTests-1722681123 None] <== create_volume: return (1708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:01:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-0696188d-5768-4f3c-b28c-d0506375349c tempest-ProjectReaderTests-1722681123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.711s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:01:31 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-0696188d-5768-4f3c-b28c-d0506375349c tempest-ProjectReaderTests-1722681123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a74271d0-6471-4f50-925f-bd7fc6293cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19b69c46-284f-4f8e-8162-028090898fe8', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:01:31 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-0696188d-5768-4f3c-b28c-d0506375349c tempest-ProjectReaderTests-1722681123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ab56ddb-4319-4730-8d23-a1d8cbafd9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:01:31 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-0696188d-5768-4f3c-b28c-d0506375349c tempest-ProjectReaderTests-1722681123 None] Volume volume-19b69c46-284f-4f8e-8162-028090898fe8 (19b69c46-284f-4f8e-8162-028090898fe8): created successfully Jul 08 02:01:31 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-0696188d-5768-4f3c-b28c-d0506375349c tempest-ProjectReaderTests-1722681123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ab56ddb-4319-4730-8d23-a1d8cbafd9c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:01:31 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-0696188d-5768-4f3c-b28c-d0506375349c tempest-ProjectReaderTests-1722681123 None] Flow 'volume_create_manager' (c8d4d0c2-979e-441f-a45d-505afb48d5fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:01:31 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-0696188d-5768-4f3c-b28c-d0506375349c tempest-ProjectReaderTests-1722681123 None] Created volume successfully. Jul 08 02:01:31 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-4da500df-2113-44a3-a968-64d20f142471 tempest-ProjectReaderTests-1722681123 None] Acquiring lock "cinder-19b69c46-284f-4f8e-8162-028090898fe8-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:01:31 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-4da500df-2113-44a3-a968-64d20f142471 tempest-ProjectReaderTests-1722681123 None] Lock "cinder-19b69c46-284f-4f8e-8162-028090898fe8-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:01:31 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-4da500df-2113-44a3-a968-64d20f142471 tempest-ProjectReaderTests-1722681123 None] Acquiring lock "cinder-quobyte-19b69c46-284f-4f8e-8162-028090898fe8" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:01:31 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-4da500df-2113-44a3-a968-64d20f142471 tempest-ProjectReaderTests-1722681123 None] Lock "cinder-quobyte-19b69c46-284f-4f8e-8162-028090898fe8" acquired by "delete_volume" :: waited 0.016s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:01:31 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b7df5e-b09c-45e9-a4b5-c0028358fd55]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:01:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4da500df-2113-44a3-a968-64d20f142471 tempest-ProjectReaderTests-1722681123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-19b69c46-284f-4f8e-8162-028090898fe8 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:01:31 devstack sudo[104821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-19b69c46-284f-4f8e-8162-028090898fe8 Jul 08 02:01:31 devstack sudo[104821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:01:32 devstack sudo[104821]: pam_unix(sudo:session): session closed for user root Jul 08 02:01:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4da500df-2113-44a3-a968-64d20f142471 tempest-ProjectReaderTests-1722681123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-19b69c46-284f-4f8e-8162-028090898fe8" returned: 0 in 0.869s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:01:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4da500df-2113-44a3-a968-64d20f142471 tempest-ProjectReaderTests-1722681123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-19b69c46-284f-4f8e-8162-028090898fe8 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:01:32 devstack sudo[104862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-19b69c46-284f-4f8e-8162-028090898fe8 Jul 08 02:01:32 devstack sudo[104862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:01:33 devstack sudo[104862]: pam_unix(sudo:session): session closed for user root Jul 08 02:01:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4da500df-2113-44a3-a968-64d20f142471 tempest-ProjectReaderTests-1722681123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-19b69c46-284f-4f8e-8162-028090898fe8" returned: 0 in 0.650s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:01:33 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-4da500df-2113-44a3-a968-64d20f142471 tempest-ProjectReaderTests-1722681123 None] Lock "cinder-quobyte-19b69c46-284f-4f8e-8162-028090898fe8" released by "delete_volume" :: held 1.561s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:01:33 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-4da500df-2113-44a3-a968-64d20f142471 tempest-ProjectReaderTests-1722681123 None] Created reservations ['521de0c9-e387-4385-84b8-c119efa8cd41', 'a2e975d0-fa4b-4a6c-a6ca-cc5d5c203a49', '7e8795a6-2528-4a98-b729-7cd49decb64d', 'dbd36d7b-6acd-4c57-a2a6-3501b53e07b7'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:01:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-4da500df-2113-44a3-a968-64d20f142471 tempest-ProjectReaderTests-1722681123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:01:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-4da500df-2113-44a3-a968-64d20f142471 tempest-ProjectReaderTests-1722681123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:01:33 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-4da500df-2113-44a3-a968-64d20f142471 tempest-ProjectReaderTests-1722681123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:01:33 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-4da500df-2113-44a3-a968-64d20f142471 tempest-ProjectReaderTests-1722681123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:01:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-4da500df-2113-44a3-a968-64d20f142471 tempest-ProjectReaderTests-1722681123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:01:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4da500df-2113-44a3-a968-64d20f142471 tempest-ProjectReaderTests-1722681123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:01:33 devstack sudo[104866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 02:01:33 devstack sudo[104866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:01:34 devstack sudo[104866]: pam_unix(sudo:session): session closed for user root Jul 08 02:01:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4da500df-2113-44a3-a968-64d20f142471 tempest-ProjectReaderTests-1722681123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.700s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:01:34 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-4da500df-2113-44a3-a968-64d20f142471 tempest-ProjectReaderTests-1722681123 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:01:34 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-4da500df-2113-44a3-a968-64d20f142471 tempest-ProjectReaderTests-1722681123 None] Deleted volume successfully. Jul 08 02:01:34 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-4da500df-2113-44a3-a968-64d20f142471 tempest-ProjectReaderTests-1722681123 None] Lock "cinder-19b69c46-284f-4f8e-8162-028090898fe8-delete_volume" released by "delete_volume" :: held 2.571s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:01:34 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-f100af0e-2e2e-4470-879c-2349cae80f05 tempest-ProjectReaderTests-1722681123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:01:34 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f100af0e-2e2e-4470-879c-2349cae80f05 tempest-ProjectReaderTests-1722681123 None] Flow 'volume_create_manager' (444dde85-2c47-4864-b862-20d64539a311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:01:34 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f100af0e-2e2e-4470-879c-2349cae80f05 tempest-ProjectReaderTests-1722681123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27a07254-6b39-4488-9aae-73f90a120b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:01:34 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f100af0e-2e2e-4470-879c-2349cae80f05 tempest-ProjectReaderTests-1722681123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27a07254-6b39-4488-9aae-73f90a120b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:01:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1632551236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea6a5ee0-37db-46b4-bb8a-7fb0ac1289a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9166d541f9a941e9aa4a3173ff87b9cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:01:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:01:34Z,use_quota=True,user_id='053e9df9b7514b0ba7fa68bc23b8e420',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:01:34 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f100af0e-2e2e-4470-879c-2349cae80f05 tempest-ProjectReaderTests-1722681123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5f1e504-c5e9-48ff-b40e-fed4f03859ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:01:34 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f100af0e-2e2e-4470-879c-2349cae80f05 tempest-ProjectReaderTests-1722681123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5f1e504-c5e9-48ff-b40e-fed4f03859ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:01:34 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f100af0e-2e2e-4470-879c-2349cae80f05 tempest-ProjectReaderTests-1722681123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28a17eb6-2b4b-4e52-9507-7c471b862224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:01:34 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f100af0e-2e2e-4470-879c-2349cae80f05 tempest-ProjectReaderTests-1722681123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28a17eb6-2b4b-4e52-9507-7c471b862224) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea6a5ee0-37db-46b4-bb8a-7fb0ac1289a7', 'volume_name': 'volume-ea6a5ee0-37db-46b4-bb8a-7fb0ac1289a7', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:01:34 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f100af0e-2e2e-4470-879c-2349cae80f05 tempest-ProjectReaderTests-1722681123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (149fd506-3149-41b7-a33b-f4e35c30104a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:01:34 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f100af0e-2e2e-4470-879c-2349cae80f05 tempest-ProjectReaderTests-1722681123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (149fd506-3149-41b7-a33b-f4e35c30104a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:01:34 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f100af0e-2e2e-4470-879c-2349cae80f05 tempest-ProjectReaderTests-1722681123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61c16912-78d8-467a-a695-49d65bb36263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:01:34 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-f100af0e-2e2e-4470-879c-2349cae80f05 tempest-ProjectReaderTests-1722681123 None] Volume ea6a5ee0-37db-46b4-bb8a-7fb0ac1289a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea6a5ee0-37db-46b4-bb8a-7fb0ac1289a7', 'volume_size': 1} Jul 08 02:01:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-f100af0e-2e2e-4470-879c-2349cae80f05 tempest-ProjectReaderTests-1722681123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:01:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-f100af0e-2e2e-4470-879c-2349cae80f05 tempest-ProjectReaderTests-1722681123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:01:34 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-f100af0e-2e2e-4470-879c-2349cae80f05 tempest-ProjectReaderTests-1722681123 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:01:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1632551236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea6a5ee0-37db-46b4-bb8a-7fb0ac1289a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9166d541f9a941e9aa4a3173ff87b9cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:01:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:01:34Z,use_quota=True,user_id='053e9df9b7514b0ba7fa68bc23b8e420',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:01:34 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-f100af0e-2e2e-4470-879c-2349cae80f05 tempest-ProjectReaderTests-1722681123 None] Creating volume ea6a5ee0-37db-46b4-bb8a-7fb0ac1289a7 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:01:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-f100af0e-2e2e-4470-879c-2349cae80f05 tempest-ProjectReaderTests-1722681123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:01:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-f100af0e-2e2e-4470-879c-2349cae80f05 tempest-ProjectReaderTests-1722681123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:01:34 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-f100af0e-2e2e-4470-879c-2349cae80f05 tempest-ProjectReaderTests-1722681123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:01:34 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-f100af0e-2e2e-4470-879c-2349cae80f05 tempest-ProjectReaderTests-1722681123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:01:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-f100af0e-2e2e-4470-879c-2349cae80f05 tempest-ProjectReaderTests-1722681123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:01:34 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-f100af0e-2e2e-4470-879c-2349cae80f05 tempest-ProjectReaderTests-1722681123 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:01:34 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-f100af0e-2e2e-4470-879c-2349cae80f05 tempest-ProjectReaderTests-1722681123 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 02:01:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f100af0e-2e2e-4470-879c-2349cae80f05 tempest-ProjectReaderTests-1722681123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ea6a5ee0-37db-46b4-bb8a-7fb0ac1289a7 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:01:34 devstack sudo[104870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ea6a5ee0-37db-46b4-bb8a-7fb0ac1289a7 1073741824 Jul 08 02:01:34 devstack sudo[104870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:01:35 devstack sudo[104870]: pam_unix(sudo:session): session closed for user root Jul 08 02:01:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f100af0e-2e2e-4470-879c-2349cae80f05 tempest-ProjectReaderTests-1722681123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ea6a5ee0-37db-46b4-bb8a-7fb0ac1289a7 1073741824" returned: 0 in 0.879s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:01:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f100af0e-2e2e-4470-879c-2349cae80f05 tempest-ProjectReaderTests-1722681123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ea6a5ee0-37db-46b4-bb8a-7fb0ac1289a7 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:01:35 devstack sudo[104876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ea6a5ee0-37db-46b4-bb8a-7fb0ac1289a7 Jul 08 02:01:35 devstack sudo[104876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:01:36 devstack sudo[104876]: pam_unix(sudo:session): session closed for user root Jul 08 02:01:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f100af0e-2e2e-4470-879c-2349cae80f05 tempest-ProjectReaderTests-1722681123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ea6a5ee0-37db-46b4-bb8a-7fb0ac1289a7" returned: 0 in 0.611s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:01:36 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-f100af0e-2e2e-4470-879c-2349cae80f05 tempest-ProjectReaderTests-1722681123 None] <== create_volume: return (1537ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:01:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-f100af0e-2e2e-4470-879c-2349cae80f05 tempest-ProjectReaderTests-1722681123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.540s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:01:36 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f100af0e-2e2e-4470-879c-2349cae80f05 tempest-ProjectReaderTests-1722681123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61c16912-78d8-467a-a695-49d65bb36263) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea6a5ee0-37db-46b4-bb8a-7fb0ac1289a7', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:01:36 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f100af0e-2e2e-4470-879c-2349cae80f05 tempest-ProjectReaderTests-1722681123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4781e9cc-f04c-4924-8947-0a842a78707f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:01:36 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-f100af0e-2e2e-4470-879c-2349cae80f05 tempest-ProjectReaderTests-1722681123 None] Volume volume-ea6a5ee0-37db-46b4-bb8a-7fb0ac1289a7 (ea6a5ee0-37db-46b4-bb8a-7fb0ac1289a7): created successfully Jul 08 02:01:36 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f100af0e-2e2e-4470-879c-2349cae80f05 tempest-ProjectReaderTests-1722681123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4781e9cc-f04c-4924-8947-0a842a78707f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:01:36 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-f100af0e-2e2e-4470-879c-2349cae80f05 tempest-ProjectReaderTests-1722681123 None] Flow 'volume_create_manager' (444dde85-2c47-4864-b862-20d64539a311) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:01:36 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-f100af0e-2e2e-4470-879c-2349cae80f05 tempest-ProjectReaderTests-1722681123 None] Created volume successfully. Jul 08 02:01:36 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-35d17cec-9792-490b-bd29-23a5a2e5c93d tempest-ProjectReaderTests-1722681123 None] Acquiring lock "cinder-ea6a5ee0-37db-46b4-bb8a-7fb0ac1289a7-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:01:36 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-35d17cec-9792-490b-bd29-23a5a2e5c93d tempest-ProjectReaderTests-1722681123 None] Lock "cinder-ea6a5ee0-37db-46b4-bb8a-7fb0ac1289a7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:01:36 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-35d17cec-9792-490b-bd29-23a5a2e5c93d tempest-ProjectReaderTests-1722681123 None] Acquiring lock "cinder-quobyte-ea6a5ee0-37db-46b4-bb8a-7fb0ac1289a7" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:01:36 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-35d17cec-9792-490b-bd29-23a5a2e5c93d tempest-ProjectReaderTests-1722681123 None] Lock "cinder-quobyte-ea6a5ee0-37db-46b4-bb8a-7fb0ac1289a7" acquired by "delete_volume" :: waited 0.018s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:01:36 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc2d6d0-ee16-4df8-9adb-37bf060fc94c]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:01:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-35d17cec-9792-490b-bd29-23a5a2e5c93d tempest-ProjectReaderTests-1722681123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ea6a5ee0-37db-46b4-bb8a-7fb0ac1289a7 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:01:36 devstack sudo[104879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ea6a5ee0-37db-46b4-bb8a-7fb0ac1289a7 Jul 08 02:01:36 devstack sudo[104879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:01:37 devstack sudo[104879]: pam_unix(sudo:session): session closed for user root Jul 08 02:01:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-35d17cec-9792-490b-bd29-23a5a2e5c93d tempest-ProjectReaderTests-1722681123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ea6a5ee0-37db-46b4-bb8a-7fb0ac1289a7" returned: 0 in 0.757s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:01:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-35d17cec-9792-490b-bd29-23a5a2e5c93d tempest-ProjectReaderTests-1722681123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ea6a5ee0-37db-46b4-bb8a-7fb0ac1289a7 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:01:37 devstack sudo[104884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ea6a5ee0-37db-46b4-bb8a-7fb0ac1289a7 Jul 08 02:01:37 devstack sudo[104884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:01:38 devstack sudo[104884]: pam_unix(sudo:session): session closed for user root Jul 08 02:01:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-35d17cec-9792-490b-bd29-23a5a2e5c93d tempest-ProjectReaderTests-1722681123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ea6a5ee0-37db-46b4-bb8a-7fb0ac1289a7" returned: 0 in 0.638s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:01:38 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-35d17cec-9792-490b-bd29-23a5a2e5c93d tempest-ProjectReaderTests-1722681123 None] Lock "cinder-quobyte-ea6a5ee0-37db-46b4-bb8a-7fb0ac1289a7" released by "delete_volume" :: held 1.438s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:01:38 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-35d17cec-9792-490b-bd29-23a5a2e5c93d tempest-ProjectReaderTests-1722681123 None] Created reservations ['56dbd685-e633-4be0-8871-8f5c1b2d2577', '48344bec-7387-4009-845e-621c0c85fad3', '6cafc9b9-c7ff-4170-a79f-e772301e389d', '363a58fb-cebd-4256-9939-6c5607e92e07'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:01:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-35d17cec-9792-490b-bd29-23a5a2e5c93d tempest-ProjectReaderTests-1722681123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:01:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-35d17cec-9792-490b-bd29-23a5a2e5c93d tempest-ProjectReaderTests-1722681123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:01:38 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-35d17cec-9792-490b-bd29-23a5a2e5c93d tempest-ProjectReaderTests-1722681123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:01:38 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-35d17cec-9792-490b-bd29-23a5a2e5c93d tempest-ProjectReaderTests-1722681123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:01:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-35d17cec-9792-490b-bd29-23a5a2e5c93d tempest-ProjectReaderTests-1722681123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:01:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-35d17cec-9792-490b-bd29-23a5a2e5c93d tempest-ProjectReaderTests-1722681123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:01:38 devstack sudo[104887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 02:01:38 devstack sudo[104887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:01:38 devstack sudo[104887]: pam_unix(sudo:session): session closed for user root Jul 08 02:01:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-35d17cec-9792-490b-bd29-23a5a2e5c93d tempest-ProjectReaderTests-1722681123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.697s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:01:39 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-35d17cec-9792-490b-bd29-23a5a2e5c93d tempest-ProjectReaderTests-1722681123 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:01:39 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-35d17cec-9792-490b-bd29-23a5a2e5c93d tempest-ProjectReaderTests-1722681123 None] Deleted volume successfully. Jul 08 02:01:39 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-35d17cec-9792-490b-bd29-23a5a2e5c93d tempest-ProjectReaderTests-1722681123 None] Lock "cinder-ea6a5ee0-37db-46b4-bb8a-7fb0ac1289a7-delete_volume" released by "delete_volume" :: held 2.407s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:01:39 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-197022f8-ee7c-4c9b-b019-0c69654df036 tempest-ProjectReaderTests-1722681123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:01:39 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-197022f8-ee7c-4c9b-b019-0c69654df036 tempest-ProjectReaderTests-1722681123 None] Flow 'volume_create_manager' (164826c9-beb5-4a0a-b74d-63e2bd610987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:01:39 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-197022f8-ee7c-4c9b-b019-0c69654df036 tempest-ProjectReaderTests-1722681123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3ac4ef7-732a-4b4c-adbd-e762f82dd751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:01:39 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-197022f8-ee7c-4c9b-b019-0c69654df036 tempest-ProjectReaderTests-1722681123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3ac4ef7-732a-4b4c-adbd-e762f82dd751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:01:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-652666477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89e7d0a9-48cd-43c7-8fd1-77110ac97f41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9166d541f9a941e9aa4a3173ff87b9cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:01:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:01:39Z,use_quota=True,user_id='053e9df9b7514b0ba7fa68bc23b8e420',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:01:39 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-197022f8-ee7c-4c9b-b019-0c69654df036 tempest-ProjectReaderTests-1722681123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54c1abe1-c964-45ef-9a99-dd6d6a20693d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:01:39 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-197022f8-ee7c-4c9b-b019-0c69654df036 tempest-ProjectReaderTests-1722681123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54c1abe1-c964-45ef-9a99-dd6d6a20693d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:01:39 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-197022f8-ee7c-4c9b-b019-0c69654df036 tempest-ProjectReaderTests-1722681123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf923b67-c618-4e59-9755-3ae02c6c198e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:01:39 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-197022f8-ee7c-4c9b-b019-0c69654df036 tempest-ProjectReaderTests-1722681123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf923b67-c618-4e59-9755-3ae02c6c198e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89e7d0a9-48cd-43c7-8fd1-77110ac97f41', 'volume_name': 'volume-89e7d0a9-48cd-43c7-8fd1-77110ac97f41', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:01:39 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-197022f8-ee7c-4c9b-b019-0c69654df036 tempest-ProjectReaderTests-1722681123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0bd155b-bb22-482a-9dfc-8cc51775f1b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:01:39 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-197022f8-ee7c-4c9b-b019-0c69654df036 tempest-ProjectReaderTests-1722681123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0bd155b-bb22-482a-9dfc-8cc51775f1b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:01:39 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-197022f8-ee7c-4c9b-b019-0c69654df036 tempest-ProjectReaderTests-1722681123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb45c27a-e968-4670-b67d-aacd3d0a010a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:01:39 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-197022f8-ee7c-4c9b-b019-0c69654df036 tempest-ProjectReaderTests-1722681123 None] Volume 89e7d0a9-48cd-43c7-8fd1-77110ac97f41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89e7d0a9-48cd-43c7-8fd1-77110ac97f41', 'volume_size': 1} Jul 08 02:01:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-197022f8-ee7c-4c9b-b019-0c69654df036 tempest-ProjectReaderTests-1722681123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:01:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-197022f8-ee7c-4c9b-b019-0c69654df036 tempest-ProjectReaderTests-1722681123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:01:39 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-197022f8-ee7c-4c9b-b019-0c69654df036 tempest-ProjectReaderTests-1722681123 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:01:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-652666477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89e7d0a9-48cd-43c7-8fd1-77110ac97f41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9166d541f9a941e9aa4a3173ff87b9cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:01:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:01:39Z,use_quota=True,user_id='053e9df9b7514b0ba7fa68bc23b8e420',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:01:39 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-197022f8-ee7c-4c9b-b019-0c69654df036 tempest-ProjectReaderTests-1722681123 None] Creating volume 89e7d0a9-48cd-43c7-8fd1-77110ac97f41 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:01:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-197022f8-ee7c-4c9b-b019-0c69654df036 tempest-ProjectReaderTests-1722681123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:01:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-197022f8-ee7c-4c9b-b019-0c69654df036 tempest-ProjectReaderTests-1722681123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:01:39 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-197022f8-ee7c-4c9b-b019-0c69654df036 tempest-ProjectReaderTests-1722681123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:01:39 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-197022f8-ee7c-4c9b-b019-0c69654df036 tempest-ProjectReaderTests-1722681123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:01:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-197022f8-ee7c-4c9b-b019-0c69654df036 tempest-ProjectReaderTests-1722681123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:01:39 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-197022f8-ee7c-4c9b-b019-0c69654df036 tempest-ProjectReaderTests-1722681123 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:01:39 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-197022f8-ee7c-4c9b-b019-0c69654df036 tempest-ProjectReaderTests-1722681123 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 02:01:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-197022f8-ee7c-4c9b-b019-0c69654df036 tempest-ProjectReaderTests-1722681123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-89e7d0a9-48cd-43c7-8fd1-77110ac97f41 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:01:39 devstack sudo[104890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-89e7d0a9-48cd-43c7-8fd1-77110ac97f41 1073741824 Jul 08 02:01:39 devstack sudo[104890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:01:40 devstack sudo[104890]: pam_unix(sudo:session): session closed for user root Jul 08 02:01:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-197022f8-ee7c-4c9b-b019-0c69654df036 tempest-ProjectReaderTests-1722681123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-89e7d0a9-48cd-43c7-8fd1-77110ac97f41 1073741824" returned: 0 in 0.861s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:01:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-197022f8-ee7c-4c9b-b019-0c69654df036 tempest-ProjectReaderTests-1722681123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-89e7d0a9-48cd-43c7-8fd1-77110ac97f41 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:01:40 devstack sudo[104896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-89e7d0a9-48cd-43c7-8fd1-77110ac97f41 Jul 08 02:01:40 devstack sudo[104896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:01:40 devstack sudo[104896]: pam_unix(sudo:session): session closed for user root Jul 08 02:01:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-197022f8-ee7c-4c9b-b019-0c69654df036 tempest-ProjectReaderTests-1722681123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-89e7d0a9-48cd-43c7-8fd1-77110ac97f41" returned: 0 in 0.647s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:01:40 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-197022f8-ee7c-4c9b-b019-0c69654df036 tempest-ProjectReaderTests-1722681123 None] <== create_volume: return (1554ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:01:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-197022f8-ee7c-4c9b-b019-0c69654df036 tempest-ProjectReaderTests-1722681123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.556s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:01:40 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-197022f8-ee7c-4c9b-b019-0c69654df036 tempest-ProjectReaderTests-1722681123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb45c27a-e968-4670-b67d-aacd3d0a010a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89e7d0a9-48cd-43c7-8fd1-77110ac97f41', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:01:41 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-197022f8-ee7c-4c9b-b019-0c69654df036 tempest-ProjectReaderTests-1722681123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2bf1972-1c6b-4380-8895-f01a958672b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:01:41 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-197022f8-ee7c-4c9b-b019-0c69654df036 tempest-ProjectReaderTests-1722681123 None] Volume volume-89e7d0a9-48cd-43c7-8fd1-77110ac97f41 (89e7d0a9-48cd-43c7-8fd1-77110ac97f41): created successfully Jul 08 02:01:41 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-197022f8-ee7c-4c9b-b019-0c69654df036 tempest-ProjectReaderTests-1722681123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2bf1972-1c6b-4380-8895-f01a958672b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:01:41 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-197022f8-ee7c-4c9b-b019-0c69654df036 tempest-ProjectReaderTests-1722681123 None] Flow 'volume_create_manager' (164826c9-beb5-4a0a-b74d-63e2bd610987) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:01:41 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-197022f8-ee7c-4c9b-b019-0c69654df036 tempest-ProjectReaderTests-1722681123 None] Created volume successfully. Jul 08 02:01:41 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-f605fa74-6f72-4564-a07c-34da92a9eb49 tempest-ProjectReaderTests-1722681123 None] Acquiring lock "cinder-89e7d0a9-48cd-43c7-8fd1-77110ac97f41-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:01:41 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-f605fa74-6f72-4564-a07c-34da92a9eb49 tempest-ProjectReaderTests-1722681123 None] Lock "cinder-89e7d0a9-48cd-43c7-8fd1-77110ac97f41-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:01:41 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-f605fa74-6f72-4564-a07c-34da92a9eb49 tempest-ProjectReaderTests-1722681123 None] Acquiring lock "cinder-quobyte-89e7d0a9-48cd-43c7-8fd1-77110ac97f41" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:01:41 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-f605fa74-6f72-4564-a07c-34da92a9eb49 tempest-ProjectReaderTests-1722681123 None] Lock "cinder-quobyte-89e7d0a9-48cd-43c7-8fd1-77110ac97f41" acquired by "delete_volume" :: waited 0.019s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:01:41 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be33c9e-9021-4844-a954-4de10621673e]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:01:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f605fa74-6f72-4564-a07c-34da92a9eb49 tempest-ProjectReaderTests-1722681123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-89e7d0a9-48cd-43c7-8fd1-77110ac97f41 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:01:41 devstack sudo[104899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-89e7d0a9-48cd-43c7-8fd1-77110ac97f41 Jul 08 02:01:41 devstack sudo[104899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:01:42 devstack sudo[104899]: pam_unix(sudo:session): session closed for user root Jul 08 02:01:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f605fa74-6f72-4564-a07c-34da92a9eb49 tempest-ProjectReaderTests-1722681123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-89e7d0a9-48cd-43c7-8fd1-77110ac97f41" returned: 0 in 0.820s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:01:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f605fa74-6f72-4564-a07c-34da92a9eb49 tempest-ProjectReaderTests-1722681123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-89e7d0a9-48cd-43c7-8fd1-77110ac97f41 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:01:42 devstack sudo[104906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-89e7d0a9-48cd-43c7-8fd1-77110ac97f41 Jul 08 02:01:42 devstack sudo[104906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:01:43 devstack sudo[104906]: pam_unix(sudo:session): session closed for user root Jul 08 02:01:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f605fa74-6f72-4564-a07c-34da92a9eb49 tempest-ProjectReaderTests-1722681123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-89e7d0a9-48cd-43c7-8fd1-77110ac97f41" returned: 0 in 0.768s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:01:43 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-f605fa74-6f72-4564-a07c-34da92a9eb49 tempest-ProjectReaderTests-1722681123 None] Lock "cinder-quobyte-89e7d0a9-48cd-43c7-8fd1-77110ac97f41" released by "delete_volume" :: held 1.630s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:01:43 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-f605fa74-6f72-4564-a07c-34da92a9eb49 tempest-ProjectReaderTests-1722681123 None] Created reservations ['d86cde1d-2cd5-4da7-9d06-2e77b887d98e', '5a2f69f6-dc04-48ba-9466-191c03b9efdf', '15f5dd74-3fd3-4245-a5fc-0c893e159569', '0e4e7cf7-5b7e-4737-b1ee-b235a6f73473'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:01:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-f605fa74-6f72-4564-a07c-34da92a9eb49 tempest-ProjectReaderTests-1722681123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:01:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-f605fa74-6f72-4564-a07c-34da92a9eb49 tempest-ProjectReaderTests-1722681123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:01:43 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-f605fa74-6f72-4564-a07c-34da92a9eb49 tempest-ProjectReaderTests-1722681123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:01:43 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-f605fa74-6f72-4564-a07c-34da92a9eb49 tempest-ProjectReaderTests-1722681123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:01:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-f605fa74-6f72-4564-a07c-34da92a9eb49 tempest-ProjectReaderTests-1722681123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:01:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f605fa74-6f72-4564-a07c-34da92a9eb49 tempest-ProjectReaderTests-1722681123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:01:43 devstack sudo[104910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 02:01:43 devstack sudo[104910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:01:43 devstack sudo[104910]: pam_unix(sudo:session): session closed for user root Jul 08 02:01:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f605fa74-6f72-4564-a07c-34da92a9eb49 tempest-ProjectReaderTests-1722681123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.651s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:01:44 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-f605fa74-6f72-4564-a07c-34da92a9eb49 tempest-ProjectReaderTests-1722681123 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:01:44 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-f605fa74-6f72-4564-a07c-34da92a9eb49 tempest-ProjectReaderTests-1722681123 None] Deleted volume successfully. Jul 08 02:01:44 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-f605fa74-6f72-4564-a07c-34da92a9eb49 tempest-ProjectReaderTests-1722681123 None] Lock "cinder-89e7d0a9-48cd-43c7-8fd1-77110ac97f41-delete_volume" released by "delete_volume" :: held 2.499s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:01:44 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c0f12cf-0d28-415b-a891-464285d04165 tempest-ProjectReaderTests-1722681123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:01:44 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6c0f12cf-0d28-415b-a891-464285d04165 tempest-ProjectReaderTests-1722681123 None] Flow 'volume_create_manager' (5b2c9ad8-cc33-4212-bdce-7fab79ee11f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:01:44 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6c0f12cf-0d28-415b-a891-464285d04165 tempest-ProjectReaderTests-1722681123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (630f4b64-6012-4d0b-b63e-8091750c7fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:01:44 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6c0f12cf-0d28-415b-a891-464285d04165 tempest-ProjectReaderTests-1722681123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (630f4b64-6012-4d0b-b63e-8091750c7fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:01:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1412861795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3eaefc39-e962-454d-aa93-1f0bd845790e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9166d541f9a941e9aa4a3173ff87b9cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:01:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:01:44Z,use_quota=True,user_id='053e9df9b7514b0ba7fa68bc23b8e420',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:01:44 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6c0f12cf-0d28-415b-a891-464285d04165 tempest-ProjectReaderTests-1722681123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc32cc89-6c45-4a5e-a2ec-3893d0704a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:01:44 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6c0f12cf-0d28-415b-a891-464285d04165 tempest-ProjectReaderTests-1722681123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc32cc89-6c45-4a5e-a2ec-3893d0704a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:01:44 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6c0f12cf-0d28-415b-a891-464285d04165 tempest-ProjectReaderTests-1722681123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74c22417-70bc-483e-938a-41c002c3e561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:01:44 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6c0f12cf-0d28-415b-a891-464285d04165 tempest-ProjectReaderTests-1722681123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74c22417-70bc-483e-938a-41c002c3e561) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3eaefc39-e962-454d-aa93-1f0bd845790e', 'volume_name': 'volume-3eaefc39-e962-454d-aa93-1f0bd845790e', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:01:44 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6c0f12cf-0d28-415b-a891-464285d04165 tempest-ProjectReaderTests-1722681123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c49a67b2-2c05-4fd1-808e-de37b3a2de26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:01:44 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6c0f12cf-0d28-415b-a891-464285d04165 tempest-ProjectReaderTests-1722681123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c49a67b2-2c05-4fd1-808e-de37b3a2de26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:01:44 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6c0f12cf-0d28-415b-a891-464285d04165 tempest-ProjectReaderTests-1722681123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (446c9875-b41f-421e-812a-aaa1ec906ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:01:44 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-6c0f12cf-0d28-415b-a891-464285d04165 tempest-ProjectReaderTests-1722681123 None] Volume 3eaefc39-e962-454d-aa93-1f0bd845790e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3eaefc39-e962-454d-aa93-1f0bd845790e', 'volume_size': 1} Jul 08 02:01:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6c0f12cf-0d28-415b-a891-464285d04165 tempest-ProjectReaderTests-1722681123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:01:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6c0f12cf-0d28-415b-a891-464285d04165 tempest-ProjectReaderTests-1722681123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:01:44 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-6c0f12cf-0d28-415b-a891-464285d04165 tempest-ProjectReaderTests-1722681123 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:01:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1412861795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3eaefc39-e962-454d-aa93-1f0bd845790e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9166d541f9a941e9aa4a3173ff87b9cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:01:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:01:44Z,use_quota=True,user_id='053e9df9b7514b0ba7fa68bc23b8e420',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:01:44 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-6c0f12cf-0d28-415b-a891-464285d04165 tempest-ProjectReaderTests-1722681123 None] Creating volume 3eaefc39-e962-454d-aa93-1f0bd845790e {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:01:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6c0f12cf-0d28-415b-a891-464285d04165 tempest-ProjectReaderTests-1722681123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:01:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6c0f12cf-0d28-415b-a891-464285d04165 tempest-ProjectReaderTests-1722681123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:01:44 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-6c0f12cf-0d28-415b-a891-464285d04165 tempest-ProjectReaderTests-1722681123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:01:44 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-6c0f12cf-0d28-415b-a891-464285d04165 tempest-ProjectReaderTests-1722681123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:01:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6c0f12cf-0d28-415b-a891-464285d04165 tempest-ProjectReaderTests-1722681123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:01:44 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-6c0f12cf-0d28-415b-a891-464285d04165 tempest-ProjectReaderTests-1722681123 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:01:44 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-6c0f12cf-0d28-415b-a891-464285d04165 tempest-ProjectReaderTests-1722681123 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 02:01:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6c0f12cf-0d28-415b-a891-464285d04165 tempest-ProjectReaderTests-1722681123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3eaefc39-e962-454d-aa93-1f0bd845790e 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:01:44 devstack sudo[104913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3eaefc39-e962-454d-aa93-1f0bd845790e 1073741824 Jul 08 02:01:44 devstack sudo[104913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:01:45 devstack sudo[104913]: pam_unix(sudo:session): session closed for user root Jul 08 02:01:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6c0f12cf-0d28-415b-a891-464285d04165 tempest-ProjectReaderTests-1722681123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3eaefc39-e962-454d-aa93-1f0bd845790e 1073741824" returned: 0 in 0.803s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:01:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6c0f12cf-0d28-415b-a891-464285d04165 tempest-ProjectReaderTests-1722681123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3eaefc39-e962-454d-aa93-1f0bd845790e {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:01:45 devstack sudo[104918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3eaefc39-e962-454d-aa93-1f0bd845790e Jul 08 02:01:45 devstack sudo[104918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:01:45 devstack sudo[104918]: pam_unix(sudo:session): session closed for user root Jul 08 02:01:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6c0f12cf-0d28-415b-a891-464285d04165 tempest-ProjectReaderTests-1722681123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3eaefc39-e962-454d-aa93-1f0bd845790e" returned: 0 in 0.643s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:01:45 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-6c0f12cf-0d28-415b-a891-464285d04165 tempest-ProjectReaderTests-1722681123 None] <== create_volume: return (1510ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:01:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6c0f12cf-0d28-415b-a891-464285d04165 tempest-ProjectReaderTests-1722681123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.513s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:01:45 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6c0f12cf-0d28-415b-a891-464285d04165 tempest-ProjectReaderTests-1722681123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (446c9875-b41f-421e-812a-aaa1ec906ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3eaefc39-e962-454d-aa93-1f0bd845790e', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:01:45 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6c0f12cf-0d28-415b-a891-464285d04165 tempest-ProjectReaderTests-1722681123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84d43c55-8dd0-4647-99dd-0fba2946fae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:01:45 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-6c0f12cf-0d28-415b-a891-464285d04165 tempest-ProjectReaderTests-1722681123 None] Volume volume-3eaefc39-e962-454d-aa93-1f0bd845790e (3eaefc39-e962-454d-aa93-1f0bd845790e): created successfully Jul 08 02:01:45 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6c0f12cf-0d28-415b-a891-464285d04165 tempest-ProjectReaderTests-1722681123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84d43c55-8dd0-4647-99dd-0fba2946fae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:01:45 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6c0f12cf-0d28-415b-a891-464285d04165 tempest-ProjectReaderTests-1722681123 None] Flow 'volume_create_manager' (5b2c9ad8-cc33-4212-bdce-7fab79ee11f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:01:45 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-6c0f12cf-0d28-415b-a891-464285d04165 tempest-ProjectReaderTests-1722681123 None] Created volume successfully. Jul 08 02:01:46 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a9ee6718-5f02-4818-b274-b5417f8e90e3 tempest-ProjectReaderTests-1722681123 None] Acquiring lock "cinder-3eaefc39-e962-454d-aa93-1f0bd845790e-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:01:46 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a9ee6718-5f02-4818-b274-b5417f8e90e3 tempest-ProjectReaderTests-1722681123 None] Lock "cinder-3eaefc39-e962-454d-aa93-1f0bd845790e-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:01:46 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a9ee6718-5f02-4818-b274-b5417f8e90e3 tempest-ProjectReaderTests-1722681123 None] Acquiring lock "cinder-quobyte-3eaefc39-e962-454d-aa93-1f0bd845790e" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:01:46 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a9ee6718-5f02-4818-b274-b5417f8e90e3 tempest-ProjectReaderTests-1722681123 None] Lock "cinder-quobyte-3eaefc39-e962-454d-aa93-1f0bd845790e" acquired by "delete_volume" :: waited 0.016s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:01:46 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e275667-ffe3-4217-b495-c7964cf028a0]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:01:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a9ee6718-5f02-4818-b274-b5417f8e90e3 tempest-ProjectReaderTests-1722681123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3eaefc39-e962-454d-aa93-1f0bd845790e {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:01:46 devstack sudo[104921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3eaefc39-e962-454d-aa93-1f0bd845790e Jul 08 02:01:46 devstack sudo[104921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:01:47 devstack sudo[104921]: pam_unix(sudo:session): session closed for user root Jul 08 02:01:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a9ee6718-5f02-4818-b274-b5417f8e90e3 tempest-ProjectReaderTests-1722681123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3eaefc39-e962-454d-aa93-1f0bd845790e" returned: 0 in 0.764s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:01:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a9ee6718-5f02-4818-b274-b5417f8e90e3 tempest-ProjectReaderTests-1722681123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3eaefc39-e962-454d-aa93-1f0bd845790e {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:01:47 devstack sudo[104926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3eaefc39-e962-454d-aa93-1f0bd845790e Jul 08 02:01:47 devstack sudo[104926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:01:47 devstack sudo[104926]: pam_unix(sudo:session): session closed for user root Jul 08 02:01:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a9ee6718-5f02-4818-b274-b5417f8e90e3 tempest-ProjectReaderTests-1722681123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3eaefc39-e962-454d-aa93-1f0bd845790e" returned: 0 in 0.651s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:01:47 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a9ee6718-5f02-4818-b274-b5417f8e90e3 tempest-ProjectReaderTests-1722681123 None] Lock "cinder-quobyte-3eaefc39-e962-454d-aa93-1f0bd845790e" released by "delete_volume" :: held 1.454s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:01:47 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-a9ee6718-5f02-4818-b274-b5417f8e90e3 tempest-ProjectReaderTests-1722681123 None] Created reservations ['74b3b09e-aafb-40e5-9c32-da9e1b3c94d1', 'd7fc8988-c266-4dd4-bdde-429810bb6ce5', 'f191eb8c-cf4c-4e3f-b4dc-45412413e741', '0263b974-f916-4463-8957-f93fc815ce1a'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:01:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-a9ee6718-5f02-4818-b274-b5417f8e90e3 tempest-ProjectReaderTests-1722681123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:01:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-a9ee6718-5f02-4818-b274-b5417f8e90e3 tempest-ProjectReaderTests-1722681123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:01:47 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-a9ee6718-5f02-4818-b274-b5417f8e90e3 tempest-ProjectReaderTests-1722681123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:01:47 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-a9ee6718-5f02-4818-b274-b5417f8e90e3 tempest-ProjectReaderTests-1722681123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:01:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-a9ee6718-5f02-4818-b274-b5417f8e90e3 tempest-ProjectReaderTests-1722681123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:01:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a9ee6718-5f02-4818-b274-b5417f8e90e3 tempest-ProjectReaderTests-1722681123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:01:47 devstack sudo[104929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 02:01:47 devstack sudo[104929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:01:48 devstack sudo[104929]: pam_unix(sudo:session): session closed for user root Jul 08 02:01:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a9ee6718-5f02-4818-b274-b5417f8e90e3 tempest-ProjectReaderTests-1722681123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.698s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:01:48 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-a9ee6718-5f02-4818-b274-b5417f8e90e3 tempest-ProjectReaderTests-1722681123 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:01:48 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-a9ee6718-5f02-4818-b274-b5417f8e90e3 tempest-ProjectReaderTests-1722681123 None] Deleted volume successfully. Jul 08 02:01:48 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a9ee6718-5f02-4818-b274-b5417f8e90e3 tempest-ProjectReaderTests-1722681123 None] Lock "cinder-3eaefc39-e962-454d-aa93-1f0bd845790e-delete_volume" released by "delete_volume" :: held 2.374s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:01:54 devstack cinder-volume[87134]: INFO cinder.volume.manager [req-c80bf4e6-a474-4390-bc0b-03ebcc1c770b req-619af13a-8973-428e-b6f1-16a3c9074716 tempest-TestMinimumBasicScenario-1410073213 None] Terminate volume connection completed successfully. Jul 08 02:01:54 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [req-c80bf4e6-a474-4390-bc0b-03ebcc1c770b req-619af13a-8973-428e-b6f1-16a3c9074716 tempest-TestMinimumBasicScenario-1410073213 None] Deleting attachment ce211be8-0f30-4cbe-9f36-2dfc47480b19. {{(pid=87134) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 02:01:56 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-5894dfee-780f-4947-8809-89b3897432d6 tempest-TestMinimumBasicScenario-1410073213 None] Acquiring lock "cinder-ab0de315-914a-45b7-a181-3b78b270970c-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:01:56 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-5894dfee-780f-4947-8809-89b3897432d6 tempest-TestMinimumBasicScenario-1410073213 None] Lock "cinder-ab0de315-914a-45b7-a181-3b78b270970c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:01:56 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-5894dfee-780f-4947-8809-89b3897432d6 tempest-TestMinimumBasicScenario-1410073213 None] Acquiring lock "cinder-quobyte-ab0de315-914a-45b7-a181-3b78b270970c" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:01:56 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-5894dfee-780f-4947-8809-89b3897432d6 tempest-TestMinimumBasicScenario-1410073213 None] Lock "cinder-quobyte-ab0de315-914a-45b7-a181-3b78b270970c" acquired by "delete_volume" :: waited 0.020s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:01:56 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aedcb60-86b6-480b-a37e-70b49cf9b6f4]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:01:56 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5894dfee-780f-4947-8809-89b3897432d6 tempest-TestMinimumBasicScenario-1410073213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ab0de315-914a-45b7-a181-3b78b270970c {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:01:56 devstack sudo[104944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ab0de315-914a-45b7-a181-3b78b270970c Jul 08 02:01:56 devstack sudo[104944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:01:57 devstack sudo[104944]: pam_unix(sudo:session): session closed for user root Jul 08 02:01:57 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5894dfee-780f-4947-8809-89b3897432d6 tempest-TestMinimumBasicScenario-1410073213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ab0de315-914a-45b7-a181-3b78b270970c" returned: 0 in 0.842s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:01:57 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5894dfee-780f-4947-8809-89b3897432d6 tempest-TestMinimumBasicScenario-1410073213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ab0de315-914a-45b7-a181-3b78b270970c {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:01:57 devstack sudo[104949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ab0de315-914a-45b7-a181-3b78b270970c Jul 08 02:01:57 devstack sudo[104949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:01:58 devstack sudo[104949]: pam_unix(sudo:session): session closed for user root Jul 08 02:01:58 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5894dfee-780f-4947-8809-89b3897432d6 tempest-TestMinimumBasicScenario-1410073213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ab0de315-914a-45b7-a181-3b78b270970c" returned: 0 in 0.734s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:01:58 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-5894dfee-780f-4947-8809-89b3897432d6 tempest-TestMinimumBasicScenario-1410073213 None] Lock "cinder-quobyte-ab0de315-914a-45b7-a181-3b78b270970c" released by "delete_volume" :: held 1.637s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:01:58 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-5894dfee-780f-4947-8809-89b3897432d6 tempest-TestMinimumBasicScenario-1410073213 None] Created reservations ['cd9346d6-12ea-4919-a98d-ffa53820c8e5', '15ebc6a7-2beb-4bbf-aaaa-3f06a746603f', 'f697be86-2faf-4eeb-bec1-9c5447e5d17f', 'b4288686-a9cf-48b1-b9c4-7fcb094e0ca5'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:01:58 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5894dfee-780f-4947-8809-89b3897432d6 tempest-TestMinimumBasicScenario-1410073213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:01:58 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5894dfee-780f-4947-8809-89b3897432d6 tempest-TestMinimumBasicScenario-1410073213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:01:58 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-5894dfee-780f-4947-8809-89b3897432d6 tempest-TestMinimumBasicScenario-1410073213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:01:58 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-5894dfee-780f-4947-8809-89b3897432d6 tempest-TestMinimumBasicScenario-1410073213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:01:58 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5894dfee-780f-4947-8809-89b3897432d6 tempest-TestMinimumBasicScenario-1410073213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:01:58 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5894dfee-780f-4947-8809-89b3897432d6 tempest-TestMinimumBasicScenario-1410073213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:01:58 devstack sudo[104952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 02:01:58 devstack sudo[104952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:01:59 devstack sudo[104952]: pam_unix(sudo:session): session closed for user root Jul 08 02:01:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5894dfee-780f-4947-8809-89b3897432d6 tempest-TestMinimumBasicScenario-1410073213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.761s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:01:59 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-5894dfee-780f-4947-8809-89b3897432d6 tempest-TestMinimumBasicScenario-1410073213 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:01:59 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-5894dfee-780f-4947-8809-89b3897432d6 tempest-TestMinimumBasicScenario-1410073213 None] Deleted volume successfully. Jul 08 02:01:59 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-5894dfee-780f-4947-8809-89b3897432d6 tempest-TestMinimumBasicScenario-1410073213 None] Lock "cinder-ab0de315-914a-45b7-a181-3b78b270970c-delete_volume" released by "delete_volume" :: held 2.678s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:02:13 devstack cinder-volume[87134]: DEBUG dbcounter [-] [87134] Writing DB stats cinder:SELECT=36,cinder:UPDATE=54,cinder:INSERT=11,cinder:DELETE=3 {{(pid=87134) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:02:13 devstack cinder-volume[87134]: DEBUG dbcounter [-] [87134] Writing DB stats cinder:SELECT=33,cinder:UPDATE=51,cinder:INSERT=13,cinder:DELETE=6 {{(pid=87134) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:02:16 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3556287-847e-4ac3-b397-e0d81f19e900 tempest-SnapshotDependencyTests-465488855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:02:16 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e3556287-847e-4ac3-b397-e0d81f19e900 tempest-SnapshotDependencyTests-465488855 None] Flow 'volume_create_manager' (f13aa8bd-628f-46f9-8a75-518e811fc1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:02:16 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e3556287-847e-4ac3-b397-e0d81f19e900 tempest-SnapshotDependencyTests-465488855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84655a02-53aa-46e0-98d5-6416fc8ab0ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:02:16 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e3556287-847e-4ac3-b397-e0d81f19e900 tempest-SnapshotDependencyTests-465488855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84655a02-53aa-46e0-98d5-6416fc8ab0ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:02:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-394664101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a473dc4-02af-429e-9155-e8338c039f26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d9680a336974f6fa85676e6e8a7f20d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:02:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:02:16Z,use_quota=True,user_id='503efb6d071044279df145be3d24dd77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:02:16 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e3556287-847e-4ac3-b397-e0d81f19e900 tempest-SnapshotDependencyTests-465488855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (594fe21a-37ec-41fe-9760-cc5af664e891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:02:16 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e3556287-847e-4ac3-b397-e0d81f19e900 tempest-SnapshotDependencyTests-465488855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (594fe21a-37ec-41fe-9760-cc5af664e891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:02:16 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e3556287-847e-4ac3-b397-e0d81f19e900 tempest-SnapshotDependencyTests-465488855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf250d14-396c-4539-9817-acee0c1941e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:02:16 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e3556287-847e-4ac3-b397-e0d81f19e900 tempest-SnapshotDependencyTests-465488855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf250d14-396c-4539-9817-acee0c1941e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a473dc4-02af-429e-9155-e8338c039f26', 'volume_name': 'volume-1a473dc4-02af-429e-9155-e8338c039f26', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:02:16 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e3556287-847e-4ac3-b397-e0d81f19e900 tempest-SnapshotDependencyTests-465488855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbebc889-fd2f-45fd-84ea-cc6708712674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:02:16 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e3556287-847e-4ac3-b397-e0d81f19e900 tempest-SnapshotDependencyTests-465488855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbebc889-fd2f-45fd-84ea-cc6708712674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:02:16 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e3556287-847e-4ac3-b397-e0d81f19e900 tempest-SnapshotDependencyTests-465488855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3180f84c-44de-438d-b6d4-76edc2fb9d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:02:16 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-e3556287-847e-4ac3-b397-e0d81f19e900 tempest-SnapshotDependencyTests-465488855 None] Volume 1a473dc4-02af-429e-9155-e8338c039f26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a473dc4-02af-429e-9155-e8338c039f26', 'volume_size': 1} Jul 08 02:02:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e3556287-847e-4ac3-b397-e0d81f19e900 tempest-SnapshotDependencyTests-465488855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:02:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e3556287-847e-4ac3-b397-e0d81f19e900 tempest-SnapshotDependencyTests-465488855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:02:16 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-e3556287-847e-4ac3-b397-e0d81f19e900 tempest-SnapshotDependencyTests-465488855 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:02:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-394664101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a473dc4-02af-429e-9155-e8338c039f26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d9680a336974f6fa85676e6e8a7f20d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:02:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:02:16Z,use_quota=True,user_id='503efb6d071044279df145be3d24dd77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:02:16 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-e3556287-847e-4ac3-b397-e0d81f19e900 tempest-SnapshotDependencyTests-465488855 None] Creating volume 1a473dc4-02af-429e-9155-e8338c039f26 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:02:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e3556287-847e-4ac3-b397-e0d81f19e900 tempest-SnapshotDependencyTests-465488855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:02:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e3556287-847e-4ac3-b397-e0d81f19e900 tempest-SnapshotDependencyTests-465488855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:02:16 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-e3556287-847e-4ac3-b397-e0d81f19e900 tempest-SnapshotDependencyTests-465488855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:02:16 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-e3556287-847e-4ac3-b397-e0d81f19e900 tempest-SnapshotDependencyTests-465488855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:02:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e3556287-847e-4ac3-b397-e0d81f19e900 tempest-SnapshotDependencyTests-465488855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:02:16 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-e3556287-847e-4ac3-b397-e0d81f19e900 tempest-SnapshotDependencyTests-465488855 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:02:16 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-e3556287-847e-4ac3-b397-e0d81f19e900 tempest-SnapshotDependencyTests-465488855 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 02:02:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e3556287-847e-4ac3-b397-e0d81f19e900 tempest-SnapshotDependencyTests-465488855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1a473dc4-02af-429e-9155-e8338c039f26 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:02:16 devstack sudo[104989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1a473dc4-02af-429e-9155-e8338c039f26 1073741824 Jul 08 02:02:16 devstack sudo[104989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:02:17 devstack sudo[104989]: pam_unix(sudo:session): session closed for user root Jul 08 02:02:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e3556287-847e-4ac3-b397-e0d81f19e900 tempest-SnapshotDependencyTests-465488855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1a473dc4-02af-429e-9155-e8338c039f26 1073741824" returned: 0 in 0.931s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:02:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e3556287-847e-4ac3-b397-e0d81f19e900 tempest-SnapshotDependencyTests-465488855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1a473dc4-02af-429e-9155-e8338c039f26 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:02:17 devstack sudo[104995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1a473dc4-02af-429e-9155-e8338c039f26 Jul 08 02:02:17 devstack sudo[104995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:02:17 devstack sudo[104995]: pam_unix(sudo:session): session closed for user root Jul 08 02:02:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e3556287-847e-4ac3-b397-e0d81f19e900 tempest-SnapshotDependencyTests-465488855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1a473dc4-02af-429e-9155-e8338c039f26" returned: 0 in 0.704s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:02:17 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-e3556287-847e-4ac3-b397-e0d81f19e900 tempest-SnapshotDependencyTests-465488855 None] <== create_volume: return (1678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:02:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e3556287-847e-4ac3-b397-e0d81f19e900 tempest-SnapshotDependencyTests-465488855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.681s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:02:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e3556287-847e-4ac3-b397-e0d81f19e900 tempest-SnapshotDependencyTests-465488855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3180f84c-44de-438d-b6d4-76edc2fb9d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a473dc4-02af-429e-9155-e8338c039f26', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:02:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e3556287-847e-4ac3-b397-e0d81f19e900 tempest-SnapshotDependencyTests-465488855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce5851c7-c5d4-49a6-bd90-675c9b0fbe7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:02:17 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-e3556287-847e-4ac3-b397-e0d81f19e900 tempest-SnapshotDependencyTests-465488855 None] Volume volume-1a473dc4-02af-429e-9155-e8338c039f26 (1a473dc4-02af-429e-9155-e8338c039f26): created successfully Jul 08 02:02:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e3556287-847e-4ac3-b397-e0d81f19e900 tempest-SnapshotDependencyTests-465488855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce5851c7-c5d4-49a6-bd90-675c9b0fbe7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:02:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e3556287-847e-4ac3-b397-e0d81f19e900 tempest-SnapshotDependencyTests-465488855 None] Flow 'volume_create_manager' (f13aa8bd-628f-46f9-8a75-518e811fc1eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:02:17 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-e3556287-847e-4ac3-b397-e0d81f19e900 tempest-SnapshotDependencyTests-465488855 None] Created volume successfully. Jul 08 02:02:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-bd960d8e-2061-43b8-a634-6e4cddbaf373 tempest-SnapshotDependencyTests-465488855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:02:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-bd960d8e-2061-43b8-a634-6e4cddbaf373 tempest-SnapshotDependencyTests-465488855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:02:18 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-bd960d8e-2061-43b8-a634-6e4cddbaf373 tempest-SnapshotDependencyTests-465488855 None] Creating offline snapshot 66b6e249-88a0-4203-b8e9-aa0bebbcdcda of volume 1a473dc4-02af-429e-9155-e8338c039f26 {{(pid=87134) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 02:02:18 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc89993-bdec-4e74-a2c5-3671fc335b87]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:02:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-bd960d8e-2061-43b8-a634-6e4cddbaf373 tempest-SnapshotDependencyTests-465488855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1a473dc4-02af-429e-9155-e8338c039f26 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:02:18 devstack sudo[104998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1a473dc4-02af-429e-9155-e8338c039f26 Jul 08 02:02:18 devstack sudo[104998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:02:19 devstack sudo[104998]: pam_unix(sudo:session): session closed for user root Jul 08 02:02:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-bd960d8e-2061-43b8-a634-6e4cddbaf373 tempest-SnapshotDependencyTests-465488855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1a473dc4-02af-429e-9155-e8338c039f26" returned: 0 in 0.934s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:02:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-bd960d8e-2061-43b8-a634-6e4cddbaf373 tempest-SnapshotDependencyTests-465488855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1a473dc4-02af-429e-9155-e8338c039f26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1a473dc4-02af-429e-9155-e8338c039f26.66b6e249-88a0-4203-b8e9-aa0bebbcdcda 1G {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:02:19 devstack sudo[105003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1a473dc4-02af-429e-9155-e8338c039f26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1a473dc4-02af-429e-9155-e8338c039f26.66b6e249-88a0-4203-b8e9-aa0bebbcdcda 1G Jul 08 02:02:19 devstack sudo[105003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:02:20 devstack sudo[105003]: pam_unix(sudo:session): session closed for user root Jul 08 02:02:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-bd960d8e-2061-43b8-a634-6e4cddbaf373 tempest-SnapshotDependencyTests-465488855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1a473dc4-02af-429e-9155-e8338c039f26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1a473dc4-02af-429e-9155-e8338c039f26.66b6e249-88a0-4203-b8e9-aa0bebbcdcda 1G" returned: 0 in 0.946s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:02:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-bd960d8e-2061-43b8-a634-6e4cddbaf373 tempest-SnapshotDependencyTests-465488855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a473dc4-02af-429e-9155-e8338c039f26 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1a473dc4-02af-429e-9155-e8338c039f26.66b6e249-88a0-4203-b8e9-aa0bebbcdcda {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:02:20 devstack sudo[105009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a473dc4-02af-429e-9155-e8338c039f26 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1a473dc4-02af-429e-9155-e8338c039f26.66b6e249-88a0-4203-b8e9-aa0bebbcdcda Jul 08 02:02:20 devstack sudo[105009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:02:20 devstack cinder-volume[87134]: DEBUG oslo_service.periodic_task [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87134) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 02:02:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:02:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:02:20 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:02:20 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:02:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:02:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:02:20 devstack sudo[105014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 02:02:20 devstack sudo[105014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:02:21 devstack sudo[105009]: pam_unix(sudo:session): session closed for user root Jul 08 02:02:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-bd960d8e-2061-43b8-a634-6e4cddbaf373 tempest-SnapshotDependencyTests-465488855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a473dc4-02af-429e-9155-e8338c039f26 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1a473dc4-02af-429e-9155-e8338c039f26.66b6e249-88a0-4203-b8e9-aa0bebbcdcda" returned: 0 in 0.759s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:02:21 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-bd960d8e-2061-43b8-a634-6e4cddbaf373 tempest-SnapshotDependencyTests-465488855 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1a473dc4-02af-429e-9155-e8338c039f26.66b6e249-88a0-4203-b8e9-aa0bebbcdcda is being set with open permissions: ugo+rw Jul 08 02:02:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-bd960d8e-2061-43b8-a634-6e4cddbaf373 tempest-SnapshotDependencyTests-465488855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1a473dc4-02af-429e-9155-e8338c039f26.66b6e249-88a0-4203-b8e9-aa0bebbcdcda {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:02:21 devstack sudo[105016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1a473dc4-02af-429e-9155-e8338c039f26.66b6e249-88a0-4203-b8e9-aa0bebbcdcda Jul 08 02:02:21 devstack sudo[105016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:02:21 devstack sudo[105014]: pam_unix(sudo:session): session closed for user root Jul 08 02:02:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.775s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:02:21 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:02:21 devstack cinder-volume[87134]: DEBUG oslo_service.periodic_task [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running periodic task VolumeManager._thread_info {{(pid=87134) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 02:02:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] thread count: 28 {{(pid=87134) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 02:02:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] thread info: [<_MainThread(MainThread, started 129378964615296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87134) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 02:02:21 devstack sudo[105016]: pam_unix(sudo:session): session closed for user root Jul 08 02:02:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-bd960d8e-2061-43b8-a634-6e4cddbaf373 tempest-SnapshotDependencyTests-465488855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1a473dc4-02af-429e-9155-e8338c039f26.66b6e249-88a0-4203-b8e9-aa0bebbcdcda" returned: 0 in 0.739s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:02:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-bd960d8e-2061-43b8-a634-6e4cddbaf373 tempest-SnapshotDependencyTests-465488855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1a473dc4-02af-429e-9155-e8338c039f26.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:02:21 devstack sudo[105020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1a473dc4-02af-429e-9155-e8338c039f26.info Jul 08 02:02:21 devstack sudo[105020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:02:22 devstack sudo[105020]: pam_unix(sudo:session): session closed for user root Jul 08 02:02:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-bd960d8e-2061-43b8-a634-6e4cddbaf373 tempest-SnapshotDependencyTests-465488855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1a473dc4-02af-429e-9155-e8338c039f26.info" returned: 0 in 0.833s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:02:22 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-bd960d8e-2061-43b8-a634-6e4cddbaf373 tempest-SnapshotDependencyTests-465488855 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1a473dc4-02af-429e-9155-e8338c039f26.info is being set with open permissions: ugo+rw Jul 08 02:02:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-bd960d8e-2061-43b8-a634-6e4cddbaf373 tempest-SnapshotDependencyTests-465488855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1a473dc4-02af-429e-9155-e8338c039f26.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:02:22 devstack sudo[105023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1a473dc4-02af-429e-9155-e8338c039f26.info Jul 08 02:02:22 devstack sudo[105023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:02:23 devstack sudo[105023]: pam_unix(sudo:session): session closed for user root Jul 08 02:02:23 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-bd960d8e-2061-43b8-a634-6e4cddbaf373 tempest-SnapshotDependencyTests-465488855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1a473dc4-02af-429e-9155-e8338c039f26.info" returned: 0 in 0.705s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:02:23 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-bd960d8e-2061-43b8-a634-6e4cddbaf373 tempest-SnapshotDependencyTests-465488855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.012s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:02:23 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-bd960d8e-2061-43b8-a634-6e4cddbaf373 tempest-SnapshotDependencyTests-465488855 None] Create snapshot completed successfully Jul 08 02:02:24 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-e28cfd57-bdff-429a-834e-5174bea55488 tempest-SnapshotDependencyTests-465488855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:02:24 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e28cfd57-bdff-429a-834e-5174bea55488 tempest-SnapshotDependencyTests-465488855 None] Flow 'volume_create_manager' (42718ac7-b31b-46bc-acfc-fba7d694b46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:02:24 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e28cfd57-bdff-429a-834e-5174bea55488 tempest-SnapshotDependencyTests-465488855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b3d9e3f-7fea-4cbd-bba7-882916a3396d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:02:24 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e28cfd57-bdff-429a-834e-5174bea55488 tempest-SnapshotDependencyTests-465488855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b3d9e3f-7fea-4cbd-bba7-882916a3396d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:02:24Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68ca7286-26c6-4fd3-ae31-326b8f836e9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d9680a336974f6fa85676e6e8a7f20d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:02:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=66b6e249-88a0-4203-b8e9-aa0bebbcdcda,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:02:24Z,use_quota=True,user_id='503efb6d071044279df145be3d24dd77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:02:24 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e28cfd57-bdff-429a-834e-5174bea55488 tempest-SnapshotDependencyTests-465488855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d71fe65c-eab8-46aa-a2f2-4d58f0994793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:02:24 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e28cfd57-bdff-429a-834e-5174bea55488 tempest-SnapshotDependencyTests-465488855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d71fe65c-eab8-46aa-a2f2-4d58f0994793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:02:24 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e28cfd57-bdff-429a-834e-5174bea55488 tempest-SnapshotDependencyTests-465488855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56e8ce3e-ebc2-409c-b2c4-33dae136a9ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:02:24 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e28cfd57-bdff-429a-834e-5174bea55488 tempest-SnapshotDependencyTests-465488855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56e8ce3e-ebc2-409c-b2c4-33dae136a9ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '68ca7286-26c6-4fd3-ae31-326b8f836e9e', 'volume_name': 'volume-68ca7286-26c6-4fd3-ae31-326b8f836e9e', 'volume_size': 1, 'snapshot_id': '66b6e249-88a0-4203-b8e9-aa0bebbcdcda'}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:02:24 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e28cfd57-bdff-429a-834e-5174bea55488 tempest-SnapshotDependencyTests-465488855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18f88a28-281d-42cc-bf5a-6ecefd9d4077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:02:24 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e28cfd57-bdff-429a-834e-5174bea55488 tempest-SnapshotDependencyTests-465488855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18f88a28-281d-42cc-bf5a-6ecefd9d4077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:02:24 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e28cfd57-bdff-429a-834e-5174bea55488 tempest-SnapshotDependencyTests-465488855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6528aadf-bf82-440f-a350-2c974b75c145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:02:24 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-e28cfd57-bdff-429a-834e-5174bea55488 tempest-SnapshotDependencyTests-465488855 None] Volume 68ca7286-26c6-4fd3-ae31-326b8f836e9e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-68ca7286-26c6-4fd3-ae31-326b8f836e9e', 'volume_size': 1, 'snapshot_id': '66b6e249-88a0-4203-b8e9-aa0bebbcdcda'} Jul 08 02:02:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e28cfd57-bdff-429a-834e-5174bea55488 tempest-SnapshotDependencyTests-465488855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:02:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e28cfd57-bdff-429a-834e-5174bea55488 tempest-SnapshotDependencyTests-465488855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:02:24 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-e28cfd57-bdff-429a-834e-5174bea55488 tempest-SnapshotDependencyTests-465488855 None] Acquiring lock "cinder-quobyte-66b6e249-88a0-4203-b8e9-aa0bebbcdcda-68ca7286-26c6-4fd3-ae31-326b8f836e9e" by "_create_volume_from_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:02:24 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-e28cfd57-bdff-429a-834e-5174bea55488 tempest-SnapshotDependencyTests-465488855 None] Lock "cinder-quobyte-66b6e249-88a0-4203-b8e9-aa0bebbcdcda-68ca7286-26c6-4fd3-ae31-326b8f836e9e" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:02:24 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-e28cfd57-bdff-429a-834e-5174bea55488 tempest-SnapshotDependencyTests-465488855 None] Creating volume 68ca7286-26c6-4fd3-ae31-326b8f836e9e from snapshot 66b6e249-88a0-4203-b8e9-aa0bebbcdcda {{(pid=87134) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 02:02:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e28cfd57-bdff-429a-834e-5174bea55488 tempest-SnapshotDependencyTests-465488855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:02:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e28cfd57-bdff-429a-834e-5174bea55488 tempest-SnapshotDependencyTests-465488855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:02:24 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-e28cfd57-bdff-429a-834e-5174bea55488 tempest-SnapshotDependencyTests-465488855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:02:24 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-e28cfd57-bdff-429a-834e-5174bea55488 tempest-SnapshotDependencyTests-465488855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:02:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e28cfd57-bdff-429a-834e-5174bea55488 tempest-SnapshotDependencyTests-465488855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:02:24 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-e28cfd57-bdff-429a-834e-5174bea55488 tempest-SnapshotDependencyTests-465488855 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:02:24 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-e28cfd57-bdff-429a-834e-5174bea55488 tempest-SnapshotDependencyTests-465488855 None] Acquiring lock "cinder-quobyte-68ca7286-26c6-4fd3-ae31-326b8f836e9e" by "_copy_volume_from_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:02:24 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-e28cfd57-bdff-429a-834e-5174bea55488 tempest-SnapshotDependencyTests-465488855 None] Lock "cinder-quobyte-68ca7286-26c6-4fd3-ae31-326b8f836e9e" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:02:24 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-e28cfd57-bdff-429a-834e-5174bea55488 tempest-SnapshotDependencyTests-465488855 None] snapshot: 66b6e249-88a0-4203-b8e9-aa0bebbcdcda, volume: 68ca7286-26c6-4fd3-ae31-326b8f836e9e, {{(pid=87134) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 02:02:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e28cfd57-bdff-429a-834e-5174bea55488 tempest-SnapshotDependencyTests-465488855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:02:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e28cfd57-bdff-429a-834e-5174bea55488 tempest-SnapshotDependencyTests-465488855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:02:24 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-e28cfd57-bdff-429a-834e-5174bea55488 tempest-SnapshotDependencyTests-465488855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:02:24 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-e28cfd57-bdff-429a-834e-5174bea55488 tempest-SnapshotDependencyTests-465488855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:02:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e28cfd57-bdff-429a-834e-5174bea55488 tempest-SnapshotDependencyTests-465488855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:02:24 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[44428c63-f65c-45e0-b97f-7bd30bc21316]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:02:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e28cfd57-bdff-429a-834e-5174bea55488 tempest-SnapshotDependencyTests-465488855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1a473dc4-02af-429e-9155-e8338c039f26.66b6e249-88a0-4203-b8e9-aa0bebbcdcda {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:02:24 devstack sudo[105027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1a473dc4-02af-429e-9155-e8338c039f26.66b6e249-88a0-4203-b8e9-aa0bebbcdcda Jul 08 02:02:24 devstack sudo[105027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:02:25 devstack sudo[105027]: pam_unix(sudo:session): session closed for user root Jul 08 02:02:25 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e28cfd57-bdff-429a-834e-5174bea55488 tempest-SnapshotDependencyTests-465488855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1a473dc4-02af-429e-9155-e8338c039f26.66b6e249-88a0-4203-b8e9-aa0bebbcdcda" returned: 0 in 0.845s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:02:25 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-e28cfd57-bdff-429a-834e-5174bea55488 tempest-SnapshotDependencyTests-465488855 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a473dc4-02af-429e-9155-e8338c039f26(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:02:25 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-e28cfd57-bdff-429a-834e-5174bea55488 tempest-SnapshotDependencyTests-465488855 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1a473dc4-02af-429e-9155-e8338c039f26 {{(pid=87134) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 02:02:25 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-e28cfd57-bdff-429a-834e-5174bea55488 tempest-SnapshotDependencyTests-465488855 None] Creating direct copy from snapshot {{(pid=87134) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 02:02:25 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3999cbb-c67d-47e3-9ca2-d570b06987b5]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:02:25 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e28cfd57-bdff-429a-834e-5174bea55488 tempest-SnapshotDependencyTests-465488855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1a473dc4-02af-429e-9155-e8338c039f26 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:02:25 devstack sudo[105032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1a473dc4-02af-429e-9155-e8338c039f26 Jul 08 02:02:25 devstack sudo[105032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:02:26 devstack sudo[105032]: pam_unix(sudo:session): session closed for user root Jul 08 02:02:26 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e28cfd57-bdff-429a-834e-5174bea55488 tempest-SnapshotDependencyTests-465488855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1a473dc4-02af-429e-9155-e8338c039f26" returned: 0 in 0.922s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:02:26 devstack cinder-volume[87134]: DEBUG cinder.utils [None req-e28cfd57-bdff-429a-834e-5174bea55488 tempest-SnapshotDependencyTests-465488855 None] Path /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-68ca7286-26c6-4fd3-ae31-326b8f836e9e not found in is_blk_device check {{(pid=87134) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 02:02:26 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e28cfd57-bdff-429a-834e-5174bea55488 tempest-SnapshotDependencyTests-465488855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1a473dc4-02af-429e-9155-e8338c039f26 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-68ca7286-26c6-4fd3-ae31-326b8f836e9e {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:02:26 devstack sudo[105039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1a473dc4-02af-429e-9155-e8338c039f26 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-68ca7286-26c6-4fd3-ae31-326b8f836e9e Jul 08 02:02:26 devstack sudo[105039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:02:31 devstack sudo[105039]: pam_unix(sudo:session): session closed for user root Jul 08 02:02:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e28cfd57-bdff-429a-834e-5174bea55488 tempest-SnapshotDependencyTests-465488855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1a473dc4-02af-429e-9155-e8338c039f26 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-68ca7286-26c6-4fd3-ae31-326b8f836e9e" returned: 0 in 5.658s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:02:31 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[22aaab71-2aec-4562-9231-88b8d74d5d51]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:02:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e28cfd57-bdff-429a-834e-5174bea55488 tempest-SnapshotDependencyTests-465488855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1a473dc4-02af-429e-9155-e8338c039f26 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:02:32 devstack sudo[105058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1a473dc4-02af-429e-9155-e8338c039f26 Jul 08 02:02:32 devstack sudo[105058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:02:33 devstack sudo[105058]: pam_unix(sudo:session): session closed for user root Jul 08 02:02:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e28cfd57-bdff-429a-834e-5174bea55488 tempest-SnapshotDependencyTests-465488855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1a473dc4-02af-429e-9155-e8338c039f26" returned: 0 in 1.057s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:02:33 devstack cinder-volume[87134]: DEBUG cinder.image.image_utils [None req-e28cfd57-bdff-429a-834e-5174bea55488 tempest-SnapshotDependencyTests-465488855 None] Image conversion details: src /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1a473dc4-02af-429e-9155-e8338c039f26, size 1024.00 MB, duration 5.66 sec, destination /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-68ca7286-26c6-4fd3-ae31-326b8f836e9e {{(pid=87134) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 02:02:33 devstack cinder-volume[87134]: INFO cinder.image.image_utils [None req-e28cfd57-bdff-429a-834e-5174bea55488 tempest-SnapshotDependencyTests-465488855 None] Converted 1024.00 MB image at 180.94 MB/s Jul 08 02:02:33 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-e28cfd57-bdff-429a-834e-5174bea55488 tempest-SnapshotDependencyTests-465488855 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-68ca7286-26c6-4fd3-ae31-326b8f836e9e is being set with open permissions: ugo+rw Jul 08 02:02:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e28cfd57-bdff-429a-834e-5174bea55488 tempest-SnapshotDependencyTests-465488855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-68ca7286-26c6-4fd3-ae31-326b8f836e9e {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:02:33 devstack sudo[105100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-68ca7286-26c6-4fd3-ae31-326b8f836e9e Jul 08 02:02:33 devstack sudo[105100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:02:33 devstack sudo[105100]: pam_unix(sudo:session): session closed for user root Jul 08 02:02:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e28cfd57-bdff-429a-834e-5174bea55488 tempest-SnapshotDependencyTests-465488855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-68ca7286-26c6-4fd3-ae31-326b8f836e9e" returned: 0 in 0.704s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:02:33 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-e28cfd57-bdff-429a-834e-5174bea55488 tempest-SnapshotDependencyTests-465488855 None] Lock "cinder-quobyte-68ca7286-26c6-4fd3-ae31-326b8f836e9e" released by "_copy_volume_from_snapshot" :: held 9.343s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:02:33 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-e28cfd57-bdff-429a-834e-5174bea55488 tempest-SnapshotDependencyTests-465488855 None] Lock "cinder-quobyte-66b6e249-88a0-4203-b8e9-aa0bebbcdcda-68ca7286-26c6-4fd3-ae31-326b8f836e9e" released by "_create_volume_from_snapshot" :: held 9.390s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:02:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e28cfd57-bdff-429a-834e-5174bea55488 tempest-SnapshotDependencyTests-465488855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.406s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:02:33 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e28cfd57-bdff-429a-834e-5174bea55488 tempest-SnapshotDependencyTests-465488855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6528aadf-bf82-440f-a350-2c974b75c145) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68ca7286-26c6-4fd3-ae31-326b8f836e9e', 'volume_size': 1, 'snapshot_id': '66b6e249-88a0-4203-b8e9-aa0bebbcdcda'}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:02:33 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e28cfd57-bdff-429a-834e-5174bea55488 tempest-SnapshotDependencyTests-465488855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a1d710b-9f52-4aa2-a557-d28016f7d736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:02:33 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-e28cfd57-bdff-429a-834e-5174bea55488 tempest-SnapshotDependencyTests-465488855 None] Volume volume-68ca7286-26c6-4fd3-ae31-326b8f836e9e (68ca7286-26c6-4fd3-ae31-326b8f836e9e): created successfully Jul 08 02:02:33 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e28cfd57-bdff-429a-834e-5174bea55488 tempest-SnapshotDependencyTests-465488855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a1d710b-9f52-4aa2-a557-d28016f7d736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:02:33 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e28cfd57-bdff-429a-834e-5174bea55488 tempest-SnapshotDependencyTests-465488855 None] Flow 'volume_create_manager' (42718ac7-b31b-46bc-acfc-fba7d694b46d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:02:33 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-e28cfd57-bdff-429a-834e-5174bea55488 tempest-SnapshotDependencyTests-465488855 None] Created volume successfully. Jul 08 02:02:34 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-d879b5e6-4a3c-470d-be04-5e1ade55c2f5 tempest-SnapshotDependencyTests-465488855 None] Acquiring lock "cinder-66b6e249-88a0-4203-b8e9-aa0bebbcdcda-delete_snapshot" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:02:34 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-d879b5e6-4a3c-470d-be04-5e1ade55c2f5 tempest-SnapshotDependencyTests-465488855 None] Lock "cinder-66b6e249-88a0-4203-b8e9-aa0bebbcdcda-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:02:34 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-d879b5e6-4a3c-470d-be04-5e1ade55c2f5 tempest-SnapshotDependencyTests-465488855 None] Acquiring lock "cinder-quobyte-1a473dc4-02af-429e-9155-e8338c039f26" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:02:34 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-d879b5e6-4a3c-470d-be04-5e1ade55c2f5 tempest-SnapshotDependencyTests-465488855 None] Lock "cinder-quobyte-1a473dc4-02af-429e-9155-e8338c039f26" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:02:34 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-d879b5e6-4a3c-470d-be04-5e1ade55c2f5 tempest-SnapshotDependencyTests-465488855 None] Acquiring lock "cinder-quobyte-66b6e249-88a0-4203-b8e9-aa0bebbcdcda" by "_delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:02:34 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-d879b5e6-4a3c-470d-be04-5e1ade55c2f5 tempest-SnapshotDependencyTests-465488855 None] Lock "cinder-quobyte-66b6e249-88a0-4203-b8e9-aa0bebbcdcda" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:02:34 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-d879b5e6-4a3c-470d-be04-5e1ade55c2f5 tempest-SnapshotDependencyTests-465488855 None] Deleting offline snapshot 66b6e249-88a0-4203-b8e9-aa0bebbcdcda of volume 1a473dc4-02af-429e-9155-e8338c039f26 {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 02:02:34 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-d879b5e6-4a3c-470d-be04-5e1ade55c2f5 tempest-SnapshotDependencyTests-465488855 None] snapshot_file for this snap is: volume-1a473dc4-02af-429e-9155-e8338c039f26.66b6e249-88a0-4203-b8e9-aa0bebbcdcda {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 02:02:34 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2cbf2d-610a-434a-b8f6-2f934fee9738]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:02:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d879b5e6-4a3c-470d-be04-5e1ade55c2f5 tempest-SnapshotDependencyTests-465488855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1a473dc4-02af-429e-9155-e8338c039f26.66b6e249-88a0-4203-b8e9-aa0bebbcdcda {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:02:34 devstack sudo[105103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1a473dc4-02af-429e-9155-e8338c039f26.66b6e249-88a0-4203-b8e9-aa0bebbcdcda Jul 08 02:02:34 devstack sudo[105103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:02:35 devstack sudo[105103]: pam_unix(sudo:session): session closed for user root Jul 08 02:02:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d879b5e6-4a3c-470d-be04-5e1ade55c2f5 tempest-SnapshotDependencyTests-465488855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1a473dc4-02af-429e-9155-e8338c039f26.66b6e249-88a0-4203-b8e9-aa0bebbcdcda" returned: 0 in 0.828s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:02:35 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-d879b5e6-4a3c-470d-be04-5e1ade55c2f5 tempest-SnapshotDependencyTests-465488855 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a473dc4-02af-429e-9155-e8338c039f26(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:02:35 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f02840-1ef0-4581-92e4-9a3540f77cc1]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:02:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d879b5e6-4a3c-470d-be04-5e1ade55c2f5 tempest-SnapshotDependencyTests-465488855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1a473dc4-02af-429e-9155-e8338c039f26 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:02:35 devstack sudo[105108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1a473dc4-02af-429e-9155-e8338c039f26 Jul 08 02:02:35 devstack sudo[105108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:02:36 devstack sudo[105108]: pam_unix(sudo:session): session closed for user root Jul 08 02:02:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d879b5e6-4a3c-470d-be04-5e1ade55c2f5 tempest-SnapshotDependencyTests-465488855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1a473dc4-02af-429e-9155-e8338c039f26" returned: 0 in 0.846s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:02:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d879b5e6-4a3c-470d-be04-5e1ade55c2f5 tempest-SnapshotDependencyTests-465488855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1a473dc4-02af-429e-9155-e8338c039f26.66b6e249-88a0-4203-b8e9-aa0bebbcdcda {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:02:36 devstack sudo[105113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1a473dc4-02af-429e-9155-e8338c039f26.66b6e249-88a0-4203-b8e9-aa0bebbcdcda Jul 08 02:02:36 devstack sudo[105113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:02:37 devstack sudo[105113]: pam_unix(sudo:session): session closed for user root Jul 08 02:02:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d879b5e6-4a3c-470d-be04-5e1ade55c2f5 tempest-SnapshotDependencyTests-465488855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1a473dc4-02af-429e-9155-e8338c039f26.66b6e249-88a0-4203-b8e9-aa0bebbcdcda" returned: 0 in 0.914s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:02:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d879b5e6-4a3c-470d-be04-5e1ade55c2f5 tempest-SnapshotDependencyTests-465488855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1a473dc4-02af-429e-9155-e8338c039f26.66b6e249-88a0-4203-b8e9-aa0bebbcdcda {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:02:37 devstack sudo[105120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1a473dc4-02af-429e-9155-e8338c039f26.66b6e249-88a0-4203-b8e9-aa0bebbcdcda Jul 08 02:02:37 devstack sudo[105120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:02:37 devstack sudo[105120]: pam_unix(sudo:session): session closed for user root Jul 08 02:02:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d879b5e6-4a3c-470d-be04-5e1ade55c2f5 tempest-SnapshotDependencyTests-465488855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1a473dc4-02af-429e-9155-e8338c039f26.66b6e249-88a0-4203-b8e9-aa0bebbcdcda" returned: 0 in 0.674s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:02:37 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-d879b5e6-4a3c-470d-be04-5e1ade55c2f5 tempest-SnapshotDependencyTests-465488855 None] Lock "cinder-quobyte-66b6e249-88a0-4203-b8e9-aa0bebbcdcda" released by "_delete_snapshot" :: held 3.381s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:02:37 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-d879b5e6-4a3c-470d-be04-5e1ade55c2f5 tempest-SnapshotDependencyTests-465488855 None] Lock "cinder-quobyte-1a473dc4-02af-429e-9155-e8338c039f26" released by "delete_snapshot" :: held 3.406s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:02:37 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-d879b5e6-4a3c-470d-be04-5e1ade55c2f5 tempest-SnapshotDependencyTests-465488855 None] Created reservations ['1adf2bcb-c502-4d7d-9ad6-99fe3a3320e5', '29be94d7-b65f-4652-8a2a-2d085ec66dc3', '732ccd38-c1ee-454d-891b-ab9bf5d6b786', '57091f68-c580-4576-85db-5d05310100f0'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:02:37 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-d879b5e6-4a3c-470d-be04-5e1ade55c2f5 tempest-SnapshotDependencyTests-465488855 None] Delete snapshot completed successfully. Jul 08 02:02:37 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-d879b5e6-4a3c-470d-be04-5e1ade55c2f5 tempest-SnapshotDependencyTests-465488855 None] Lock "cinder-66b6e249-88a0-4203-b8e9-aa0bebbcdcda-delete_snapshot" released by "delete_snapshot" :: held 3.590s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:02:38 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a85f9001-cda5-4ab0-8c2b-1a42558bc6b3 tempest-SnapshotDependencyTests-465488855 None] Acquiring lock "cinder-1a473dc4-02af-429e-9155-e8338c039f26-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:02:38 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a85f9001-cda5-4ab0-8c2b-1a42558bc6b3 tempest-SnapshotDependencyTests-465488855 None] Lock "cinder-1a473dc4-02af-429e-9155-e8338c039f26-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:02:38 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a85f9001-cda5-4ab0-8c2b-1a42558bc6b3 tempest-SnapshotDependencyTests-465488855 None] Acquiring lock "cinder-quobyte-1a473dc4-02af-429e-9155-e8338c039f26" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:02:38 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a85f9001-cda5-4ab0-8c2b-1a42558bc6b3 tempest-SnapshotDependencyTests-465488855 None] Lock "cinder-quobyte-1a473dc4-02af-429e-9155-e8338c039f26" acquired by "delete_volume" :: waited 0.014s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:02:38 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[e67c9867-1d39-4d1d-a62e-848316607650]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:02:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a85f9001-cda5-4ab0-8c2b-1a42558bc6b3 tempest-SnapshotDependencyTests-465488855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1a473dc4-02af-429e-9155-e8338c039f26 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:02:38 devstack sudo[105123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1a473dc4-02af-429e-9155-e8338c039f26 Jul 08 02:02:38 devstack sudo[105123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:02:39 devstack sudo[105123]: pam_unix(sudo:session): session closed for user root Jul 08 02:02:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a85f9001-cda5-4ab0-8c2b-1a42558bc6b3 tempest-SnapshotDependencyTests-465488855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1a473dc4-02af-429e-9155-e8338c039f26" returned: 0 in 0.931s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:02:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a85f9001-cda5-4ab0-8c2b-1a42558bc6b3 tempest-SnapshotDependencyTests-465488855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1a473dc4-02af-429e-9155-e8338c039f26 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:02:39 devstack sudo[105128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1a473dc4-02af-429e-9155-e8338c039f26 Jul 08 02:02:39 devstack sudo[105128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:02:40 devstack sudo[105128]: pam_unix(sudo:session): session closed for user root Jul 08 02:02:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a85f9001-cda5-4ab0-8c2b-1a42558bc6b3 tempest-SnapshotDependencyTests-465488855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1a473dc4-02af-429e-9155-e8338c039f26" returned: 0 in 0.666s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:02:40 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a85f9001-cda5-4ab0-8c2b-1a42558bc6b3 tempest-SnapshotDependencyTests-465488855 None] Lock "cinder-quobyte-1a473dc4-02af-429e-9155-e8338c039f26" released by "delete_volume" :: held 1.674s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:02:40 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-a85f9001-cda5-4ab0-8c2b-1a42558bc6b3 tempest-SnapshotDependencyTests-465488855 None] Created reservations ['bba4e995-ae4d-40bc-b928-0b019ebdfa6d', '37dc17e1-8d94-45aa-87c2-f451166c96ca', '87a8b4d0-fa7d-4332-98f2-ef467dc2b469', '33414b67-1b13-4d95-8bec-0d88c32fca2a'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:02:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-a85f9001-cda5-4ab0-8c2b-1a42558bc6b3 tempest-SnapshotDependencyTests-465488855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:02:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-a85f9001-cda5-4ab0-8c2b-1a42558bc6b3 tempest-SnapshotDependencyTests-465488855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:02:40 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-a85f9001-cda5-4ab0-8c2b-1a42558bc6b3 tempest-SnapshotDependencyTests-465488855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:02:40 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-a85f9001-cda5-4ab0-8c2b-1a42558bc6b3 tempest-SnapshotDependencyTests-465488855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:02:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-a85f9001-cda5-4ab0-8c2b-1a42558bc6b3 tempest-SnapshotDependencyTests-465488855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:02:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a85f9001-cda5-4ab0-8c2b-1a42558bc6b3 tempest-SnapshotDependencyTests-465488855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:02:40 devstack sudo[105131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 02:02:40 devstack sudo[105131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:02:40 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-aa5f3dab-4b63-44f6-8a44-9f9d984a6bbd tempest-SnapshotDependencyTests-465488855 None] Acquiring lock "cinder-68ca7286-26c6-4fd3-ae31-326b8f836e9e-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:02:40 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-aa5f3dab-4b63-44f6-8a44-9f9d984a6bbd tempest-SnapshotDependencyTests-465488855 None] Lock "cinder-68ca7286-26c6-4fd3-ae31-326b8f836e9e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:02:40 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-aa5f3dab-4b63-44f6-8a44-9f9d984a6bbd tempest-SnapshotDependencyTests-465488855 None] Acquiring lock "cinder-quobyte-68ca7286-26c6-4fd3-ae31-326b8f836e9e" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:02:41 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-aa5f3dab-4b63-44f6-8a44-9f9d984a6bbd tempest-SnapshotDependencyTests-465488855 None] Lock "cinder-quobyte-68ca7286-26c6-4fd3-ae31-326b8f836e9e" acquired by "delete_volume" :: waited 0.015s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:02:41 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd168b2-5f81-4f42-8a40-28f8c22268cf]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:02:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-aa5f3dab-4b63-44f6-8a44-9f9d984a6bbd tempest-SnapshotDependencyTests-465488855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-68ca7286-26c6-4fd3-ae31-326b8f836e9e {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:02:41 devstack sudo[105133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-68ca7286-26c6-4fd3-ae31-326b8f836e9e Jul 08 02:02:41 devstack sudo[105133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:02:41 devstack sudo[105131]: pam_unix(sudo:session): session closed for user root Jul 08 02:02:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a85f9001-cda5-4ab0-8c2b-1a42558bc6b3 tempest-SnapshotDependencyTests-465488855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.750s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:02:41 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-a85f9001-cda5-4ab0-8c2b-1a42558bc6b3 tempest-SnapshotDependencyTests-465488855 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:02:41 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-a85f9001-cda5-4ab0-8c2b-1a42558bc6b3 tempest-SnapshotDependencyTests-465488855 None] Deleted volume successfully. Jul 08 02:02:41 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a85f9001-cda5-4ab0-8c2b-1a42558bc6b3 tempest-SnapshotDependencyTests-465488855 None] Lock "cinder-1a473dc4-02af-429e-9155-e8338c039f26-delete_volume" released by "delete_volume" :: held 2.699s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:02:41 devstack sudo[105133]: pam_unix(sudo:session): session closed for user root Jul 08 02:02:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-aa5f3dab-4b63-44f6-8a44-9f9d984a6bbd tempest-SnapshotDependencyTests-465488855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-68ca7286-26c6-4fd3-ae31-326b8f836e9e" returned: 0 in 0.923s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:02:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-aa5f3dab-4b63-44f6-8a44-9f9d984a6bbd tempest-SnapshotDependencyTests-465488855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-68ca7286-26c6-4fd3-ae31-326b8f836e9e {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:02:41 devstack sudo[105139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-68ca7286-26c6-4fd3-ae31-326b8f836e9e Jul 08 02:02:41 devstack sudo[105139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:02:42 devstack sudo[105139]: pam_unix(sudo:session): session closed for user root Jul 08 02:02:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-aa5f3dab-4b63-44f6-8a44-9f9d984a6bbd tempest-SnapshotDependencyTests-465488855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-68ca7286-26c6-4fd3-ae31-326b8f836e9e" returned: 0 in 0.727s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:02:42 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-aa5f3dab-4b63-44f6-8a44-9f9d984a6bbd tempest-SnapshotDependencyTests-465488855 None] Lock "cinder-quobyte-68ca7286-26c6-4fd3-ae31-326b8f836e9e" released by "delete_volume" :: held 1.712s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:02:42 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-aa5f3dab-4b63-44f6-8a44-9f9d984a6bbd tempest-SnapshotDependencyTests-465488855 None] Created reservations ['245a6b74-059d-4d2f-bdf0-8b13bd70a204', '562e765d-dcf3-4a40-97c6-af45e5ae2858', 'a66f586d-c39f-4d77-a78e-cbcde90c6347', 'c33c9ec6-87f8-4c1a-8d22-fd0b7c44dc28'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:02:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-aa5f3dab-4b63-44f6-8a44-9f9d984a6bbd tempest-SnapshotDependencyTests-465488855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:02:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-aa5f3dab-4b63-44f6-8a44-9f9d984a6bbd tempest-SnapshotDependencyTests-465488855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:02:42 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-aa5f3dab-4b63-44f6-8a44-9f9d984a6bbd tempest-SnapshotDependencyTests-465488855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:02:42 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-aa5f3dab-4b63-44f6-8a44-9f9d984a6bbd tempest-SnapshotDependencyTests-465488855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:02:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-aa5f3dab-4b63-44f6-8a44-9f9d984a6bbd tempest-SnapshotDependencyTests-465488855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:02:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-aa5f3dab-4b63-44f6-8a44-9f9d984a6bbd tempest-SnapshotDependencyTests-465488855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:02:42 devstack sudo[105142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 02:02:42 devstack sudo[105142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:02:43 devstack sudo[105142]: pam_unix(sudo:session): session closed for user root Jul 08 02:02:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-aa5f3dab-4b63-44f6-8a44-9f9d984a6bbd tempest-SnapshotDependencyTests-465488855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.790s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:02:43 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-aa5f3dab-4b63-44f6-8a44-9f9d984a6bbd tempest-SnapshotDependencyTests-465488855 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:02:43 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-aa5f3dab-4b63-44f6-8a44-9f9d984a6bbd tempest-SnapshotDependencyTests-465488855 None] Deleted volume successfully. Jul 08 02:02:43 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-aa5f3dab-4b63-44f6-8a44-9f9d984a6bbd tempest-SnapshotDependencyTests-465488855 None] Lock "cinder-68ca7286-26c6-4fd3-ae31-326b8f836e9e-delete_volume" released by "delete_volume" :: held 2.765s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:02:52 devstack cinder-volume[87134]: DEBUG dbcounter [-] [87134] Writing DB stats cinder:UPDATE=27,cinder:SELECT=21,cinder:INSERT=7,cinder:DELETE=2 {{(pid=87134) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:02:53 devstack cinder-volume[87134]: DEBUG dbcounter [-] [87134] Writing DB stats cinder:SELECT=26,cinder:INSERT=7,cinder:UPDATE=29,cinder:DELETE=3 {{(pid=87134) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:03:20 devstack cinder-volume[87134]: DEBUG oslo_service.periodic_task [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running periodic task VolumeManager._thread_info {{(pid=87134) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 02:03:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] thread count: 28 {{(pid=87134) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 02:03:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] thread info: [<_MainThread(MainThread, started 129378964615296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87134) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 02:03:25 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-13e9a74a-5cc8-4ce5-b795-d82a04475bab tempest-TestServerVolumeAttachScenarioOldVersion-1845298514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:03:25 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-13e9a74a-5cc8-4ce5-b795-d82a04475bab tempest-TestServerVolumeAttachScenarioOldVersion-1845298514 None] Flow 'volume_create_manager' (85cab7e8-cc2f-4fcd-b43b-c63280668162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:03:25 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-13e9a74a-5cc8-4ce5-b795-d82a04475bab tempest-TestServerVolumeAttachScenarioOldVersion-1845298514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f842fea3-ac07-4e75-927f-ea4af00d5dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:03:25 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-13e9a74a-5cc8-4ce5-b795-d82a04475bab tempest-TestServerVolumeAttachScenarioOldVersion-1845298514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f842fea3-ac07-4e75-927f-ea4af00d5dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:03:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-432472330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=107f725d-5980-4af6-993d-60b6ad995e28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c93a6a3dc6424384b3bf4abf1b49dafb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:03:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:03:25Z,use_quota=True,user_id='5a717a4b383b401caa94d2fe1e78d98d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:03:25 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-13e9a74a-5cc8-4ce5-b795-d82a04475bab tempest-TestServerVolumeAttachScenarioOldVersion-1845298514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04d2aa6b-3ec0-424a-96f6-7b3f3a71fa25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:03:25 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-13e9a74a-5cc8-4ce5-b795-d82a04475bab tempest-TestServerVolumeAttachScenarioOldVersion-1845298514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04d2aa6b-3ec0-424a-96f6-7b3f3a71fa25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:03:25 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-13e9a74a-5cc8-4ce5-b795-d82a04475bab tempest-TestServerVolumeAttachScenarioOldVersion-1845298514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb5500e6-d8a3-4419-8312-ba957336735f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:03:25 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-13e9a74a-5cc8-4ce5-b795-d82a04475bab tempest-TestServerVolumeAttachScenarioOldVersion-1845298514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb5500e6-d8a3-4419-8312-ba957336735f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '107f725d-5980-4af6-993d-60b6ad995e28', 'volume_name': 'volume-107f725d-5980-4af6-993d-60b6ad995e28', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:03:25 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-13e9a74a-5cc8-4ce5-b795-d82a04475bab tempest-TestServerVolumeAttachScenarioOldVersion-1845298514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c4f10db-6266-4a2f-9937-2e00efd94db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:03:25 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-13e9a74a-5cc8-4ce5-b795-d82a04475bab tempest-TestServerVolumeAttachScenarioOldVersion-1845298514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c4f10db-6266-4a2f-9937-2e00efd94db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:03:25 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-13e9a74a-5cc8-4ce5-b795-d82a04475bab tempest-TestServerVolumeAttachScenarioOldVersion-1845298514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (954e7d61-0475-482b-94b7-02772733a1bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:03:25 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-13e9a74a-5cc8-4ce5-b795-d82a04475bab tempest-TestServerVolumeAttachScenarioOldVersion-1845298514 None] Volume 107f725d-5980-4af6-993d-60b6ad995e28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-107f725d-5980-4af6-993d-60b6ad995e28', 'volume_size': 1} Jul 08 02:03:25 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-13e9a74a-5cc8-4ce5-b795-d82a04475bab tempest-TestServerVolumeAttachScenarioOldVersion-1845298514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:03:25 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-13e9a74a-5cc8-4ce5-b795-d82a04475bab tempest-TestServerVolumeAttachScenarioOldVersion-1845298514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:03:25 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-13e9a74a-5cc8-4ce5-b795-d82a04475bab tempest-TestServerVolumeAttachScenarioOldVersion-1845298514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:03:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-432472330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=107f725d-5980-4af6-993d-60b6ad995e28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c93a6a3dc6424384b3bf4abf1b49dafb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:03:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:03:25Z,use_quota=True,user_id='5a717a4b383b401caa94d2fe1e78d98d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:03:25 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-13e9a74a-5cc8-4ce5-b795-d82a04475bab tempest-TestServerVolumeAttachScenarioOldVersion-1845298514 None] Creating volume 107f725d-5980-4af6-993d-60b6ad995e28 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:03:25 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-13e9a74a-5cc8-4ce5-b795-d82a04475bab tempest-TestServerVolumeAttachScenarioOldVersion-1845298514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:03:25 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-13e9a74a-5cc8-4ce5-b795-d82a04475bab tempest-TestServerVolumeAttachScenarioOldVersion-1845298514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:03:25 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-13e9a74a-5cc8-4ce5-b795-d82a04475bab tempest-TestServerVolumeAttachScenarioOldVersion-1845298514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:03:25 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-13e9a74a-5cc8-4ce5-b795-d82a04475bab tempest-TestServerVolumeAttachScenarioOldVersion-1845298514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:03:25 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-13e9a74a-5cc8-4ce5-b795-d82a04475bab tempest-TestServerVolumeAttachScenarioOldVersion-1845298514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:03:25 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-13e9a74a-5cc8-4ce5-b795-d82a04475bab tempest-TestServerVolumeAttachScenarioOldVersion-1845298514 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:03:25 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-13e9a74a-5cc8-4ce5-b795-d82a04475bab tempest-TestServerVolumeAttachScenarioOldVersion-1845298514 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 02:03:25 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-13e9a74a-5cc8-4ce5-b795-d82a04475bab tempest-TestServerVolumeAttachScenarioOldVersion-1845298514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-107f725d-5980-4af6-993d-60b6ad995e28 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:03:25 devstack sudo[105272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-107f725d-5980-4af6-993d-60b6ad995e28 1073741824 Jul 08 02:03:25 devstack sudo[105272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:03:26 devstack sudo[105272]: pam_unix(sudo:session): session closed for user root Jul 08 02:03:26 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-13e9a74a-5cc8-4ce5-b795-d82a04475bab tempest-TestServerVolumeAttachScenarioOldVersion-1845298514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-107f725d-5980-4af6-993d-60b6ad995e28 1073741824" returned: 0 in 0.826s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:03:26 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-13e9a74a-5cc8-4ce5-b795-d82a04475bab tempest-TestServerVolumeAttachScenarioOldVersion-1845298514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-107f725d-5980-4af6-993d-60b6ad995e28 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:03:26 devstack sudo[105279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-107f725d-5980-4af6-993d-60b6ad995e28 Jul 08 02:03:26 devstack sudo[105279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:03:26 devstack sudo[105279]: pam_unix(sudo:session): session closed for user root Jul 08 02:03:26 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-13e9a74a-5cc8-4ce5-b795-d82a04475bab tempest-TestServerVolumeAttachScenarioOldVersion-1845298514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-107f725d-5980-4af6-993d-60b6ad995e28" returned: 0 in 0.622s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:03:26 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-13e9a74a-5cc8-4ce5-b795-d82a04475bab tempest-TestServerVolumeAttachScenarioOldVersion-1845298514 None] <== create_volume: return (1487ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:03:26 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-13e9a74a-5cc8-4ce5-b795-d82a04475bab tempest-TestServerVolumeAttachScenarioOldVersion-1845298514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.489s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:03:26 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-13e9a74a-5cc8-4ce5-b795-d82a04475bab tempest-TestServerVolumeAttachScenarioOldVersion-1845298514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (954e7d61-0475-482b-94b7-02772733a1bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-107f725d-5980-4af6-993d-60b6ad995e28', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:03:26 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-13e9a74a-5cc8-4ce5-b795-d82a04475bab tempest-TestServerVolumeAttachScenarioOldVersion-1845298514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24225a3b-8bb7-4ced-9fcf-b526a846cd40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:03:26 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-13e9a74a-5cc8-4ce5-b795-d82a04475bab tempest-TestServerVolumeAttachScenarioOldVersion-1845298514 None] Volume volume-107f725d-5980-4af6-993d-60b6ad995e28 (107f725d-5980-4af6-993d-60b6ad995e28): created successfully Jul 08 02:03:26 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-13e9a74a-5cc8-4ce5-b795-d82a04475bab tempest-TestServerVolumeAttachScenarioOldVersion-1845298514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24225a3b-8bb7-4ced-9fcf-b526a846cd40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:03:26 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-13e9a74a-5cc8-4ce5-b795-d82a04475bab tempest-TestServerVolumeAttachScenarioOldVersion-1845298514 None] Flow 'volume_create_manager' (85cab7e8-cc2f-4fcd-b43b-c63280668162) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:03:26 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-13e9a74a-5cc8-4ce5-b795-d82a04475bab tempest-TestServerVolumeAttachScenarioOldVersion-1845298514 None] Created volume successfully. Jul 08 02:03:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-b15ad3a8-4ea3-4f52-81e7-759414c0c837 req-71538f71-c036-4178-9907-e9b3e2be1d4b tempest-TestServerVolumeAttachScenarioOldVersion-1845298514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:03:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-b15ad3a8-4ea3-4f52-81e7-759414c0c837 req-71538f71-c036-4178-9907-e9b3e2be1d4b tempest-TestServerVolumeAttachScenarioOldVersion-1845298514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:03:30 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d56b3c-0fa5-41eb-97b5-29d86bbe9289]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:03:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-b15ad3a8-4ea3-4f52-81e7-759414c0c837 req-71538f71-c036-4178-9907-e9b3e2be1d4b tempest-TestServerVolumeAttachScenarioOldVersion-1845298514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-107f725d-5980-4af6-993d-60b6ad995e28 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:03:30 devstack sudo[105293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-107f725d-5980-4af6-993d-60b6ad995e28 Jul 08 02:03:30 devstack sudo[105293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:03:31 devstack sudo[105293]: pam_unix(sudo:session): session closed for user root Jul 08 02:03:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [req-b15ad3a8-4ea3-4f52-81e7-759414c0c837 req-71538f71-c036-4178-9907-e9b3e2be1d4b tempest-TestServerVolumeAttachScenarioOldVersion-1845298514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-107f725d-5980-4af6-993d-60b6ad995e28" returned: 0 in 0.787s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:03:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [req-b15ad3a8-4ea3-4f52-81e7-759414c0c837 req-71538f71-c036-4178-9907-e9b3e2be1d4b tempest-TestServerVolumeAttachScenarioOldVersion-1845298514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.804s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:03:31 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [req-b15ad3a8-4ea3-4f52-81e7-759414c0c837 req-71538f71-c036-4178-9907-e9b3e2be1d4b tempest-TestServerVolumeAttachScenarioOldVersion-1845298514 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17', 'name': 'volume-107f725d-5980-4af6-993d-60b6ad995e28', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e38101f4-b82b-48df-b54c-5293a1d842ee', 'enforce_multipath': True} {{(pid=87134) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 02:03:31 devstack cinder-volume[87134]: INFO cinder.volume.manager [req-b15ad3a8-4ea3-4f52-81e7-759414c0c837 req-71538f71-c036-4178-9907-e9b3e2be1d4b tempest-TestServerVolumeAttachScenarioOldVersion-1845298514 None] attachment_update completed successfully. Jul 08 02:03:37 devstack cinder-volume[87134]: INFO cinder.volume.manager [req-f83103b7-06df-40a2-956b-509f3d5053d5 req-a04aa5ae-492a-4849-af27-28233dd11540 tempest-TestServerVolumeAttachScenarioOldVersion-1845298514 None] Terminate volume connection completed successfully. Jul 08 02:03:37 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [req-f83103b7-06df-40a2-956b-509f3d5053d5 req-a04aa5ae-492a-4849-af27-28233dd11540 tempest-TestServerVolumeAttachScenarioOldVersion-1845298514 None] Deleting attachment e38101f4-b82b-48df-b54c-5293a1d842ee. {{(pid=87134) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 02:03:39 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-b89c340b-4991-471e-9fa3-e49551f3128f tempest-TestServerVolumeAttachScenarioOldVersion-1845298514 None] Acquiring lock "cinder-107f725d-5980-4af6-993d-60b6ad995e28-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:03:39 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-b89c340b-4991-471e-9fa3-e49551f3128f tempest-TestServerVolumeAttachScenarioOldVersion-1845298514 None] Lock "cinder-107f725d-5980-4af6-993d-60b6ad995e28-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:03:39 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-b89c340b-4991-471e-9fa3-e49551f3128f tempest-TestServerVolumeAttachScenarioOldVersion-1845298514 None] Acquiring lock "cinder-quobyte-107f725d-5980-4af6-993d-60b6ad995e28" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:03:39 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-b89c340b-4991-471e-9fa3-e49551f3128f tempest-TestServerVolumeAttachScenarioOldVersion-1845298514 None] Lock "cinder-quobyte-107f725d-5980-4af6-993d-60b6ad995e28" acquired by "delete_volume" :: waited 0.022s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:03:39 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[20fc3e6b-eff1-4f20-a320-f004ce389d4a]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:03:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b89c340b-4991-471e-9fa3-e49551f3128f tempest-TestServerVolumeAttachScenarioOldVersion-1845298514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-107f725d-5980-4af6-993d-60b6ad995e28 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:03:39 devstack sudo[105751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-107f725d-5980-4af6-993d-60b6ad995e28 Jul 08 02:03:39 devstack sudo[105751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:03:40 devstack sudo[105751]: pam_unix(sudo:session): session closed for user root Jul 08 02:03:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b89c340b-4991-471e-9fa3-e49551f3128f tempest-TestServerVolumeAttachScenarioOldVersion-1845298514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-107f725d-5980-4af6-993d-60b6ad995e28" returned: 0 in 0.803s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:03:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b89c340b-4991-471e-9fa3-e49551f3128f tempest-TestServerVolumeAttachScenarioOldVersion-1845298514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-107f725d-5980-4af6-993d-60b6ad995e28 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:03:40 devstack sudo[105756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-107f725d-5980-4af6-993d-60b6ad995e28 Jul 08 02:03:40 devstack sudo[105756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:03:41 devstack sudo[105756]: pam_unix(sudo:session): session closed for user root Jul 08 02:03:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b89c340b-4991-471e-9fa3-e49551f3128f tempest-TestServerVolumeAttachScenarioOldVersion-1845298514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-107f725d-5980-4af6-993d-60b6ad995e28" returned: 0 in 0.664s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:03:41 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-b89c340b-4991-471e-9fa3-e49551f3128f tempest-TestServerVolumeAttachScenarioOldVersion-1845298514 None] Lock "cinder-quobyte-107f725d-5980-4af6-993d-60b6ad995e28" released by "delete_volume" :: held 1.505s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:03:41 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-b89c340b-4991-471e-9fa3-e49551f3128f tempest-TestServerVolumeAttachScenarioOldVersion-1845298514 None] Created reservations ['00188e06-48ca-49cb-93aa-f69ad5af4b08', '4230ef48-a9d3-4e16-95d3-d991084414e2', 'e2a33071-f1b0-421f-9622-05ed2d7e99c2', '12656140-7d1f-4d0a-b980-269b7efb7b07'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:03:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b89c340b-4991-471e-9fa3-e49551f3128f tempest-TestServerVolumeAttachScenarioOldVersion-1845298514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:03:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b89c340b-4991-471e-9fa3-e49551f3128f tempest-TestServerVolumeAttachScenarioOldVersion-1845298514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:03:41 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-b89c340b-4991-471e-9fa3-e49551f3128f tempest-TestServerVolumeAttachScenarioOldVersion-1845298514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:03:41 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-b89c340b-4991-471e-9fa3-e49551f3128f tempest-TestServerVolumeAttachScenarioOldVersion-1845298514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:03:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b89c340b-4991-471e-9fa3-e49551f3128f tempest-TestServerVolumeAttachScenarioOldVersion-1845298514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:03:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b89c340b-4991-471e-9fa3-e49551f3128f tempest-TestServerVolumeAttachScenarioOldVersion-1845298514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:03:41 devstack sudo[105759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 02:03:41 devstack sudo[105759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:03:42 devstack sudo[105759]: pam_unix(sudo:session): session closed for user root Jul 08 02:03:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b89c340b-4991-471e-9fa3-e49551f3128f tempest-TestServerVolumeAttachScenarioOldVersion-1845298514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.719s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:03:42 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-b89c340b-4991-471e-9fa3-e49551f3128f tempest-TestServerVolumeAttachScenarioOldVersion-1845298514 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:03:42 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-b89c340b-4991-471e-9fa3-e49551f3128f tempest-TestServerVolumeAttachScenarioOldVersion-1845298514 None] Deleted volume successfully. Jul 08 02:03:42 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-b89c340b-4991-471e-9fa3-e49551f3128f tempest-TestServerVolumeAttachScenarioOldVersion-1845298514 None] Lock "cinder-107f725d-5980-4af6-993d-60b6ad995e28-delete_volume" released by "delete_volume" :: held 2.438s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:03:51 devstack cinder-volume[87134]: DEBUG dbcounter [-] [87134] Writing DB stats cinder:UPDATE=12,cinder:SELECT=13,cinder:INSERT=2 {{(pid=87134) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:03:52 devstack cinder-volume[87134]: DEBUG dbcounter [-] [87134] Writing DB stats cinder:SELECT=14,cinder:INSERT=3,cinder:UPDATE=13,cinder:DELETE=2 {{(pid=87134) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:04:13 devstack cinder-volume[87134]: DEBUG dbcounter [-] [87134] Writing DB stats cinder:SELECT=1 {{(pid=87134) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:04:13 devstack cinder-volume[87134]: DEBUG dbcounter [-] [87134] Writing DB stats cinder:UPDATE=1 {{(pid=87134) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:04:14 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dee8bc4-e5b2-4ad0-8337-fcadd9d6895d tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:04:14 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6dee8bc4-e5b2-4ad0-8337-fcadd9d6895d tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Flow 'volume_create_manager' (43442425-d8e4-4790-a494-7c4521359c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:04:14 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6dee8bc4-e5b2-4ad0-8337-fcadd9d6895d tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5f83696-fd73-4fc1-9019-07f371ff2d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:15 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6dee8bc4-e5b2-4ad0-8337-fcadd9d6895d tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5f83696-fd73-4fc1-9019-07f371ff2d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-891880977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4233b2f-ddf5-4238-a6fb-6290ec975f46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2cadb800e474072a5fbcf41df9c4c00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:04:15Z,use_quota=True,user_id='e04003fe878b4e6b8766372ced58f07c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:15 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6dee8bc4-e5b2-4ad0-8337-fcadd9d6895d tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51e4073e-0fd2-4410-b37a-3cec83d52c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:15 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6dee8bc4-e5b2-4ad0-8337-fcadd9d6895d tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51e4073e-0fd2-4410-b37a-3cec83d52c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:15 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6dee8bc4-e5b2-4ad0-8337-fcadd9d6895d tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b00ed28f-4601-4e28-996d-a0d81a2ef4ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:15 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6dee8bc4-e5b2-4ad0-8337-fcadd9d6895d tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b00ed28f-4601-4e28-996d-a0d81a2ef4ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4233b2f-ddf5-4238-a6fb-6290ec975f46', 'volume_name': 'volume-f4233b2f-ddf5-4238-a6fb-6290ec975f46', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:15 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6dee8bc4-e5b2-4ad0-8337-fcadd9d6895d tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a32db8e-ad2a-4809-93f9-9b21e0260cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:15 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6dee8bc4-e5b2-4ad0-8337-fcadd9d6895d tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a32db8e-ad2a-4809-93f9-9b21e0260cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:15 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6dee8bc4-e5b2-4ad0-8337-fcadd9d6895d tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5b68dd5-afff-4c7d-918b-b61c0d36b97b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:15 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-6dee8bc4-e5b2-4ad0-8337-fcadd9d6895d tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Volume f4233b2f-ddf5-4238-a6fb-6290ec975f46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4233b2f-ddf5-4238-a6fb-6290ec975f46', 'volume_size': 1} Jul 08 02:04:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6dee8bc4-e5b2-4ad0-8337-fcadd9d6895d tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:04:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6dee8bc4-e5b2-4ad0-8337-fcadd9d6895d tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:04:15 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-6dee8bc4-e5b2-4ad0-8337-fcadd9d6895d tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-891880977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4233b2f-ddf5-4238-a6fb-6290ec975f46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2cadb800e474072a5fbcf41df9c4c00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:04:15Z,use_quota=True,user_id='e04003fe878b4e6b8766372ced58f07c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:04:15 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-6dee8bc4-e5b2-4ad0-8337-fcadd9d6895d tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Creating volume f4233b2f-ddf5-4238-a6fb-6290ec975f46 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:04:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6dee8bc4-e5b2-4ad0-8337-fcadd9d6895d tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:04:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6dee8bc4-e5b2-4ad0-8337-fcadd9d6895d tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:04:15 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-6dee8bc4-e5b2-4ad0-8337-fcadd9d6895d tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:04:15 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-6dee8bc4-e5b2-4ad0-8337-fcadd9d6895d tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:04:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6dee8bc4-e5b2-4ad0-8337-fcadd9d6895d tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:04:15 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-6dee8bc4-e5b2-4ad0-8337-fcadd9d6895d tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:04:15 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-6dee8bc4-e5b2-4ad0-8337-fcadd9d6895d tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 02:04:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6dee8bc4-e5b2-4ad0-8337-fcadd9d6895d tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f4233b2f-ddf5-4238-a6fb-6290ec975f46 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:15 devstack sudo[105838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f4233b2f-ddf5-4238-a6fb-6290ec975f46 1073741824 Jul 08 02:04:15 devstack sudo[105838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:15 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-b903a511-7321-4abb-a142-42d30262207c tempest-CreateVolumesFromImageTest-193126103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:04:15 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b903a511-7321-4abb-a142-42d30262207c tempest-CreateVolumesFromImageTest-193126103 None] Flow 'volume_create_manager' (6bca0624-536c-4713-a9e6-51312ec99b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:04:15 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b903a511-7321-4abb-a142-42d30262207c tempest-CreateVolumesFromImageTest-193126103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d93814e-6763-4f7a-943e-6f4c3a405f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:15 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b903a511-7321-4abb-a142-42d30262207c tempest-CreateVolumesFromImageTest-193126103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d93814e-6763-4f7a-943e-6f4c3a405f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-229541086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fada77a-d414-433b-aba4-7d9b493c9990,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c005ff5e9e8427588cb11cec0b726e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:04:15Z,use_quota=True,user_id='19a305fe78734a838ffd0c5725a3460b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:15 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b903a511-7321-4abb-a142-42d30262207c tempest-CreateVolumesFromImageTest-193126103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89ef7a76-0802-4dd5-a25e-ea71f9ba8cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:15 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b903a511-7321-4abb-a142-42d30262207c tempest-CreateVolumesFromImageTest-193126103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89ef7a76-0802-4dd5-a25e-ea71f9ba8cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:15 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b903a511-7321-4abb-a142-42d30262207c tempest-CreateVolumesFromImageTest-193126103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1dc9f55-f4b2-4c61-b908-28660d4f08aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:15 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b903a511-7321-4abb-a142-42d30262207c tempest-CreateVolumesFromImageTest-193126103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1dc9f55-f4b2-4c61-b908-28660d4f08aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fada77a-d414-433b-aba4-7d9b493c9990', 'volume_name': 'volume-7fada77a-d414-433b-aba4-7d9b493c9990', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:15 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b903a511-7321-4abb-a142-42d30262207c tempest-CreateVolumesFromImageTest-193126103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e6ee69f-008f-4e1d-a5d2-3254d1d96ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:15 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b903a511-7321-4abb-a142-42d30262207c tempest-CreateVolumesFromImageTest-193126103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e6ee69f-008f-4e1d-a5d2-3254d1d96ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:15 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b903a511-7321-4abb-a142-42d30262207c tempest-CreateVolumesFromImageTest-193126103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dbaefa6-7f9c-4fd5-be93-00d8bf90071a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:15 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-b903a511-7321-4abb-a142-42d30262207c tempest-CreateVolumesFromImageTest-193126103 None] Volume 7fada77a-d414-433b-aba4-7d9b493c9990: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fada77a-d414-433b-aba4-7d9b493c9990', 'volume_size': 1} Jul 08 02:04:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b903a511-7321-4abb-a142-42d30262207c tempest-CreateVolumesFromImageTest-193126103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:04:15 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-a23d02c5-2476-437c-9b53-678ea869164c tempest-CreateVolumesFromImageTest-193126103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:04:15 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-a23d02c5-2476-437c-9b53-678ea869164c tempest-CreateVolumesFromImageTest-193126103 None] Flow 'volume_create_manager' (6601c2de-f406-4afa-91be-348ce03615b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:04:15 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-a23d02c5-2476-437c-9b53-678ea869164c tempest-CreateVolumesFromImageTest-193126103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (180e6e1a-ade8-421a-a16e-9e38b4c78af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:16 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-a23d02c5-2476-437c-9b53-678ea869164c tempest-CreateVolumesFromImageTest-193126103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (180e6e1a-ade8-421a-a16e-9e38b4c78af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-884872118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b444f07-ebc6-4177-bd19-96152dc849a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c005ff5e9e8427588cb11cec0b726e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:04:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:04:16Z,use_quota=True,user_id='19a305fe78734a838ffd0c5725a3460b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:16 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-a23d02c5-2476-437c-9b53-678ea869164c tempest-CreateVolumesFromImageTest-193126103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0b78352-b94b-40a7-823a-fa1800050c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:16 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-a23d02c5-2476-437c-9b53-678ea869164c tempest-CreateVolumesFromImageTest-193126103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0b78352-b94b-40a7-823a-fa1800050c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:16 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-a23d02c5-2476-437c-9b53-678ea869164c tempest-CreateVolumesFromImageTest-193126103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a50eaa2-ab64-4144-a1af-6f91e4362f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:16 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-a23d02c5-2476-437c-9b53-678ea869164c tempest-CreateVolumesFromImageTest-193126103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a50eaa2-ab64-4144-a1af-6f91e4362f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b444f07-ebc6-4177-bd19-96152dc849a7', 'volume_name': 'volume-6b444f07-ebc6-4177-bd19-96152dc849a7', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:16 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-a23d02c5-2476-437c-9b53-678ea869164c tempest-CreateVolumesFromImageTest-193126103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33e411f3-f943-4439-8b84-793c04d7ff09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:16 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-a23d02c5-2476-437c-9b53-678ea869164c tempest-CreateVolumesFromImageTest-193126103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33e411f3-f943-4439-8b84-793c04d7ff09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:16 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-a23d02c5-2476-437c-9b53-678ea869164c tempest-CreateVolumesFromImageTest-193126103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b01eaad0-517b-4a5e-8105-9001e8aef5b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:16 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-a23d02c5-2476-437c-9b53-678ea869164c tempest-CreateVolumesFromImageTest-193126103 None] Volume 6b444f07-ebc6-4177-bd19-96152dc849a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b444f07-ebc6-4177-bd19-96152dc849a7', 'volume_size': 1} Jul 08 02:04:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-a23d02c5-2476-437c-9b53-678ea869164c tempest-CreateVolumesFromImageTest-193126103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:04:16 devstack sudo[105838]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6dee8bc4-e5b2-4ad0-8337-fcadd9d6895d tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f4233b2f-ddf5-4238-a6fb-6290ec975f46 1073741824" returned: 0 in 1.294s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6dee8bc4-e5b2-4ad0-8337-fcadd9d6895d tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f4233b2f-ddf5-4238-a6fb-6290ec975f46 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:16 devstack sudo[105844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f4233b2f-ddf5-4238-a6fb-6290ec975f46 Jul 08 02:04:16 devstack sudo[105844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:16 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-81251c41-85f0-452c-b459-fd98e2c7bae5 tempest-CreateVolumesFromImageTest-193126103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:04:16 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-81251c41-85f0-452c-b459-fd98e2c7bae5 tempest-CreateVolumesFromImageTest-193126103 None] Flow 'volume_create_manager' (fd4902f6-2501-4790-bf24-8490d71be412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:04:16 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-81251c41-85f0-452c-b459-fd98e2c7bae5 tempest-CreateVolumesFromImageTest-193126103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecfaaf1e-8a89-4dd2-88e1-361815da3e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:16 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-81251c41-85f0-452c-b459-fd98e2c7bae5 tempest-CreateVolumesFromImageTest-193126103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecfaaf1e-8a89-4dd2-88e1-361815da3e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:04:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1662084347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66d77387-4f36-44bf-8f76-0b33d163a047,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c005ff5e9e8427588cb11cec0b726e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:04:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:04:16Z,use_quota=True,user_id='19a305fe78734a838ffd0c5725a3460b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:16 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-81251c41-85f0-452c-b459-fd98e2c7bae5 tempest-CreateVolumesFromImageTest-193126103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4cb24cd-5bd0-430e-b533-9fb1aa114280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:16 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-81251c41-85f0-452c-b459-fd98e2c7bae5 tempest-CreateVolumesFromImageTest-193126103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4cb24cd-5bd0-430e-b533-9fb1aa114280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:16 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-81251c41-85f0-452c-b459-fd98e2c7bae5 tempest-CreateVolumesFromImageTest-193126103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e03692e8-9cd9-423d-af81-ec191bfc5c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:16 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-81251c41-85f0-452c-b459-fd98e2c7bae5 tempest-CreateVolumesFromImageTest-193126103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e03692e8-9cd9-423d-af81-ec191bfc5c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66d77387-4f36-44bf-8f76-0b33d163a047', 'volume_name': 'volume-66d77387-4f36-44bf-8f76-0b33d163a047', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:16 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-81251c41-85f0-452c-b459-fd98e2c7bae5 tempest-CreateVolumesFromImageTest-193126103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22119a04-9881-45bd-8abb-cda7c976c9a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:16 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-81251c41-85f0-452c-b459-fd98e2c7bae5 tempest-CreateVolumesFromImageTest-193126103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22119a04-9881-45bd-8abb-cda7c976c9a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:16 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-81251c41-85f0-452c-b459-fd98e2c7bae5 tempest-CreateVolumesFromImageTest-193126103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eee01a88-596c-4b3b-af24-5296ead1a463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:16 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-81251c41-85f0-452c-b459-fd98e2c7bae5 tempest-CreateVolumesFromImageTest-193126103 None] Volume 66d77387-4f36-44bf-8f76-0b33d163a047: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66d77387-4f36-44bf-8f76-0b33d163a047', 'volume_size': 1} Jul 08 02:04:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-81251c41-85f0-452c-b459-fd98e2c7bae5 tempest-CreateVolumesFromImageTest-193126103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:04:17 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5d5b763-b269-407d-b36b-14b0350e5f19 tempest-CreateVolumesFromImageTest-193126103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:04:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b5d5b763-b269-407d-b36b-14b0350e5f19 tempest-CreateVolumesFromImageTest-193126103 None] Flow 'volume_create_manager' (9849ff61-1859-4a83-a5ea-c3616ba28c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:04:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b5d5b763-b269-407d-b36b-14b0350e5f19 tempest-CreateVolumesFromImageTest-193126103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (530ef87f-291a-4cf5-8ff0-58d1c95baaaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b5d5b763-b269-407d-b36b-14b0350e5f19 tempest-CreateVolumesFromImageTest-193126103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (530ef87f-291a-4cf5-8ff0-58d1c95baaaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:04:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-605455382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7c5ff12-877f-4c02-9470-51b005f7a4d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c005ff5e9e8427588cb11cec0b726e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:04:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:04:17Z,use_quota=True,user_id='19a305fe78734a838ffd0c5725a3460b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b5d5b763-b269-407d-b36b-14b0350e5f19 tempest-CreateVolumesFromImageTest-193126103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24b1c616-d5d6-4af1-9669-8591e230e9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b5d5b763-b269-407d-b36b-14b0350e5f19 tempest-CreateVolumesFromImageTest-193126103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24b1c616-d5d6-4af1-9669-8591e230e9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b5d5b763-b269-407d-b36b-14b0350e5f19 tempest-CreateVolumesFromImageTest-193126103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dfc3bf2-cad4-4aea-8632-d9782c21c55c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b5d5b763-b269-407d-b36b-14b0350e5f19 tempest-CreateVolumesFromImageTest-193126103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dfc3bf2-cad4-4aea-8632-d9782c21c55c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7c5ff12-877f-4c02-9470-51b005f7a4d5', 'volume_name': 'volume-f7c5ff12-877f-4c02-9470-51b005f7a4d5', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b5d5b763-b269-407d-b36b-14b0350e5f19 tempest-CreateVolumesFromImageTest-193126103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (700c8c56-34af-4e60-a625-c86b8ce172b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b5d5b763-b269-407d-b36b-14b0350e5f19 tempest-CreateVolumesFromImageTest-193126103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (700c8c56-34af-4e60-a625-c86b8ce172b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b5d5b763-b269-407d-b36b-14b0350e5f19 tempest-CreateVolumesFromImageTest-193126103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f28c195f-edfe-41fd-b119-eeba2dcf5799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:17 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-b5d5b763-b269-407d-b36b-14b0350e5f19 tempest-CreateVolumesFromImageTest-193126103 None] Volume f7c5ff12-877f-4c02-9470-51b005f7a4d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7c5ff12-877f-4c02-9470-51b005f7a4d5', 'volume_size': 1} Jul 08 02:04:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b5d5b763-b269-407d-b36b-14b0350e5f19 tempest-CreateVolumesFromImageTest-193126103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:04:17 devstack sudo[105844]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6dee8bc4-e5b2-4ad0-8337-fcadd9d6895d tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f4233b2f-ddf5-4238-a6fb-6290ec975f46" returned: 0 in 0.955s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:17 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-6dee8bc4-e5b2-4ad0-8337-fcadd9d6895d tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] <== create_volume: return (2322ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:04:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6dee8bc4-e5b2-4ad0-8337-fcadd9d6895d tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.326s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:04:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b903a511-7321-4abb-a142-42d30262207c tempest-CreateVolumesFromImageTest-193126103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.760s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:04:17 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-b903a511-7321-4abb-a142-42d30262207c tempest-CreateVolumesFromImageTest-193126103 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-229541086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fada77a-d414-433b-aba4-7d9b493c9990,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c005ff5e9e8427588cb11cec0b726e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:04:15Z,use_quota=True,user_id='19a305fe78734a838ffd0c5725a3460b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:04:17 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-b903a511-7321-4abb-a142-42d30262207c tempest-CreateVolumesFromImageTest-193126103 None] Creating volume 7fada77a-d414-433b-aba4-7d9b493c9990 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:04:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b903a511-7321-4abb-a142-42d30262207c tempest-CreateVolumesFromImageTest-193126103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:04:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b903a511-7321-4abb-a142-42d30262207c tempest-CreateVolumesFromImageTest-193126103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:04:17 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-b903a511-7321-4abb-a142-42d30262207c tempest-CreateVolumesFromImageTest-193126103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:04:17 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-b903a511-7321-4abb-a142-42d30262207c tempest-CreateVolumesFromImageTest-193126103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:04:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b903a511-7321-4abb-a142-42d30262207c tempest-CreateVolumesFromImageTest-193126103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:04:17 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-b903a511-7321-4abb-a142-42d30262207c tempest-CreateVolumesFromImageTest-193126103 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:04:17 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-b903a511-7321-4abb-a142-42d30262207c tempest-CreateVolumesFromImageTest-193126103 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 02:04:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b903a511-7321-4abb-a142-42d30262207c tempest-CreateVolumesFromImageTest-193126103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7fada77a-d414-433b-aba4-7d9b493c9990 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:17 devstack sudo[105847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7fada77a-d414-433b-aba4-7d9b493c9990 1073741824 Jul 08 02:04:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6dee8bc4-e5b2-4ad0-8337-fcadd9d6895d tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5b68dd5-afff-4c7d-918b-b61c0d36b97b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4233b2f-ddf5-4238-a6fb-6290ec975f46', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:17 devstack sudo[105847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6dee8bc4-e5b2-4ad0-8337-fcadd9d6895d tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e02c050-ec4e-49c7-9d07-4c735b073214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:17 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-6dee8bc4-e5b2-4ad0-8337-fcadd9d6895d tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Volume volume-f4233b2f-ddf5-4238-a6fb-6290ec975f46 (f4233b2f-ddf5-4238-a6fb-6290ec975f46): created successfully Jul 08 02:04:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6dee8bc4-e5b2-4ad0-8337-fcadd9d6895d tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e02c050-ec4e-49c7-9d07-4c735b073214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6dee8bc4-e5b2-4ad0-8337-fcadd9d6895d tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Flow 'volume_create_manager' (43442425-d8e4-4790-a494-7c4521359c4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:04:17 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-6dee8bc4-e5b2-4ad0-8337-fcadd9d6895d tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Created volume successfully. Jul 08 02:04:17 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-455b94cd-1573-48fc-bac2-247e34f567cc tempest-CreateVolumesFromImageTest-193126103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:04:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-455b94cd-1573-48fc-bac2-247e34f567cc tempest-CreateVolumesFromImageTest-193126103 None] Flow 'volume_create_manager' (dcff61f0-ee45-4d3e-b0cb-05319f6ed9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:04:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-455b94cd-1573-48fc-bac2-247e34f567cc tempest-CreateVolumesFromImageTest-193126103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d418d74-682b-4baa-9ecd-cabd8adb53f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-455b94cd-1573-48fc-bac2-247e34f567cc tempest-CreateVolumesFromImageTest-193126103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d418d74-682b-4baa-9ecd-cabd8adb53f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:04:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1627657358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e278ac8b-1235-4e7e-8d69-8a291b8e41df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c005ff5e9e8427588cb11cec0b726e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:04:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:04:18Z,use_quota=True,user_id='19a305fe78734a838ffd0c5725a3460b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-455b94cd-1573-48fc-bac2-247e34f567cc tempest-CreateVolumesFromImageTest-193126103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40ce99d1-5e3a-4cbf-821a-c8a40545cf70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-455b94cd-1573-48fc-bac2-247e34f567cc tempest-CreateVolumesFromImageTest-193126103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40ce99d1-5e3a-4cbf-821a-c8a40545cf70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-455b94cd-1573-48fc-bac2-247e34f567cc tempest-CreateVolumesFromImageTest-193126103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b147860-75ec-48f3-a1c1-941d1adbf754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-455b94cd-1573-48fc-bac2-247e34f567cc tempest-CreateVolumesFromImageTest-193126103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b147860-75ec-48f3-a1c1-941d1adbf754) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e278ac8b-1235-4e7e-8d69-8a291b8e41df', 'volume_name': 'volume-e278ac8b-1235-4e7e-8d69-8a291b8e41df', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-455b94cd-1573-48fc-bac2-247e34f567cc tempest-CreateVolumesFromImageTest-193126103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24191501-a7b9-4c00-86e9-41e5337a2ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-455b94cd-1573-48fc-bac2-247e34f567cc tempest-CreateVolumesFromImageTest-193126103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24191501-a7b9-4c00-86e9-41e5337a2ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-455b94cd-1573-48fc-bac2-247e34f567cc tempest-CreateVolumesFromImageTest-193126103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (737e7e9b-77ad-451e-9d9b-2725c1336447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:17 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-455b94cd-1573-48fc-bac2-247e34f567cc tempest-CreateVolumesFromImageTest-193126103 None] Volume e278ac8b-1235-4e7e-8d69-8a291b8e41df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e278ac8b-1235-4e7e-8d69-8a291b8e41df', 'volume_size': 1} Jul 08 02:04:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-455b94cd-1573-48fc-bac2-247e34f567cc tempest-CreateVolumesFromImageTest-193126103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:04:18 devstack sudo[105847]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b903a511-7321-4abb-a142-42d30262207c tempest-CreateVolumesFromImageTest-193126103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7fada77a-d414-433b-aba4-7d9b493c9990 1073741824" returned: 0 in 1.260s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b903a511-7321-4abb-a142-42d30262207c tempest-CreateVolumesFromImageTest-193126103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7fada77a-d414-433b-aba4-7d9b493c9990 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:18 devstack sudo[105853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7fada77a-d414-433b-aba4-7d9b493c9990 Jul 08 02:04:18 devstack sudo[105853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:19 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b740b81-a9a5-4889-971f-950cfec156b2 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:04:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5b740b81-a9a5-4889-971f-950cfec156b2 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Flow 'volume_create_manager' (5d14db6c-7486-4bbd-9ffc-2b09c690bc19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:04:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5b740b81-a9a5-4889-971f-950cfec156b2 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e01045c-6fa4-4454-a201-08d092ffa85c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5b740b81-a9a5-4889-971f-950cfec156b2 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e01045c-6fa4-4454-a201-08d092ffa85c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:04:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1947744386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a3bf812-e904-426d-92c4-4fdd3d65f702,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2cadb800e474072a5fbcf41df9c4c00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:04:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:04:19Z,use_quota=True,user_id='e04003fe878b4e6b8766372ced58f07c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5b740b81-a9a5-4889-971f-950cfec156b2 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c7f94e5-688f-4615-aeef-db08afbfe203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5b740b81-a9a5-4889-971f-950cfec156b2 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c7f94e5-688f-4615-aeef-db08afbfe203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5b740b81-a9a5-4889-971f-950cfec156b2 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3735867f-74da-4abd-b0fd-0058bd6a5e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5b740b81-a9a5-4889-971f-950cfec156b2 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3735867f-74da-4abd-b0fd-0058bd6a5e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a3bf812-e904-426d-92c4-4fdd3d65f702', 'volume_name': 'volume-2a3bf812-e904-426d-92c4-4fdd3d65f702', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5b740b81-a9a5-4889-971f-950cfec156b2 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7992b17-3184-473d-a712-3cd2ab215bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5b740b81-a9a5-4889-971f-950cfec156b2 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7992b17-3184-473d-a712-3cd2ab215bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5b740b81-a9a5-4889-971f-950cfec156b2 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (790a6e30-098b-45f3-b7ee-2f144d027456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:19 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-5b740b81-a9a5-4889-971f-950cfec156b2 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Volume 2a3bf812-e904-426d-92c4-4fdd3d65f702: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a3bf812-e904-426d-92c4-4fdd3d65f702', 'volume_size': 1} Jul 08 02:04:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5b740b81-a9a5-4889-971f-950cfec156b2 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:04:19 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6181d64-9296-407e-99a4-b87257296450 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:04:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c6181d64-9296-407e-99a4-b87257296450 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Flow 'volume_create_manager' (26d8c6ee-80f7-41c6-9fa1-6037473f7511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:04:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c6181d64-9296-407e-99a4-b87257296450 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b22a1be-78e5-45f6-9474-32ca2b097920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c6181d64-9296-407e-99a4-b87257296450 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b22a1be-78e5-45f6-9474-32ca2b097920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:04:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1528323275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ded5792-df72-4160-89c4-4837a5e2f0b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2cadb800e474072a5fbcf41df9c4c00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:04:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:04:20Z,use_quota=True,user_id='e04003fe878b4e6b8766372ced58f07c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c6181d64-9296-407e-99a4-b87257296450 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aadfc17f-42ca-45af-a0a5-410339666c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c6181d64-9296-407e-99a4-b87257296450 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aadfc17f-42ca-45af-a0a5-410339666c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c6181d64-9296-407e-99a4-b87257296450 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a18e95c0-b9a9-469b-9bd6-2984de03f926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c6181d64-9296-407e-99a4-b87257296450 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a18e95c0-b9a9-469b-9bd6-2984de03f926) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ded5792-df72-4160-89c4-4837a5e2f0b0', 'volume_name': 'volume-1ded5792-df72-4160-89c4-4837a5e2f0b0', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c6181d64-9296-407e-99a4-b87257296450 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f227fc0-da8e-4cdd-9c4d-3260fb789728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c6181d64-9296-407e-99a4-b87257296450 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f227fc0-da8e-4cdd-9c4d-3260fb789728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c6181d64-9296-407e-99a4-b87257296450 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad267b9a-b569-4e75-af41-08d4e3ac4ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:19 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-c6181d64-9296-407e-99a4-b87257296450 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Volume 1ded5792-df72-4160-89c4-4837a5e2f0b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ded5792-df72-4160-89c4-4837a5e2f0b0', 'volume_size': 1} Jul 08 02:04:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c6181d64-9296-407e-99a4-b87257296450 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:04:19 devstack sudo[105853]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b903a511-7321-4abb-a142-42d30262207c tempest-CreateVolumesFromImageTest-193126103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7fada77a-d414-433b-aba4-7d9b493c9990" returned: 0 in 1.178s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:19 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-b903a511-7321-4abb-a142-42d30262207c tempest-CreateVolumesFromImageTest-193126103 None] <== create_volume: return (2505ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:04:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b903a511-7321-4abb-a142-42d30262207c tempest-CreateVolumesFromImageTest-193126103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.511s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:04:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-a23d02c5-2476-437c-9b53-678ea869164c tempest-CreateVolumesFromImageTest-193126103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.884s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:04:19 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-a23d02c5-2476-437c-9b53-678ea869164c tempest-CreateVolumesFromImageTest-193126103 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-884872118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b444f07-ebc6-4177-bd19-96152dc849a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c005ff5e9e8427588cb11cec0b726e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:04:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:04:16Z,use_quota=True,user_id='19a305fe78734a838ffd0c5725a3460b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:04:19 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-a23d02c5-2476-437c-9b53-678ea869164c tempest-CreateVolumesFromImageTest-193126103 None] Creating volume 6b444f07-ebc6-4177-bd19-96152dc849a7 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:04:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-a23d02c5-2476-437c-9b53-678ea869164c tempest-CreateVolumesFromImageTest-193126103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:04:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-a23d02c5-2476-437c-9b53-678ea869164c tempest-CreateVolumesFromImageTest-193126103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:04:19 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-a23d02c5-2476-437c-9b53-678ea869164c tempest-CreateVolumesFromImageTest-193126103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:04:19 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-a23d02c5-2476-437c-9b53-678ea869164c tempest-CreateVolumesFromImageTest-193126103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:04:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-a23d02c5-2476-437c-9b53-678ea869164c tempest-CreateVolumesFromImageTest-193126103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:04:19 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-a23d02c5-2476-437c-9b53-678ea869164c tempest-CreateVolumesFromImageTest-193126103 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:04:19 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-a23d02c5-2476-437c-9b53-678ea869164c tempest-CreateVolumesFromImageTest-193126103 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 02:04:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a23d02c5-2476-437c-9b53-678ea869164c tempest-CreateVolumesFromImageTest-193126103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-6b444f07-ebc6-4177-bd19-96152dc849a7 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b903a511-7321-4abb-a142-42d30262207c tempest-CreateVolumesFromImageTest-193126103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dbaefa6-7f9c-4fd5-be93-00d8bf90071a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fada77a-d414-433b-aba4-7d9b493c9990', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:19 devstack sudo[105856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-6b444f07-ebc6-4177-bd19-96152dc849a7 1073741824 Jul 08 02:04:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b903a511-7321-4abb-a142-42d30262207c tempest-CreateVolumesFromImageTest-193126103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd68f417-220e-4e67-b956-a8452cb0db33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:19 devstack sudo[105856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:20 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-b903a511-7321-4abb-a142-42d30262207c tempest-CreateVolumesFromImageTest-193126103 None] Volume volume-7fada77a-d414-433b-aba4-7d9b493c9990 (7fada77a-d414-433b-aba4-7d9b493c9990): created successfully Jul 08 02:04:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b903a511-7321-4abb-a142-42d30262207c tempest-CreateVolumesFromImageTest-193126103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd68f417-220e-4e67-b956-a8452cb0db33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b903a511-7321-4abb-a142-42d30262207c tempest-CreateVolumesFromImageTest-193126103 None] Flow 'volume_create_manager' (6bca0624-536c-4713-a9e6-51312ec99b8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:04:20 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-b903a511-7321-4abb-a142-42d30262207c tempest-CreateVolumesFromImageTest-193126103 None] Created volume successfully. Jul 08 02:04:20 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c94e279-1fc4-44ac-8965-1236a61b2f6b tempest-VolumeImageDependencyTests-2073805245 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:04:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-2c94e279-1fc4-44ac-8965-1236a61b2f6b tempest-VolumeImageDependencyTests-2073805245 None] Flow 'volume_create_manager' (2fcca2d3-da6e-4e77-b972-d722fea11ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:04:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-2c94e279-1fc4-44ac-8965-1236a61b2f6b tempest-VolumeImageDependencyTests-2073805245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d637ff4-3a4f-4de5-ad52-4709960f6214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-2c94e279-1fc4-44ac-8965-1236a61b2f6b tempest-VolumeImageDependencyTests-2073805245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d637ff4-3a4f-4de5-ad52-4709960f6214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:04:19Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c72c0d9-253c-4db7-8255-3874f51e6c3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='486b39d7801645518f19c8d6aa5fc1ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:04:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:04:20Z,use_quota=True,user_id='2c8af564cbde434aa6b1595e1e36da33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-2c94e279-1fc4-44ac-8965-1236a61b2f6b tempest-VolumeImageDependencyTests-2073805245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e7c65a6-116b-408d-b2a0-341d60251bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-2c94e279-1fc4-44ac-8965-1236a61b2f6b tempest-VolumeImageDependencyTests-2073805245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e7c65a6-116b-408d-b2a0-341d60251bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-2c94e279-1fc4-44ac-8965-1236a61b2f6b tempest-VolumeImageDependencyTests-2073805245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89e88a11-eee9-4356-9319-bdf8fbdb8f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:20 devstack cinder-volume[87134]: DEBUG cinder.image.glance [None req-2c94e279-1fc4-44ac-8965-1236a61b2f6b tempest-VolumeImageDependencyTests-2073805245 None] Creating Keystone auth plugin from conf {{(pid=87134) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 02:04:20 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d8b93a9-64d4-4408-a9cc-2a7d542868af tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:04:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-2d8b93a9-64d4-4408-a9cc-2a7d542868af tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Flow 'volume_create_manager' (6bbe0a79-92f5-4cc1-ba2f-72f87c137daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:04:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-2d8b93a9-64d4-4408-a9cc-2a7d542868af tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc89f100-ac6c-4bb4-88fd-9b18779e3db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-2d8b93a9-64d4-4408-a9cc-2a7d542868af tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc89f100-ac6c-4bb4-88fd-9b18779e3db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:04:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-778547538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aaca542-90b7-4b2a-9fcf-b49cd0572052,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2cadb800e474072a5fbcf41df9c4c00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:04:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:04:20Z,use_quota=True,user_id='e04003fe878b4e6b8766372ced58f07c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-2d8b93a9-64d4-4408-a9cc-2a7d542868af tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaa8850c-823b-4dca-b205-006cd9d1f1e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-2d8b93a9-64d4-4408-a9cc-2a7d542868af tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaa8850c-823b-4dca-b205-006cd9d1f1e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-2d8b93a9-64d4-4408-a9cc-2a7d542868af tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24d2994b-31e3-4d4b-b72b-6ce3e5d720a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-2d8b93a9-64d4-4408-a9cc-2a7d542868af tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24d2994b-31e3-4d4b-b72b-6ce3e5d720a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1aaca542-90b7-4b2a-9fcf-b49cd0572052', 'volume_name': 'volume-1aaca542-90b7-4b2a-9fcf-b49cd0572052', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-2d8b93a9-64d4-4408-a9cc-2a7d542868af tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12d834e1-50ef-479e-8d1d-08df4e51d1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-2d8b93a9-64d4-4408-a9cc-2a7d542868af tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12d834e1-50ef-479e-8d1d-08df4e51d1f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-2d8b93a9-64d4-4408-a9cc-2a7d542868af tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbd6e39f-5f7e-426d-b647-bb2176495689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:20 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-2d8b93a9-64d4-4408-a9cc-2a7d542868af tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Volume 1aaca542-90b7-4b2a-9fcf-b49cd0572052: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1aaca542-90b7-4b2a-9fcf-b49cd0572052', 'volume_size': 1} Jul 08 02:04:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-2d8b93a9-64d4-4408-a9cc-2a7d542868af tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:04:20 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-92409692-02fa-4a5a-a137-f7f464136866 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:04:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-92409692-02fa-4a5a-a137-f7f464136866 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Flow 'volume_create_manager' (7021b694-a387-45ed-ac03-0d6e7a588fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:04:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-92409692-02fa-4a5a-a137-f7f464136866 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cf263bf-f587-4ad8-9cb2-e3ef875aae7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-92409692-02fa-4a5a-a137-f7f464136866 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cf263bf-f587-4ad8-9cb2-e3ef875aae7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:04:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1741325671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5926707-7997-4d96-ace6-336caedc1e29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2cadb800e474072a5fbcf41df9c4c00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:04:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:04:21Z,use_quota=True,user_id='e04003fe878b4e6b8766372ced58f07c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-92409692-02fa-4a5a-a137-f7f464136866 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7a33b8f-b769-4ec4-b8e2-e2c470820b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-92409692-02fa-4a5a-a137-f7f464136866 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7a33b8f-b769-4ec4-b8e2-e2c470820b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-92409692-02fa-4a5a-a137-f7f464136866 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7391775b-8d06-48cb-a84f-006d6780da7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-92409692-02fa-4a5a-a137-f7f464136866 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7391775b-8d06-48cb-a84f-006d6780da7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5926707-7997-4d96-ace6-336caedc1e29', 'volume_name': 'volume-e5926707-7997-4d96-ace6-336caedc1e29', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-92409692-02fa-4a5a-a137-f7f464136866 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1f33031-e5be-4b69-9744-87bebc47bb6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-92409692-02fa-4a5a-a137-f7f464136866 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1f33031-e5be-4b69-9744-87bebc47bb6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-92409692-02fa-4a5a-a137-f7f464136866 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aa0e291-09a6-4c7c-931c-8b83a34a6942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:20 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-92409692-02fa-4a5a-a137-f7f464136866 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Volume e5926707-7997-4d96-ace6-336caedc1e29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5926707-7997-4d96-ace6-336caedc1e29', 'volume_size': 1} Jul 08 02:04:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-92409692-02fa-4a5a-a137-f7f464136866 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:04:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-2c94e279-1fc4-44ac-8965-1236a61b2f6b tempest-VolumeImageDependencyTests-2073805245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89e88a11-eee9-4356-9319-bdf8fbdb8f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3c72c0d9-253c-4db7-8255-3874f51e6c3d', 'volume_name': 'volume-3c72c0d9-253c-4db7-8255-3874f51e6c3d', 'volume_size': 1, 'image_id': '7acfc39f-06af-4d17-8e9e-f8f8dadb6f5f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7acfc39f-06af-4d17-8e9e-f8f8dadb6f5f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '399c8bf3f3de985a0ad4e0c984f394e1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '486b39d7801645518f19c8d6aa5fc1ad', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e0fd5c2da6234ae70ac6db6e7e2f7886301b516825780b40105dd88b9e9bab012d58afe068dfd56f5f4879df81124be91f765d9354cb77d9ce6cc18e8bdab632', 'id': '7acfc39f-06af-4d17-8e9e-f8f8dadb6f5f', 'created_at': datetime.datetime(2026, 7, 8, 0, 4, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 0, 4, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7acfc39f-06af-4d17-8e9e-f8f8dadb6f5f/file', 'properties': {}}, 'image_service': }' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-2c94e279-1fc4-44ac-8965-1236a61b2f6b tempest-VolumeImageDependencyTests-2073805245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5c2f57e-b644-49df-8144-e9c91640d14b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-2c94e279-1fc4-44ac-8965-1236a61b2f6b tempest-VolumeImageDependencyTests-2073805245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5c2f57e-b644-49df-8144-e9c91640d14b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-2c94e279-1fc4-44ac-8965-1236a61b2f6b tempest-VolumeImageDependencyTests-2073805245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27bed7d8-b63e-40f3-a8a2-9a83f688e3ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:20 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-2c94e279-1fc4-44ac-8965-1236a61b2f6b tempest-VolumeImageDependencyTests-2073805245 None] Volume 3c72c0d9-253c-4db7-8255-3874f51e6c3d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3c72c0d9-253c-4db7-8255-3874f51e6c3d', 'volume_size': 1, 'image_id': '7acfc39f-06af-4d17-8e9e-f8f8dadb6f5f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7acfc39f-06af-4d17-8e9e-f8f8dadb6f5f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '399c8bf3f3de985a0ad4e0c984f394e1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '486b39d7801645518f19c8d6aa5fc1ad', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e0fd5c2da6234ae70ac6db6e7e2f7886301b516825780b40105dd88b9e9bab012d58afe068dfd56f5f4879df81124be91f765d9354cb77d9ce6cc18e8bdab632', 'id': '7acfc39f-06af-4d17-8e9e-f8f8dadb6f5f', 'created_at': datetime.datetime(2026, 7, 8, 0, 4, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 0, 4, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7acfc39f-06af-4d17-8e9e-f8f8dadb6f5f/file', 'properties': {}}, 'image_service': } Jul 08 02:04:20 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c94e279-1fc4-44ac-8965-1236a61b2f6b tempest-VolumeImageDependencyTests-2073805245 None] Trying to clone 3c72c0d9-253c-4db7-8255-3874f51e6c3d from image 7acfc39f-06af-4d17-8e9e-f8f8dadb6f5f at location (None, [{'url': 'file:///opt/stack/data/glance/images/7acfc39f-06af-4d17-8e9e-f8f8dadb6f5f', 'metadata': {}}]). {{(pid=87134) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 02:04:20 devstack cinder-volume[87134]: DEBUG oslo_service.periodic_task [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87134) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 02:04:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:04:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:04:20 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:04:20 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:04:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:04:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:21 devstack sudo[105863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 02:04:21 devstack sudo[105863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:21 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-32f069d6-6bc3-4709-b768-aba491f5f164 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:04:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-32f069d6-6bc3-4709-b768-aba491f5f164 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] Flow 'volume_create_manager' (e9d99d3e-ef0f-4d74-ac3d-4576fa951a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:04:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-32f069d6-6bc3-4709-b768-aba491f5f164 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72950535-4f12-4292-915b-4f8d324f0764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:21 devstack cinder-volume[87134]: DEBUG cinder.image.image_utils [None req-2c94e279-1fc4-44ac-8965-1236a61b2f6b tempest-VolumeImageDependencyTests-2073805245 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7acfc39f-06af-4d17-8e9e-f8f8dadb6f5f_5jk2ejq9devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87134) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 02:04:21 devstack cinder-volume[87134]: INFO cinder.image.image_utils [None req-2c94e279-1fc4-44ac-8965-1236a61b2f6b tempest-VolumeImageDependencyTests-2073805245 None] Image download 0.00 MB at 0.00 MB/s Jul 08 02:04:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-32f069d6-6bc3-4709-b768-aba491f5f164 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72950535-4f12-4292-915b-4f8d324f0764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:04:20Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2fce024-0a9f-40bf-97a0-8f974fbb43de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79e3c1a92b214f009b68e2e92edd2d2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:04:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:04:21Z,use_quota=True,user_id='dc398523bb684249a7b24e3fdbba43d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e05ea9cb-bafb-4c65-875f-9bc810c3cb0e),volume_type_id=e05ea9cb-bafb-4c65-875f-9bc810c3cb0e)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-32f069d6-6bc3-4709-b768-aba491f5f164 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00824221-611f-4a73-8523-cc74b1821550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-32f069d6-6bc3-4709-b768-aba491f5f164 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00824221-611f-4a73-8523-cc74b1821550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-32f069d6-6bc3-4709-b768-aba491f5f164 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (646b7972-7b13-44ac-953a-7f63906c80e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:21 devstack cinder-volume[87134]: DEBUG cinder.image.glance [None req-32f069d6-6bc3-4709-b768-aba491f5f164 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] Creating Keystone auth plugin from conf {{(pid=87134) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 02:04:21 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cea4a0b-26b0-478c-a9c9-809fbabeb785]: (4, 'raw') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:04:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2c94e279-1fc4-44ac-8965-1236a61b2f6b tempest-VolumeImageDependencyTests-2073805245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7acfc39f-06af-4d17-8e9e-f8f8dadb6f5f_5jk2ejq9devstack@QuobyteHD {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:21 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fe3089c-fdf4-49f6-8207-96b01a95d038 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:04:21 devstack sudo[105856]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8fe3089c-fdf4-49f6-8207-96b01a95d038 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Flow 'volume_create_manager' (2e0e1b42-09bd-4037-aca0-d38e4cbc20db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:04:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8fe3089c-fdf4-49f6-8207-96b01a95d038 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5867fdc0-c607-4599-b60f-c62f57a4c9d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a23d02c5-2476-437c-9b53-678ea869164c tempest-CreateVolumesFromImageTest-193126103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-6b444f07-ebc6-4177-bd19-96152dc849a7 1073741824" returned: 0 in 1.372s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8fe3089c-fdf4-49f6-8207-96b01a95d038 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5867fdc0-c607-4599-b60f-c62f57a4c9d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:04:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-713499319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e998505-1e68-4bf4-966a-cc0b1d46b32b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2cadb800e474072a5fbcf41df9c4c00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:04:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:04:21Z,use_quota=True,user_id='e04003fe878b4e6b8766372ced58f07c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8fe3089c-fdf4-49f6-8207-96b01a95d038 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3d63def-b8f3-4480-a286-0d294b475827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8fe3089c-fdf4-49f6-8207-96b01a95d038 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3d63def-b8f3-4480-a286-0d294b475827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:21 devstack sudo[105865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7acfc39f-06af-4d17-8e9e-f8f8dadb6f5f_5jk2ejq9devstack@QuobyteHD Jul 08 02:04:21 devstack sudo[105865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8fe3089c-fdf4-49f6-8207-96b01a95d038 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d62a0e0d-3d50-446c-945e-1e14be6c0bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8fe3089c-fdf4-49f6-8207-96b01a95d038 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d62a0e0d-3d50-446c-945e-1e14be6c0bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e998505-1e68-4bf4-966a-cc0b1d46b32b', 'volume_name': 'volume-8e998505-1e68-4bf4-966a-cc0b1d46b32b', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8fe3089c-fdf4-49f6-8207-96b01a95d038 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37fc15a2-bd5b-4d38-8276-f11f2d567066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8fe3089c-fdf4-49f6-8207-96b01a95d038 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37fc15a2-bd5b-4d38-8276-f11f2d567066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8fe3089c-fdf4-49f6-8207-96b01a95d038 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3b767de-03f8-41be-b70b-0679c768f075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:21 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-8fe3089c-fdf4-49f6-8207-96b01a95d038 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Volume 8e998505-1e68-4bf4-966a-cc0b1d46b32b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e998505-1e68-4bf4-966a-cc0b1d46b32b', 'volume_size': 1} Jul 08 02:04:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-8fe3089c-fdf4-49f6-8207-96b01a95d038 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:04:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a23d02c5-2476-437c-9b53-678ea869164c tempest-CreateVolumesFromImageTest-193126103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-6b444f07-ebc6-4177-bd19-96152dc849a7 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:21 devstack sudo[105867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-6b444f07-ebc6-4177-bd19-96152dc849a7 Jul 08 02:04:21 devstack sudo[105867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-32f069d6-6bc3-4709-b768-aba491f5f164 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (646b7972-7b13-44ac-953a-7f63906c80e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e2fce024-0a9f-40bf-97a0-8f974fbb43de', 'volume_name': 'volume-e2fce024-0a9f-40bf-97a0-8f974fbb43de', 'volume_size': 1, 'image_id': '8ff43535-3a40-4446-a28e-5fbde4a7e7cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8ff43535-3a40-4446-a28e-5fbde4a7e7cf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '12945d36d1743ab50a0bfa8aef89b4ad', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '79e3c1a92b214f009b68e2e92edd2d2c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'eba9d9d17f35bac98826d6fda08b0aee23a8091b4062e1370e30f4871208878627d07bdbca27b348c97a0baf130c3ff40137f5013e5823875f3af86f2159d6de', 'id': '8ff43535-3a40-4446-a28e-5fbde4a7e7cf', 'created_at': datetime.datetime(2026, 7, 8, 0, 4, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 0, 4, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8ff43535-3a40-4446-a28e-5fbde4a7e7cf/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-32f069d6-6bc3-4709-b768-aba491f5f164 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af9fa70f-4054-472a-bb5c-87475c543543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-32f069d6-6bc3-4709-b768-aba491f5f164 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af9fa70f-4054-472a-bb5c-87475c543543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-32f069d6-6bc3-4709-b768-aba491f5f164 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7948b006-4420-456f-ad2b-cdc57ab342b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:21 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-32f069d6-6bc3-4709-b768-aba491f5f164 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] Volume e2fce024-0a9f-40bf-97a0-8f974fbb43de: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e2fce024-0a9f-40bf-97a0-8f974fbb43de', 'volume_size': 1, 'image_id': '8ff43535-3a40-4446-a28e-5fbde4a7e7cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8ff43535-3a40-4446-a28e-5fbde4a7e7cf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '12945d36d1743ab50a0bfa8aef89b4ad', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '79e3c1a92b214f009b68e2e92edd2d2c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'eba9d9d17f35bac98826d6fda08b0aee23a8091b4062e1370e30f4871208878627d07bdbca27b348c97a0baf130c3ff40137f5013e5823875f3af86f2159d6de', 'id': '8ff43535-3a40-4446-a28e-5fbde4a7e7cf', 'created_at': datetime.datetime(2026, 7, 8, 0, 4, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 0, 4, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8ff43535-3a40-4446-a28e-5fbde4a7e7cf/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 08 02:04:21 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-32f069d6-6bc3-4709-b768-aba491f5f164 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] Trying to clone e2fce024-0a9f-40bf-97a0-8f974fbb43de from image 8ff43535-3a40-4446-a28e-5fbde4a7e7cf at location (None, [{'url': 'file:///opt/stack/data/glance/images/8ff43535-3a40-4446-a28e-5fbde4a7e7cf', 'metadata': {}}]). {{(pid=87134) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 02:04:21 devstack cinder-volume[87134]: DEBUG cinder.image.image_utils [None req-32f069d6-6bc3-4709-b768-aba491f5f164 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8ff43535-3a40-4446-a28e-5fbde4a7e7cf_3iy8xby3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87134) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 02:04:21 devstack cinder-volume[87134]: INFO cinder.image.image_utils [None req-32f069d6-6bc3-4709-b768-aba491f5f164 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] Image download 0.00 MB at 0.00 MB/s Jul 08 02:04:21 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[b009387b-a5a8-4d36-9f94-51cca249cbe7]: (4, 'raw') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:04:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-32f069d6-6bc3-4709-b768-aba491f5f164 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8ff43535-3a40-4446-a28e-5fbde4a7e7cf_3iy8xby3devstack@QuobyteHD {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:21 devstack sudo[105863]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.893s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:21 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:04:21 devstack sudo[105869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8ff43535-3a40-4446-a28e-5fbde4a7e7cf_3iy8xby3devstack@QuobyteHD Jul 08 02:04:21 devstack cinder-volume[87134]: DEBUG oslo_service.periodic_task [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running periodic task VolumeManager._thread_info {{(pid=87134) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 02:04:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] thread count: 28 {{(pid=87134) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 02:04:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] thread info: [<_MainThread(MainThread, started 129378964615296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87134) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 02:04:21 devstack sudo[105869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:22 devstack sudo[105865]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2c94e279-1fc4-44ac-8965-1236a61b2f6b tempest-VolumeImageDependencyTests-2073805245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7acfc39f-06af-4d17-8e9e-f8f8dadb6f5f_5jk2ejq9devstack@QuobyteHD" returned: 0 in 0.883s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2c94e279-1fc4-44ac-8965-1236a61b2f6b tempest-VolumeImageDependencyTests-2073805245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7acfc39f-06af-4d17-8e9e-f8f8dadb6f5f_5jk2ejq9devstack@QuobyteHD {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:22 devstack sudo[105867]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a23d02c5-2476-437c-9b53-678ea869164c tempest-CreateVolumesFromImageTest-193126103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-6b444f07-ebc6-4177-bd19-96152dc849a7" returned: 0 in 0.790s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:22 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-a23d02c5-2476-437c-9b53-678ea869164c tempest-CreateVolumesFromImageTest-193126103 None] <== create_volume: return (2280ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:04:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-a23d02c5-2476-437c-9b53-678ea869164c tempest-CreateVolumesFromImageTest-193126103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.285s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:04:22 devstack sudo[105875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7acfc39f-06af-4d17-8e9e-f8f8dadb6f5f_5jk2ejq9devstack@QuobyteHD Jul 08 02:04:22 devstack sudo[105875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-81251c41-85f0-452c-b459-fd98e2c7bae5 tempest-CreateVolumesFromImageTest-193126103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.511s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:04:22 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-81251c41-85f0-452c-b459-fd98e2c7bae5 tempest-CreateVolumesFromImageTest-193126103 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:04:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1662084347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66d77387-4f36-44bf-8f76-0b33d163a047,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c005ff5e9e8427588cb11cec0b726e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:04:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:04:16Z,use_quota=True,user_id='19a305fe78734a838ffd0c5725a3460b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:04:22 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-81251c41-85f0-452c-b459-fd98e2c7bae5 tempest-CreateVolumesFromImageTest-193126103 None] Creating volume 66d77387-4f36-44bf-8f76-0b33d163a047 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:04:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-81251c41-85f0-452c-b459-fd98e2c7bae5 tempest-CreateVolumesFromImageTest-193126103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:04:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-81251c41-85f0-452c-b459-fd98e2c7bae5 tempest-CreateVolumesFromImageTest-193126103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:04:22 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-81251c41-85f0-452c-b459-fd98e2c7bae5 tempest-CreateVolumesFromImageTest-193126103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:04:22 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-81251c41-85f0-452c-b459-fd98e2c7bae5 tempest-CreateVolumesFromImageTest-193126103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:04:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-81251c41-85f0-452c-b459-fd98e2c7bae5 tempest-CreateVolumesFromImageTest-193126103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:04:22 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-81251c41-85f0-452c-b459-fd98e2c7bae5 tempest-CreateVolumesFromImageTest-193126103 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:04:22 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-81251c41-85f0-452c-b459-fd98e2c7bae5 tempest-CreateVolumesFromImageTest-193126103 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 02:04:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-81251c41-85f0-452c-b459-fd98e2c7bae5 tempest-CreateVolumesFromImageTest-193126103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-66d77387-4f36-44bf-8f76-0b33d163a047 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:22 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-a23d02c5-2476-437c-9b53-678ea869164c tempest-CreateVolumesFromImageTest-193126103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b01eaad0-517b-4a5e-8105-9001e8aef5b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b444f07-ebc6-4177-bd19-96152dc849a7', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:22 devstack sudo[105877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-66d77387-4f36-44bf-8f76-0b33d163a047 1073741824 Jul 08 02:04:22 devstack sudo[105877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:22 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-a23d02c5-2476-437c-9b53-678ea869164c tempest-CreateVolumesFromImageTest-193126103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d479aff6-7c0f-43f0-9615-ee123eeadd1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:22 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-a23d02c5-2476-437c-9b53-678ea869164c tempest-CreateVolumesFromImageTest-193126103 None] Volume volume-6b444f07-ebc6-4177-bd19-96152dc849a7 (6b444f07-ebc6-4177-bd19-96152dc849a7): created successfully Jul 08 02:04:22 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-a23d02c5-2476-437c-9b53-678ea869164c tempest-CreateVolumesFromImageTest-193126103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d479aff6-7c0f-43f0-9615-ee123eeadd1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:22 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-a23d02c5-2476-437c-9b53-678ea869164c tempest-CreateVolumesFromImageTest-193126103 None] Flow 'volume_create_manager' (6601c2de-f406-4afa-91be-348ce03615b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:04:22 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-a23d02c5-2476-437c-9b53-678ea869164c tempest-CreateVolumesFromImageTest-193126103 None] Created volume successfully. Jul 08 02:04:22 devstack sudo[105869]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-32f069d6-6bc3-4709-b768-aba491f5f164 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8ff43535-3a40-4446-a28e-5fbde4a7e7cf_3iy8xby3devstack@QuobyteHD" returned: 0 in 0.883s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-32f069d6-6bc3-4709-b768-aba491f5f164 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ff43535-3a40-4446-a28e-5fbde4a7e7cf_3iy8xby3devstack@QuobyteHD {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:22 devstack sudo[105881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ff43535-3a40-4446-a28e-5fbde4a7e7cf_3iy8xby3devstack@QuobyteHD Jul 08 02:04:22 devstack sudo[105881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:22 devstack sudo[105875]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2c94e279-1fc4-44ac-8965-1236a61b2f6b tempest-VolumeImageDependencyTests-2073805245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7acfc39f-06af-4d17-8e9e-f8f8dadb6f5f_5jk2ejq9devstack@QuobyteHD" returned: 1 in 0.776s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2c94e279-1fc4-44ac-8965-1236a61b2f6b tempest-VolumeImageDependencyTests-2073805245 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7acfc39f-06af-4d17-8e9e-f8f8dadb6f5f_5jk2ejq9devstack@QuobyteHD' failed. Not Retrying. {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 02:04:22 devstack cinder-volume[87134]: DEBUG cinder.image.image_utils [None req-2c94e279-1fc4-44ac-8965-1236a61b2f6b tempest-VolumeImageDependencyTests-2073805245 None] Temporary image 7acfc39f-06af-4d17-8e9e-f8f8dadb6f5f is fetched for user 2c8af564cbde434aa6b1595e1e36da33. {{(pid=87134) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 02:04:22 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d717e82-bba9-434b-bd96-2154dde1c84e]: (4, 'raw') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:04:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2c94e279-1fc4-44ac-8965-1236a61b2f6b tempest-VolumeImageDependencyTests-2073805245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7acfc39f-06af-4d17-8e9e-f8f8dadb6f5f_5jk2ejq9devstack@QuobyteHD {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:23 devstack sudo[105889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7acfc39f-06af-4d17-8e9e-f8f8dadb6f5f_5jk2ejq9devstack@QuobyteHD Jul 08 02:04:23 devstack sudo[105889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:23 devstack sudo[105877]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:23 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-81251c41-85f0-452c-b459-fd98e2c7bae5 tempest-CreateVolumesFromImageTest-193126103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-66d77387-4f36-44bf-8f76-0b33d163a047 1073741824" returned: 0 in 1.038s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:23 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-81251c41-85f0-452c-b459-fd98e2c7bae5 tempest-CreateVolumesFromImageTest-193126103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-66d77387-4f36-44bf-8f76-0b33d163a047 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:23 devstack sudo[105896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-66d77387-4f36-44bf-8f76-0b33d163a047 Jul 08 02:04:23 devstack sudo[105896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:23 devstack sudo[105881]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:23 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-32f069d6-6bc3-4709-b768-aba491f5f164 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ff43535-3a40-4446-a28e-5fbde4a7e7cf_3iy8xby3devstack@QuobyteHD" returned: 1 in 0.826s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:23 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-32f069d6-6bc3-4709-b768-aba491f5f164 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ff43535-3a40-4446-a28e-5fbde4a7e7cf_3iy8xby3devstack@QuobyteHD' failed. Not Retrying. {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 02:04:23 devstack cinder-volume[87134]: DEBUG cinder.image.image_utils [None req-32f069d6-6bc3-4709-b768-aba491f5f164 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] Temporary image 8ff43535-3a40-4446-a28e-5fbde4a7e7cf is fetched for user dc398523bb684249a7b24e3fdbba43d4. {{(pid=87134) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 02:04:23 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c602d1-21f8-4bf0-8d0e-467631eacdd8]: (4, 'raw') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:04:23 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-32f069d6-6bc3-4709-b768-aba491f5f164 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8ff43535-3a40-4446-a28e-5fbde4a7e7cf_3iy8xby3devstack@QuobyteHD {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:23 devstack sudo[105898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8ff43535-3a40-4446-a28e-5fbde4a7e7cf_3iy8xby3devstack@QuobyteHD Jul 08 02:04:23 devstack sudo[105898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:23 devstack sudo[105889]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:23 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2c94e279-1fc4-44ac-8965-1236a61b2f6b tempest-VolumeImageDependencyTests-2073805245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7acfc39f-06af-4d17-8e9e-f8f8dadb6f5f_5jk2ejq9devstack@QuobyteHD" returned: 0 in 0.832s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:23 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2c94e279-1fc4-44ac-8965-1236a61b2f6b tempest-VolumeImageDependencyTests-2073805245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7acfc39f-06af-4d17-8e9e-f8f8dadb6f5f_5jk2ejq9devstack@QuobyteHD {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:23 devstack sudo[105902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7acfc39f-06af-4d17-8e9e-f8f8dadb6f5f_5jk2ejq9devstack@QuobyteHD Jul 08 02:04:23 devstack sudo[105902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:24 devstack sudo[105896]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-81251c41-85f0-452c-b459-fd98e2c7bae5 tempest-CreateVolumesFromImageTest-193126103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-66d77387-4f36-44bf-8f76-0b33d163a047" returned: 0 in 0.707s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:24 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-81251c41-85f0-452c-b459-fd98e2c7bae5 tempest-CreateVolumesFromImageTest-193126103 None] <== create_volume: return (1802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:04:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-81251c41-85f0-452c-b459-fd98e2c7bae5 tempest-CreateVolumesFromImageTest-193126103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.806s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:04:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b5d5b763-b269-407d-b36b-14b0350e5f19 tempest-CreateVolumesFromImageTest-193126103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.831s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:04:24 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-b5d5b763-b269-407d-b36b-14b0350e5f19 tempest-CreateVolumesFromImageTest-193126103 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:04:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-605455382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7c5ff12-877f-4c02-9470-51b005f7a4d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c005ff5e9e8427588cb11cec0b726e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:04:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:04:17Z,use_quota=True,user_id='19a305fe78734a838ffd0c5725a3460b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:04:24 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-b5d5b763-b269-407d-b36b-14b0350e5f19 tempest-CreateVolumesFromImageTest-193126103 None] Creating volume f7c5ff12-877f-4c02-9470-51b005f7a4d5 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:04:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b5d5b763-b269-407d-b36b-14b0350e5f19 tempest-CreateVolumesFromImageTest-193126103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:04:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b5d5b763-b269-407d-b36b-14b0350e5f19 tempest-CreateVolumesFromImageTest-193126103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:04:24 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-b5d5b763-b269-407d-b36b-14b0350e5f19 tempest-CreateVolumesFromImageTest-193126103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:04:24 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-b5d5b763-b269-407d-b36b-14b0350e5f19 tempest-CreateVolumesFromImageTest-193126103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:04:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b5d5b763-b269-407d-b36b-14b0350e5f19 tempest-CreateVolumesFromImageTest-193126103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:04:24 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-b5d5b763-b269-407d-b36b-14b0350e5f19 tempest-CreateVolumesFromImageTest-193126103 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:04:24 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-b5d5b763-b269-407d-b36b-14b0350e5f19 tempest-CreateVolumesFromImageTest-193126103 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 02:04:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b5d5b763-b269-407d-b36b-14b0350e5f19 tempest-CreateVolumesFromImageTest-193126103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f7c5ff12-877f-4c02-9470-51b005f7a4d5 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:24 devstack sudo[105905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f7c5ff12-877f-4c02-9470-51b005f7a4d5 1073741824 Jul 08 02:04:24 devstack sudo[105905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:24 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-81251c41-85f0-452c-b459-fd98e2c7bae5 tempest-CreateVolumesFromImageTest-193126103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eee01a88-596c-4b3b-af24-5296ead1a463) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66d77387-4f36-44bf-8f76-0b33d163a047', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:24 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-81251c41-85f0-452c-b459-fd98e2c7bae5 tempest-CreateVolumesFromImageTest-193126103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aaaa89d-108e-450c-ab0c-302ce122b88c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:24 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-81251c41-85f0-452c-b459-fd98e2c7bae5 tempest-CreateVolumesFromImageTest-193126103 None] Volume volume-66d77387-4f36-44bf-8f76-0b33d163a047 (66d77387-4f36-44bf-8f76-0b33d163a047): created successfully Jul 08 02:04:24 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-81251c41-85f0-452c-b459-fd98e2c7bae5 tempest-CreateVolumesFromImageTest-193126103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aaaa89d-108e-450c-ab0c-302ce122b88c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:24 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-81251c41-85f0-452c-b459-fd98e2c7bae5 tempest-CreateVolumesFromImageTest-193126103 None] Flow 'volume_create_manager' (fd4902f6-2501-4790-bf24-8490d71be412) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:04:24 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-81251c41-85f0-452c-b459-fd98e2c7bae5 tempest-CreateVolumesFromImageTest-193126103 None] Created volume successfully. Jul 08 02:04:24 devstack sudo[105898]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-32f069d6-6bc3-4709-b768-aba491f5f164 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8ff43535-3a40-4446-a28e-5fbde4a7e7cf_3iy8xby3devstack@QuobyteHD" returned: 0 in 0.832s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-32f069d6-6bc3-4709-b768-aba491f5f164 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ff43535-3a40-4446-a28e-5fbde4a7e7cf_3iy8xby3devstack@QuobyteHD {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:24 devstack sudo[105909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ff43535-3a40-4446-a28e-5fbde4a7e7cf_3iy8xby3devstack@QuobyteHD Jul 08 02:04:24 devstack sudo[105909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:24 devstack sudo[105902]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2c94e279-1fc4-44ac-8965-1236a61b2f6b tempest-VolumeImageDependencyTests-2073805245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7acfc39f-06af-4d17-8e9e-f8f8dadb6f5f_5jk2ejq9devstack@QuobyteHD" returned: 1 in 0.805s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2c94e279-1fc4-44ac-8965-1236a61b2f6b tempest-VolumeImageDependencyTests-2073805245 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7acfc39f-06af-4d17-8e9e-f8f8dadb6f5f_5jk2ejq9devstack@QuobyteHD' failed. Not Retrying. {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 02:04:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-2c94e279-1fc4-44ac-8965-1236a61b2f6b tempest-VolumeImageDependencyTests-2073805245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:04:24 devstack sudo[105905]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b5d5b763-b269-407d-b36b-14b0350e5f19 tempest-CreateVolumesFromImageTest-193126103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f7c5ff12-877f-4c02-9470-51b005f7a4d5 1073741824" returned: 0 in 0.920s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:25 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b5d5b763-b269-407d-b36b-14b0350e5f19 tempest-CreateVolumesFromImageTest-193126103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f7c5ff12-877f-4c02-9470-51b005f7a4d5 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:25 devstack sudo[105917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f7c5ff12-877f-4c02-9470-51b005f7a4d5 Jul 08 02:04:25 devstack sudo[105917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:25 devstack sudo[105909]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:25 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-32f069d6-6bc3-4709-b768-aba491f5f164 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ff43535-3a40-4446-a28e-5fbde4a7e7cf_3iy8xby3devstack@QuobyteHD" returned: 1 in 0.901s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:25 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-32f069d6-6bc3-4709-b768-aba491f5f164 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ff43535-3a40-4446-a28e-5fbde4a7e7cf_3iy8xby3devstack@QuobyteHD' failed. Not Retrying. {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 02:04:25 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-32f069d6-6bc3-4709-b768-aba491f5f164 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:04:25 devstack sudo[105917]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:25 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b5d5b763-b269-407d-b36b-14b0350e5f19 tempest-CreateVolumesFromImageTest-193126103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f7c5ff12-877f-4c02-9470-51b005f7a4d5" returned: 0 in 0.652s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:25 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-b5d5b763-b269-407d-b36b-14b0350e5f19 tempest-CreateVolumesFromImageTest-193126103 None] <== create_volume: return (1627ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:04:25 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b5d5b763-b269-407d-b36b-14b0350e5f19 tempest-CreateVolumesFromImageTest-193126103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.629s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:04:25 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-455b94cd-1573-48fc-bac2-247e34f567cc tempest-CreateVolumesFromImageTest-193126103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.850s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:04:25 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-455b94cd-1573-48fc-bac2-247e34f567cc tempest-CreateVolumesFromImageTest-193126103 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:04:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1627657358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e278ac8b-1235-4e7e-8d69-8a291b8e41df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c005ff5e9e8427588cb11cec0b726e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:04:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:04:18Z,use_quota=True,user_id='19a305fe78734a838ffd0c5725a3460b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:04:25 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-455b94cd-1573-48fc-bac2-247e34f567cc tempest-CreateVolumesFromImageTest-193126103 None] Creating volume e278ac8b-1235-4e7e-8d69-8a291b8e41df {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:04:25 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-455b94cd-1573-48fc-bac2-247e34f567cc tempest-CreateVolumesFromImageTest-193126103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:04:25 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-455b94cd-1573-48fc-bac2-247e34f567cc tempest-CreateVolumesFromImageTest-193126103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:04:25 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-455b94cd-1573-48fc-bac2-247e34f567cc tempest-CreateVolumesFromImageTest-193126103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:04:25 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-455b94cd-1573-48fc-bac2-247e34f567cc tempest-CreateVolumesFromImageTest-193126103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:04:25 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-455b94cd-1573-48fc-bac2-247e34f567cc tempest-CreateVolumesFromImageTest-193126103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:04:25 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-455b94cd-1573-48fc-bac2-247e34f567cc tempest-CreateVolumesFromImageTest-193126103 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:04:25 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-455b94cd-1573-48fc-bac2-247e34f567cc tempest-CreateVolumesFromImageTest-193126103 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 02:04:25 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-455b94cd-1573-48fc-bac2-247e34f567cc tempest-CreateVolumesFromImageTest-193126103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e278ac8b-1235-4e7e-8d69-8a291b8e41df 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:25 devstack sudo[105924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e278ac8b-1235-4e7e-8d69-8a291b8e41df 1073741824 Jul 08 02:04:25 devstack sudo[105924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:25 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b5d5b763-b269-407d-b36b-14b0350e5f19 tempest-CreateVolumesFromImageTest-193126103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f28c195f-edfe-41fd-b119-eeba2dcf5799) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7c5ff12-877f-4c02-9470-51b005f7a4d5', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:25 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b5d5b763-b269-407d-b36b-14b0350e5f19 tempest-CreateVolumesFromImageTest-193126103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9601aba8-47e2-495a-b559-9ab8d2f0de66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:25 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-b5d5b763-b269-407d-b36b-14b0350e5f19 tempest-CreateVolumesFromImageTest-193126103 None] Volume volume-f7c5ff12-877f-4c02-9470-51b005f7a4d5 (f7c5ff12-877f-4c02-9470-51b005f7a4d5): created successfully Jul 08 02:04:25 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b5d5b763-b269-407d-b36b-14b0350e5f19 tempest-CreateVolumesFromImageTest-193126103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9601aba8-47e2-495a-b559-9ab8d2f0de66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:25 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b5d5b763-b269-407d-b36b-14b0350e5f19 tempest-CreateVolumesFromImageTest-193126103 None] Flow 'volume_create_manager' (9849ff61-1859-4a83-a5ea-c3616ba28c77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:04:25 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-b5d5b763-b269-407d-b36b-14b0350e5f19 tempest-CreateVolumesFromImageTest-193126103 None] Created volume successfully. Jul 08 02:04:26 devstack sudo[105924]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:26 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-455b94cd-1573-48fc-bac2-247e34f567cc tempest-CreateVolumesFromImageTest-193126103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e278ac8b-1235-4e7e-8d69-8a291b8e41df 1073741824" returned: 0 in 0.845s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:26 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-455b94cd-1573-48fc-bac2-247e34f567cc tempest-CreateVolumesFromImageTest-193126103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e278ac8b-1235-4e7e-8d69-8a291b8e41df {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:26 devstack sudo[105930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e278ac8b-1235-4e7e-8d69-8a291b8e41df Jul 08 02:04:26 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:27 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:27 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-455b94cd-1573-48fc-bac2-247e34f567cc tempest-CreateVolumesFromImageTest-193126103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e278ac8b-1235-4e7e-8d69-8a291b8e41df" returned: 0 in 0.726s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:27 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-455b94cd-1573-48fc-bac2-247e34f567cc tempest-CreateVolumesFromImageTest-193126103 None] <== create_volume: return (1619ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:04:27 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-455b94cd-1573-48fc-bac2-247e34f567cc tempest-CreateVolumesFromImageTest-193126103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.622s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:04:27 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5b740b81-a9a5-4889-971f-950cfec156b2 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.997s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:04:27 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-5b740b81-a9a5-4889-971f-950cfec156b2 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:04:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1947744386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a3bf812-e904-426d-92c4-4fdd3d65f702,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2cadb800e474072a5fbcf41df9c4c00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:04:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:04:19Z,use_quota=True,user_id='e04003fe878b4e6b8766372ced58f07c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:04:27 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-5b740b81-a9a5-4889-971f-950cfec156b2 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Creating volume 2a3bf812-e904-426d-92c4-4fdd3d65f702 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:04:27 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5b740b81-a9a5-4889-971f-950cfec156b2 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:04:27 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5b740b81-a9a5-4889-971f-950cfec156b2 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:04:27 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-5b740b81-a9a5-4889-971f-950cfec156b2 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:04:27 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-5b740b81-a9a5-4889-971f-950cfec156b2 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:04:27 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5b740b81-a9a5-4889-971f-950cfec156b2 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:04:27 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-5b740b81-a9a5-4889-971f-950cfec156b2 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:04:27 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-5b740b81-a9a5-4889-971f-950cfec156b2 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 02:04:27 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5b740b81-a9a5-4889-971f-950cfec156b2 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-2a3bf812-e904-426d-92c4-4fdd3d65f702 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:27 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-455b94cd-1573-48fc-bac2-247e34f567cc tempest-CreateVolumesFromImageTest-193126103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (737e7e9b-77ad-451e-9d9b-2725c1336447) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e278ac8b-1235-4e7e-8d69-8a291b8e41df', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:27 devstack sudo[105933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-2a3bf812-e904-426d-92c4-4fdd3d65f702 1073741824 Jul 08 02:04:27 devstack sudo[105933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:27 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-455b94cd-1573-48fc-bac2-247e34f567cc tempest-CreateVolumesFromImageTest-193126103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (198f8f08-8af5-4def-acb3-503cf0bac1a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:27 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-455b94cd-1573-48fc-bac2-247e34f567cc tempest-CreateVolumesFromImageTest-193126103 None] Volume volume-e278ac8b-1235-4e7e-8d69-8a291b8e41df (e278ac8b-1235-4e7e-8d69-8a291b8e41df): created successfully Jul 08 02:04:27 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-455b94cd-1573-48fc-bac2-247e34f567cc tempest-CreateVolumesFromImageTest-193126103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (198f8f08-8af5-4def-acb3-503cf0bac1a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:27 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-455b94cd-1573-48fc-bac2-247e34f567cc tempest-CreateVolumesFromImageTest-193126103 None] Flow 'volume_create_manager' (dcff61f0-ee45-4d3e-b0cb-05319f6ed9db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:04:27 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-455b94cd-1573-48fc-bac2-247e34f567cc tempest-CreateVolumesFromImageTest-193126103 None] Created volume successfully. Jul 08 02:04:27 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-ed5f518e-98c9-4f56-ac3b-cb21ac691cb1 tempest-CreateVolumesFromImageTest-193126103 None] Acquiring lock "cinder-e278ac8b-1235-4e7e-8d69-8a291b8e41df-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:04:27 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-ed5f518e-98c9-4f56-ac3b-cb21ac691cb1 tempest-CreateVolumesFromImageTest-193126103 None] Lock "cinder-e278ac8b-1235-4e7e-8d69-8a291b8e41df-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:04:27 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-ed5f518e-98c9-4f56-ac3b-cb21ac691cb1 tempest-CreateVolumesFromImageTest-193126103 None] Acquiring lock "cinder-quobyte-e278ac8b-1235-4e7e-8d69-8a291b8e41df" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:04:27 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-ed5f518e-98c9-4f56-ac3b-cb21ac691cb1 tempest-CreateVolumesFromImageTest-193126103 None] Lock "cinder-quobyte-e278ac8b-1235-4e7e-8d69-8a291b8e41df" acquired by "delete_volume" :: waited 0.022s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:04:27 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ab8862-878c-499a-90d0-4c5c570867c9]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:04:27 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ed5f518e-98c9-4f56-ac3b-cb21ac691cb1 tempest-CreateVolumesFromImageTest-193126103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e278ac8b-1235-4e7e-8d69-8a291b8e41df {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:28 devstack sudo[105937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e278ac8b-1235-4e7e-8d69-8a291b8e41df Jul 08 02:04:28 devstack sudo[105937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:28 devstack sudo[105933]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:28 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5b740b81-a9a5-4889-971f-950cfec156b2 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-2a3bf812-e904-426d-92c4-4fdd3d65f702 1073741824" returned: 0 in 1.025s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:28 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5b740b81-a9a5-4889-971f-950cfec156b2 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-2a3bf812-e904-426d-92c4-4fdd3d65f702 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:28 devstack sudo[105941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-2a3bf812-e904-426d-92c4-4fdd3d65f702 Jul 08 02:04:28 devstack sudo[105941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:28 devstack sudo[105937]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:28 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ed5f518e-98c9-4f56-ac3b-cb21ac691cb1 tempest-CreateVolumesFromImageTest-193126103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e278ac8b-1235-4e7e-8d69-8a291b8e41df" returned: 0 in 0.847s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:28 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ed5f518e-98c9-4f56-ac3b-cb21ac691cb1 tempest-CreateVolumesFromImageTest-193126103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e278ac8b-1235-4e7e-8d69-8a291b8e41df {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:28 devstack sudo[105946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e278ac8b-1235-4e7e-8d69-8a291b8e41df Jul 08 02:04:28 devstack sudo[105946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:29 devstack sudo[105941]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5b740b81-a9a5-4889-971f-950cfec156b2 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-2a3bf812-e904-426d-92c4-4fdd3d65f702" returned: 0 in 0.683s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:29 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-5b740b81-a9a5-4889-971f-950cfec156b2 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] <== create_volume: return (1772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:04:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5b740b81-a9a5-4889-971f-950cfec156b2 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.775s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:04:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c6181d64-9296-407e-99a4-b87257296450 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.293s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:04:29 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-c6181d64-9296-407e-99a4-b87257296450 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:04:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1528323275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ded5792-df72-4160-89c4-4837a5e2f0b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2cadb800e474072a5fbcf41df9c4c00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:04:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:04:20Z,use_quota=True,user_id='e04003fe878b4e6b8766372ced58f07c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:04:29 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-c6181d64-9296-407e-99a4-b87257296450 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Creating volume 1ded5792-df72-4160-89c4-4837a5e2f0b0 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:04:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c6181d64-9296-407e-99a4-b87257296450 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:04:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c6181d64-9296-407e-99a4-b87257296450 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:04:29 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-c6181d64-9296-407e-99a4-b87257296450 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:04:29 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-c6181d64-9296-407e-99a4-b87257296450 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:04:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c6181d64-9296-407e-99a4-b87257296450 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:04:29 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-c6181d64-9296-407e-99a4-b87257296450 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:04:29 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-c6181d64-9296-407e-99a4-b87257296450 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 02:04:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c6181d64-9296-407e-99a4-b87257296450 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1ded5792-df72-4160-89c4-4837a5e2f0b0 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:29 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5b740b81-a9a5-4889-971f-950cfec156b2 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (790a6e30-098b-45f3-b7ee-2f144d027456) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a3bf812-e904-426d-92c4-4fdd3d65f702', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:29 devstack sudo[105949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1ded5792-df72-4160-89c4-4837a5e2f0b0 1073741824 Jul 08 02:04:29 devstack sudo[105949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:29 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5b740b81-a9a5-4889-971f-950cfec156b2 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32b5609f-1fb6-41c4-abdd-ff90199197fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:29 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-5b740b81-a9a5-4889-971f-950cfec156b2 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Volume volume-2a3bf812-e904-426d-92c4-4fdd3d65f702 (2a3bf812-e904-426d-92c4-4fdd3d65f702): created successfully Jul 08 02:04:29 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5b740b81-a9a5-4889-971f-950cfec156b2 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32b5609f-1fb6-41c4-abdd-ff90199197fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:29 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-5b740b81-a9a5-4889-971f-950cfec156b2 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Flow 'volume_create_manager' (5d14db6c-7486-4bbd-9ffc-2b09c690bc19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:04:29 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-5b740b81-a9a5-4889-971f-950cfec156b2 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Created volume successfully. Jul 08 02:04:29 devstack sudo[105946]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ed5f518e-98c9-4f56-ac3b-cb21ac691cb1 tempest-CreateVolumesFromImageTest-193126103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e278ac8b-1235-4e7e-8d69-8a291b8e41df" returned: 0 in 0.686s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:29 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-ed5f518e-98c9-4f56-ac3b-cb21ac691cb1 tempest-CreateVolumesFromImageTest-193126103 None] Lock "cinder-quobyte-e278ac8b-1235-4e7e-8d69-8a291b8e41df" released by "delete_volume" :: held 1.582s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:04:29 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-ed5f518e-98c9-4f56-ac3b-cb21ac691cb1 tempest-CreateVolumesFromImageTest-193126103 None] Created reservations ['7bbf8bb2-cc70-4e87-869a-7e1c3b4f5bbb', 'd206a664-bb27-48d9-b10a-3ff0becca28c', '3bb90f3d-ae14-4b03-9f21-13188f0158fd', 'beec5407-83f6-4ce1-a6d2-20dde6e63f55'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:04:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-ed5f518e-98c9-4f56-ac3b-cb21ac691cb1 tempest-CreateVolumesFromImageTest-193126103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:04:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-ed5f518e-98c9-4f56-ac3b-cb21ac691cb1 tempest-CreateVolumesFromImageTest-193126103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:04:29 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-ed5f518e-98c9-4f56-ac3b-cb21ac691cb1 tempest-CreateVolumesFromImageTest-193126103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:04:29 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-ed5f518e-98c9-4f56-ac3b-cb21ac691cb1 tempest-CreateVolumesFromImageTest-193126103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:04:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-ed5f518e-98c9-4f56-ac3b-cb21ac691cb1 tempest-CreateVolumesFromImageTest-193126103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:04:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ed5f518e-98c9-4f56-ac3b-cb21ac691cb1 tempest-CreateVolumesFromImageTest-193126103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:29 devstack sudo[105952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 02:04:29 devstack sudo[105952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:30 devstack sudo[105949]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c6181d64-9296-407e-99a4-b87257296450 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1ded5792-df72-4160-89c4-4837a5e2f0b0 1073741824" returned: 0 in 0.960s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:30 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-8a9eb63b-c177-477f-a25e-7afad3ae1d8a tempest-CreateVolumesFromImageTest-193126103 None] Acquiring lock "cinder-f7c5ff12-877f-4c02-9470-51b005f7a4d5-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:04:30 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-8a9eb63b-c177-477f-a25e-7afad3ae1d8a tempest-CreateVolumesFromImageTest-193126103 None] Lock "cinder-f7c5ff12-877f-4c02-9470-51b005f7a4d5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:04:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c6181d64-9296-407e-99a4-b87257296450 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1ded5792-df72-4160-89c4-4837a5e2f0b0 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:30 devstack sudo[105957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1ded5792-df72-4160-89c4-4837a5e2f0b0 Jul 08 02:04:30 devstack sudo[105957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:30 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-8a9eb63b-c177-477f-a25e-7afad3ae1d8a tempest-CreateVolumesFromImageTest-193126103 None] Acquiring lock "cinder-quobyte-f7c5ff12-877f-4c02-9470-51b005f7a4d5" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:04:30 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-8a9eb63b-c177-477f-a25e-7afad3ae1d8a tempest-CreateVolumesFromImageTest-193126103 None] Lock "cinder-quobyte-f7c5ff12-877f-4c02-9470-51b005f7a4d5" acquired by "delete_volume" :: waited 0.019s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:04:30 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf9c19bc-dd09-4228-b769-1ea91ba79e7b]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:04:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8a9eb63b-c177-477f-a25e-7afad3ae1d8a tempest-CreateVolumesFromImageTest-193126103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f7c5ff12-877f-4c02-9470-51b005f7a4d5 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:30 devstack sudo[105959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f7c5ff12-877f-4c02-9470-51b005f7a4d5 Jul 08 02:04:30 devstack sudo[105959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:30 devstack sudo[105952]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ed5f518e-98c9-4f56-ac3b-cb21ac691cb1 tempest-CreateVolumesFromImageTest-193126103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.775s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:30 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-ed5f518e-98c9-4f56-ac3b-cb21ac691cb1 tempest-CreateVolumesFromImageTest-193126103 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:04:30 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-ed5f518e-98c9-4f56-ac3b-cb21ac691cb1 tempest-CreateVolumesFromImageTest-193126103 None] Deleted volume successfully. Jul 08 02:04:30 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-ed5f518e-98c9-4f56-ac3b-cb21ac691cb1 tempest-CreateVolumesFromImageTest-193126103 None] Lock "cinder-e278ac8b-1235-4e7e-8d69-8a291b8e41df-delete_volume" released by "delete_volume" :: held 2.653s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:04:30 devstack sudo[105957]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c6181d64-9296-407e-99a4-b87257296450 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1ded5792-df72-4160-89c4-4837a5e2f0b0" returned: 0 in 0.716s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:30 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-c6181d64-9296-407e-99a4-b87257296450 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] <== create_volume: return (1736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:04:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c6181d64-9296-407e-99a4-b87257296450 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.740s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:04:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-2d8b93a9-64d4-4408-a9cc-2a7d542868af tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.359s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:04:30 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-2d8b93a9-64d4-4408-a9cc-2a7d542868af tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:04:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-778547538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aaca542-90b7-4b2a-9fcf-b49cd0572052,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2cadb800e474072a5fbcf41df9c4c00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:04:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:04:20Z,use_quota=True,user_id='e04003fe878b4e6b8766372ced58f07c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:04:30 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-2d8b93a9-64d4-4408-a9cc-2a7d542868af tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Creating volume 1aaca542-90b7-4b2a-9fcf-b49cd0572052 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:04:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-2d8b93a9-64d4-4408-a9cc-2a7d542868af tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:04:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-2d8b93a9-64d4-4408-a9cc-2a7d542868af tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:04:30 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-2d8b93a9-64d4-4408-a9cc-2a7d542868af tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:04:30 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-2d8b93a9-64d4-4408-a9cc-2a7d542868af tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:04:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-2d8b93a9-64d4-4408-a9cc-2a7d542868af tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:04:30 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-2d8b93a9-64d4-4408-a9cc-2a7d542868af tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:04:30 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-2d8b93a9-64d4-4408-a9cc-2a7d542868af tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 02:04:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2d8b93a9-64d4-4408-a9cc-2a7d542868af tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1aaca542-90b7-4b2a-9fcf-b49cd0572052 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:30 devstack sudo[105963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1aaca542-90b7-4b2a-9fcf-b49cd0572052 1073741824 Jul 08 02:04:30 devstack sudo[105963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:30 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c6181d64-9296-407e-99a4-b87257296450 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad267b9a-b569-4e75-af41-08d4e3ac4ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ded5792-df72-4160-89c4-4837a5e2f0b0', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:30 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c6181d64-9296-407e-99a4-b87257296450 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c05b3fb-45da-4392-a1a5-d8e0c633864d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:30 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-c6181d64-9296-407e-99a4-b87257296450 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Volume volume-1ded5792-df72-4160-89c4-4837a5e2f0b0 (1ded5792-df72-4160-89c4-4837a5e2f0b0): created successfully Jul 08 02:04:30 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c6181d64-9296-407e-99a4-b87257296450 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c05b3fb-45da-4392-a1a5-d8e0c633864d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:30 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c6181d64-9296-407e-99a4-b87257296450 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Flow 'volume_create_manager' (26d8c6ee-80f7-41c6-9fa1-6037473f7511) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:04:30 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-c6181d64-9296-407e-99a4-b87257296450 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Created volume successfully. Jul 08 02:04:31 devstack sudo[105959]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8a9eb63b-c177-477f-a25e-7afad3ae1d8a tempest-CreateVolumesFromImageTest-193126103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f7c5ff12-877f-4c02-9470-51b005f7a4d5" returned: 0 in 0.842s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8a9eb63b-c177-477f-a25e-7afad3ae1d8a tempest-CreateVolumesFromImageTest-193126103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f7c5ff12-877f-4c02-9470-51b005f7a4d5 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:31 devstack sudo[105968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f7c5ff12-877f-4c02-9470-51b005f7a4d5 Jul 08 02:04:31 devstack sudo[105968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:31 devstack sudo[105963]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2d8b93a9-64d4-4408-a9cc-2a7d542868af tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1aaca542-90b7-4b2a-9fcf-b49cd0572052 1073741824" returned: 0 in 0.956s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:31 devstack sudo[105968]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8a9eb63b-c177-477f-a25e-7afad3ae1d8a tempest-CreateVolumesFromImageTest-193126103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f7c5ff12-877f-4c02-9470-51b005f7a4d5" returned: 0 in 0.831s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2d8b93a9-64d4-4408-a9cc-2a7d542868af tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1aaca542-90b7-4b2a-9fcf-b49cd0572052 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:31 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-8a9eb63b-c177-477f-a25e-7afad3ae1d8a tempest-CreateVolumesFromImageTest-193126103 None] Lock "cinder-quobyte-f7c5ff12-877f-4c02-9470-51b005f7a4d5" released by "delete_volume" :: held 1.733s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:04:31 devstack sudo[105980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1aaca542-90b7-4b2a-9fcf-b49cd0572052 Jul 08 02:04:31 devstack sudo[105980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:31 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-8a9eb63b-c177-477f-a25e-7afad3ae1d8a tempest-CreateVolumesFromImageTest-193126103 None] Created reservations ['7c5de228-7737-4653-a015-b3b141b5fb74', '06ed62ca-e0b5-4a44-946c-ff5bb7b78874', '84e72730-bd5c-4a6d-9da9-f4a97f324d7a', 'c1522cc9-9de0-45ba-89b0-e23e835e6dbc'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:04:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-8a9eb63b-c177-477f-a25e-7afad3ae1d8a tempest-CreateVolumesFromImageTest-193126103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:04:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-8a9eb63b-c177-477f-a25e-7afad3ae1d8a tempest-CreateVolumesFromImageTest-193126103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:04:32 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-8a9eb63b-c177-477f-a25e-7afad3ae1d8a tempest-CreateVolumesFromImageTest-193126103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:04:32 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-8a9eb63b-c177-477f-a25e-7afad3ae1d8a tempest-CreateVolumesFromImageTest-193126103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:04:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-8a9eb63b-c177-477f-a25e-7afad3ae1d8a tempest-CreateVolumesFromImageTest-193126103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:04:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8a9eb63b-c177-477f-a25e-7afad3ae1d8a tempest-CreateVolumesFromImageTest-193126103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:32 devstack sudo[105982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 02:04:32 devstack sudo[105982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:32 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-f88ce5c9-e1fd-4dc7-bdf8-fe500af8ea46 tempest-CreateVolumesFromImageTest-193126103 None] Acquiring lock "cinder-66d77387-4f36-44bf-8f76-0b33d163a047-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:04:32 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-f88ce5c9-e1fd-4dc7-bdf8-fe500af8ea46 tempest-CreateVolumesFromImageTest-193126103 None] Lock "cinder-66d77387-4f36-44bf-8f76-0b33d163a047-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:04:32 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-f88ce5c9-e1fd-4dc7-bdf8-fe500af8ea46 tempest-CreateVolumesFromImageTest-193126103 None] Acquiring lock "cinder-quobyte-66d77387-4f36-44bf-8f76-0b33d163a047" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:04:32 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-f88ce5c9-e1fd-4dc7-bdf8-fe500af8ea46 tempest-CreateVolumesFromImageTest-193126103 None] Lock "cinder-quobyte-66d77387-4f36-44bf-8f76-0b33d163a047" acquired by "delete_volume" :: waited 0.029s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:04:32 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[92232236-1001-4200-bc78-630909445206]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:04:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f88ce5c9-e1fd-4dc7-bdf8-fe500af8ea46 tempest-CreateVolumesFromImageTest-193126103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-66d77387-4f36-44bf-8f76-0b33d163a047 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:32 devstack sudo[105984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-66d77387-4f36-44bf-8f76-0b33d163a047 Jul 08 02:04:32 devstack sudo[105984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:32 devstack sudo[105980]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2d8b93a9-64d4-4408-a9cc-2a7d542868af tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1aaca542-90b7-4b2a-9fcf-b49cd0572052" returned: 0 in 0.809s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:32 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-2d8b93a9-64d4-4408-a9cc-2a7d542868af tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] <== create_volume: return (1877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:04:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-2d8b93a9-64d4-4408-a9cc-2a7d542868af tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.879s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:04:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-92409692-02fa-4a5a-a137-f7f464136866 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.893s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:04:32 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-92409692-02fa-4a5a-a137-f7f464136866 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:04:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1741325671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5926707-7997-4d96-ace6-336caedc1e29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2cadb800e474072a5fbcf41df9c4c00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:04:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:04:21Z,use_quota=True,user_id='e04003fe878b4e6b8766372ced58f07c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:04:32 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-92409692-02fa-4a5a-a137-f7f464136866 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Creating volume e5926707-7997-4d96-ace6-336caedc1e29 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:04:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-92409692-02fa-4a5a-a137-f7f464136866 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:04:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-92409692-02fa-4a5a-a137-f7f464136866 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:04:32 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-92409692-02fa-4a5a-a137-f7f464136866 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:04:32 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-92409692-02fa-4a5a-a137-f7f464136866 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:04:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-92409692-02fa-4a5a-a137-f7f464136866 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:04:32 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-92409692-02fa-4a5a-a137-f7f464136866 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:04:32 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-92409692-02fa-4a5a-a137-f7f464136866 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 02:04:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-92409692-02fa-4a5a-a137-f7f464136866 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e5926707-7997-4d96-ace6-336caedc1e29 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:32 devstack sudo[105988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e5926707-7997-4d96-ace6-336caedc1e29 1073741824 Jul 08 02:04:32 devstack sudo[105988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:32 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-2d8b93a9-64d4-4408-a9cc-2a7d542868af tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbd6e39f-5f7e-426d-b647-bb2176495689) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1aaca542-90b7-4b2a-9fcf-b49cd0572052', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:32 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-2d8b93a9-64d4-4408-a9cc-2a7d542868af tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42f52e6d-03c1-4649-80f1-619f856889e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:32 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-2d8b93a9-64d4-4408-a9cc-2a7d542868af tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Volume volume-1aaca542-90b7-4b2a-9fcf-b49cd0572052 (1aaca542-90b7-4b2a-9fcf-b49cd0572052): created successfully Jul 08 02:04:32 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-2d8b93a9-64d4-4408-a9cc-2a7d542868af tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42f52e6d-03c1-4649-80f1-619f856889e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:32 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-2d8b93a9-64d4-4408-a9cc-2a7d542868af tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Flow 'volume_create_manager' (6bbe0a79-92f5-4cc1-ba2f-72f87c137daf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:04:32 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-2d8b93a9-64d4-4408-a9cc-2a7d542868af tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Created volume successfully. Jul 08 02:04:32 devstack sudo[105982]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8a9eb63b-c177-477f-a25e-7afad3ae1d8a tempest-CreateVolumesFromImageTest-193126103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.761s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:32 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-8a9eb63b-c177-477f-a25e-7afad3ae1d8a tempest-CreateVolumesFromImageTest-193126103 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:04:32 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-8a9eb63b-c177-477f-a25e-7afad3ae1d8a tempest-CreateVolumesFromImageTest-193126103 None] Deleted volume successfully. Jul 08 02:04:32 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-8a9eb63b-c177-477f-a25e-7afad3ae1d8a tempest-CreateVolumesFromImageTest-193126103 None] Lock "cinder-f7c5ff12-877f-4c02-9470-51b005f7a4d5-delete_volume" released by "delete_volume" :: held 2.753s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:04:33 devstack sudo[105984]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f88ce5c9-e1fd-4dc7-bdf8-fe500af8ea46 tempest-CreateVolumesFromImageTest-193126103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-66d77387-4f36-44bf-8f76-0b33d163a047" returned: 0 in 0.937s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f88ce5c9-e1fd-4dc7-bdf8-fe500af8ea46 tempest-CreateVolumesFromImageTest-193126103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-66d77387-4f36-44bf-8f76-0b33d163a047 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:33 devstack sudo[106031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-66d77387-4f36-44bf-8f76-0b33d163a047 Jul 08 02:04:33 devstack sudo[106031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:33 devstack sudo[105988]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-92409692-02fa-4a5a-a137-f7f464136866 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e5926707-7997-4d96-ace6-336caedc1e29 1073741824" returned: 0 in 1.036s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-92409692-02fa-4a5a-a137-f7f464136866 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e5926707-7997-4d96-ace6-336caedc1e29 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:33 devstack sudo[106035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e5926707-7997-4d96-ace6-336caedc1e29 Jul 08 02:04:33 devstack sudo[106035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:34 devstack sudo[106031]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f88ce5c9-e1fd-4dc7-bdf8-fe500af8ea46 tempest-CreateVolumesFromImageTest-193126103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-66d77387-4f36-44bf-8f76-0b33d163a047" returned: 0 in 0.789s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:34 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-f88ce5c9-e1fd-4dc7-bdf8-fe500af8ea46 tempest-CreateVolumesFromImageTest-193126103 None] Lock "cinder-quobyte-66d77387-4f36-44bf-8f76-0b33d163a047" released by "delete_volume" :: held 1.772s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:04:34 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-f88ce5c9-e1fd-4dc7-bdf8-fe500af8ea46 tempest-CreateVolumesFromImageTest-193126103 None] Created reservations ['18363f3d-ee1a-4c84-b32b-22457800a415', 'b126e7ea-59d9-4fc9-aa20-07f6ca28e962', '028a2abd-82fc-41eb-a916-4c42ce6f014b', 'ad071f27-1860-4c25-aac5-29e456e0dc12'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:04:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-f88ce5c9-e1fd-4dc7-bdf8-fe500af8ea46 tempest-CreateVolumesFromImageTest-193126103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:04:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-f88ce5c9-e1fd-4dc7-bdf8-fe500af8ea46 tempest-CreateVolumesFromImageTest-193126103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:04:34 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-f88ce5c9-e1fd-4dc7-bdf8-fe500af8ea46 tempest-CreateVolumesFromImageTest-193126103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:04:34 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-f88ce5c9-e1fd-4dc7-bdf8-fe500af8ea46 tempest-CreateVolumesFromImageTest-193126103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:04:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-f88ce5c9-e1fd-4dc7-bdf8-fe500af8ea46 tempest-CreateVolumesFromImageTest-193126103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:04:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f88ce5c9-e1fd-4dc7-bdf8-fe500af8ea46 tempest-CreateVolumesFromImageTest-193126103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:34 devstack sudo[106038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 02:04:34 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:34 devstack sudo[106035]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-92409692-02fa-4a5a-a137-f7f464136866 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e5926707-7997-4d96-ace6-336caedc1e29" returned: 0 in 0.671s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:34 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-92409692-02fa-4a5a-a137-f7f464136866 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] <== create_volume: return (1765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:04:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-92409692-02fa-4a5a-a137-f7f464136866 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.768s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:04:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-8fe3089c-fdf4-49f6-8207-96b01a95d038 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.084s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:04:34 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-8fe3089c-fdf4-49f6-8207-96b01a95d038 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:04:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-713499319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e998505-1e68-4bf4-966a-cc0b1d46b32b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2cadb800e474072a5fbcf41df9c4c00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:04:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:04:21Z,use_quota=True,user_id='e04003fe878b4e6b8766372ced58f07c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:04:34 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-8fe3089c-fdf4-49f6-8207-96b01a95d038 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Creating volume 8e998505-1e68-4bf4-966a-cc0b1d46b32b {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:04:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-8fe3089c-fdf4-49f6-8207-96b01a95d038 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:04:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-8fe3089c-fdf4-49f6-8207-96b01a95d038 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:04:34 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-8fe3089c-fdf4-49f6-8207-96b01a95d038 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:04:34 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-8fe3089c-fdf4-49f6-8207-96b01a95d038 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:04:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-8fe3089c-fdf4-49f6-8207-96b01a95d038 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:04:34 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-8fe3089c-fdf4-49f6-8207-96b01a95d038 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:04:34 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-8fe3089c-fdf4-49f6-8207-96b01a95d038 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 02:04:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8fe3089c-fdf4-49f6-8207-96b01a95d038 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8e998505-1e68-4bf4-966a-cc0b1d46b32b 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:34 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-92409692-02fa-4a5a-a137-f7f464136866 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aa0e291-09a6-4c7c-931c-8b83a34a6942) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5926707-7997-4d96-ace6-336caedc1e29', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:34 devstack sudo[106041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8e998505-1e68-4bf4-966a-cc0b1d46b32b 1073741824 Jul 08 02:04:34 devstack sudo[106041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:34 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-92409692-02fa-4a5a-a137-f7f464136866 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (033b8bbc-d7d5-4d87-9954-19a24ae60e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:34 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-92409692-02fa-4a5a-a137-f7f464136866 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Volume volume-e5926707-7997-4d96-ace6-336caedc1e29 (e5926707-7997-4d96-ace6-336caedc1e29): created successfully Jul 08 02:04:34 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-92409692-02fa-4a5a-a137-f7f464136866 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (033b8bbc-d7d5-4d87-9954-19a24ae60e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:34 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-92409692-02fa-4a5a-a137-f7f464136866 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Flow 'volume_create_manager' (7021b694-a387-45ed-ac03-0d6e7a588fdd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:04:34 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-92409692-02fa-4a5a-a137-f7f464136866 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Created volume successfully. Jul 08 02:04:34 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-57761e4c-afd3-494e-b24e-7a85817697e9 tempest-CreateVolumesFromImageTest-193126103 None] Acquiring lock "cinder-6b444f07-ebc6-4177-bd19-96152dc849a7-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:04:34 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-57761e4c-afd3-494e-b24e-7a85817697e9 tempest-CreateVolumesFromImageTest-193126103 None] Lock "cinder-6b444f07-ebc6-4177-bd19-96152dc849a7-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:04:34 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-57761e4c-afd3-494e-b24e-7a85817697e9 tempest-CreateVolumesFromImageTest-193126103 None] Acquiring lock "cinder-quobyte-6b444f07-ebc6-4177-bd19-96152dc849a7" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:04:34 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-57761e4c-afd3-494e-b24e-7a85817697e9 tempest-CreateVolumesFromImageTest-193126103 None] Lock "cinder-quobyte-6b444f07-ebc6-4177-bd19-96152dc849a7" acquired by "delete_volume" :: waited 0.016s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:04:34 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a55439-7d64-40bf-b370-b7a51bc6d130]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:04:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-57761e4c-afd3-494e-b24e-7a85817697e9 tempest-CreateVolumesFromImageTest-193126103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-6b444f07-ebc6-4177-bd19-96152dc849a7 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:34 devstack sudo[106043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-6b444f07-ebc6-4177-bd19-96152dc849a7 Jul 08 02:04:34 devstack sudo[106043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:35 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f88ce5c9-e1fd-4dc7-bdf8-fe500af8ea46 tempest-CreateVolumesFromImageTest-193126103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.827s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:35 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-f88ce5c9-e1fd-4dc7-bdf8-fe500af8ea46 tempest-CreateVolumesFromImageTest-193126103 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:04:35 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-f88ce5c9-e1fd-4dc7-bdf8-fe500af8ea46 tempest-CreateVolumesFromImageTest-193126103 None] Deleted volume successfully. Jul 08 02:04:35 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-f88ce5c9-e1fd-4dc7-bdf8-fe500af8ea46 tempest-CreateVolumesFromImageTest-193126103 None] Lock "cinder-66d77387-4f36-44bf-8f76-0b33d163a047-delete_volume" released by "delete_volume" :: held 2.969s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:04:35 devstack sudo[106041]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8fe3089c-fdf4-49f6-8207-96b01a95d038 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8e998505-1e68-4bf4-966a-cc0b1d46b32b 1073741824" returned: 0 in 1.076s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8fe3089c-fdf4-49f6-8207-96b01a95d038 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8e998505-1e68-4bf4-966a-cc0b1d46b32b {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:35 devstack sudo[106050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8e998505-1e68-4bf4-966a-cc0b1d46b32b Jul 08 02:04:35 devstack sudo[106050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:35 devstack sudo[106043]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-57761e4c-afd3-494e-b24e-7a85817697e9 tempest-CreateVolumesFromImageTest-193126103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-6b444f07-ebc6-4177-bd19-96152dc849a7" returned: 0 in 0.901s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-57761e4c-afd3-494e-b24e-7a85817697e9 tempest-CreateVolumesFromImageTest-193126103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-6b444f07-ebc6-4177-bd19-96152dc849a7 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:35 devstack sudo[106054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-6b444f07-ebc6-4177-bd19-96152dc849a7 Jul 08 02:04:35 devstack sudo[106054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:36 devstack sudo[106050]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8fe3089c-fdf4-49f6-8207-96b01a95d038 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8e998505-1e68-4bf4-966a-cc0b1d46b32b" returned: 0 in 0.690s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:36 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-8fe3089c-fdf4-49f6-8207-96b01a95d038 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] <== create_volume: return (1812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:04:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-8fe3089c-fdf4-49f6-8207-96b01a95d038 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.815s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:04:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-2c94e279-1fc4-44ac-8965-1236a61b2f6b tempest-VolumeImageDependencyTests-2073805245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.687s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:04:36 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-2c94e279-1fc4-44ac-8965-1236a61b2f6b tempest-VolumeImageDependencyTests-2073805245 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:04:19Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c72c0d9-253c-4db7-8255-3874f51e6c3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='486b39d7801645518f19c8d6aa5fc1ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:04:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:04:20Z,use_quota=True,user_id='2c8af564cbde434aa6b1595e1e36da33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:04:36 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-2c94e279-1fc4-44ac-8965-1236a61b2f6b tempest-VolumeImageDependencyTests-2073805245 None] Creating volume 3c72c0d9-253c-4db7-8255-3874f51e6c3d {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:04:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-2c94e279-1fc4-44ac-8965-1236a61b2f6b tempest-VolumeImageDependencyTests-2073805245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:04:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-2c94e279-1fc4-44ac-8965-1236a61b2f6b tempest-VolumeImageDependencyTests-2073805245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:04:36 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-2c94e279-1fc4-44ac-8965-1236a61b2f6b tempest-VolumeImageDependencyTests-2073805245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:04:36 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-2c94e279-1fc4-44ac-8965-1236a61b2f6b tempest-VolumeImageDependencyTests-2073805245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:04:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-2c94e279-1fc4-44ac-8965-1236a61b2f6b tempest-VolumeImageDependencyTests-2073805245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:04:36 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-2c94e279-1fc4-44ac-8965-1236a61b2f6b tempest-VolumeImageDependencyTests-2073805245 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:04:36 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-2c94e279-1fc4-44ac-8965-1236a61b2f6b tempest-VolumeImageDependencyTests-2073805245 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 02:04:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2c94e279-1fc4-44ac-8965-1236a61b2f6b tempest-VolumeImageDependencyTests-2073805245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3c72c0d9-253c-4db7-8255-3874f51e6c3d 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:36 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8fe3089c-fdf4-49f6-8207-96b01a95d038 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3b767de-03f8-41be-b70b-0679c768f075) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e998505-1e68-4bf4-966a-cc0b1d46b32b', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:36 devstack sudo[106057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3c72c0d9-253c-4db7-8255-3874f51e6c3d 1073741824 Jul 08 02:04:36 devstack sudo[106057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:36 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8fe3089c-fdf4-49f6-8207-96b01a95d038 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6e57dfd-0b99-4f75-9cfc-7fe5434374cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:36 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-8fe3089c-fdf4-49f6-8207-96b01a95d038 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Volume volume-8e998505-1e68-4bf4-966a-cc0b1d46b32b (8e998505-1e68-4bf4-966a-cc0b1d46b32b): created successfully Jul 08 02:04:36 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8fe3089c-fdf4-49f6-8207-96b01a95d038 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6e57dfd-0b99-4f75-9cfc-7fe5434374cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:36 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-8fe3089c-fdf4-49f6-8207-96b01a95d038 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Flow 'volume_create_manager' (2e0e1b42-09bd-4037-aca0-d38e4cbc20db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:04:36 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-8fe3089c-fdf4-49f6-8207-96b01a95d038 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Created volume successfully. Jul 08 02:04:36 devstack sudo[106054]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-57761e4c-afd3-494e-b24e-7a85817697e9 tempest-CreateVolumesFromImageTest-193126103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-6b444f07-ebc6-4177-bd19-96152dc849a7" returned: 0 in 0.756s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:36 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-57761e4c-afd3-494e-b24e-7a85817697e9 tempest-CreateVolumesFromImageTest-193126103 None] Lock "cinder-quobyte-6b444f07-ebc6-4177-bd19-96152dc849a7" released by "delete_volume" :: held 1.723s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:04:36 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-57761e4c-afd3-494e-b24e-7a85817697e9 tempest-CreateVolumesFromImageTest-193126103 None] Created reservations ['573d477b-da83-4d91-ab40-378802353797', 'f791cb65-4a1b-4adc-ba21-21ffcd05d0cb', 'ea25eaad-6a9b-4c3c-8873-8af52b2d41d6', 'ed21ec59-5b45-41c6-84cb-13a3afa1e130'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:04:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-57761e4c-afd3-494e-b24e-7a85817697e9 tempest-CreateVolumesFromImageTest-193126103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:04:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-57761e4c-afd3-494e-b24e-7a85817697e9 tempest-CreateVolumesFromImageTest-193126103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:04:36 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-57761e4c-afd3-494e-b24e-7a85817697e9 tempest-CreateVolumesFromImageTest-193126103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:04:36 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-57761e4c-afd3-494e-b24e-7a85817697e9 tempest-CreateVolumesFromImageTest-193126103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:04:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-57761e4c-afd3-494e-b24e-7a85817697e9 tempest-CreateVolumesFromImageTest-193126103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:04:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-57761e4c-afd3-494e-b24e-7a85817697e9 tempest-CreateVolumesFromImageTest-193126103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:36 devstack sudo[106060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 02:04:36 devstack sudo[106060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:36 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-caa89228-575f-4dfa-b0d9-5b009ad19b30 tempest-CreateVolumesFromImageTest-193126103 None] Acquiring lock "cinder-7fada77a-d414-433b-aba4-7d9b493c9990-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:04:37 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-caa89228-575f-4dfa-b0d9-5b009ad19b30 tempest-CreateVolumesFromImageTest-193126103 None] Lock "cinder-7fada77a-d414-433b-aba4-7d9b493c9990-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:04:37 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-caa89228-575f-4dfa-b0d9-5b009ad19b30 tempest-CreateVolumesFromImageTest-193126103 None] Acquiring lock "cinder-quobyte-7fada77a-d414-433b-aba4-7d9b493c9990" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:04:37 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-caa89228-575f-4dfa-b0d9-5b009ad19b30 tempest-CreateVolumesFromImageTest-193126103 None] Lock "cinder-quobyte-7fada77a-d414-433b-aba4-7d9b493c9990" acquired by "delete_volume" :: waited 0.016s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:04:37 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[50772d05-6db1-4f24-9407-8c0d2b5375b7]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:04:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-caa89228-575f-4dfa-b0d9-5b009ad19b30 tempest-CreateVolumesFromImageTest-193126103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7fada77a-d414-433b-aba4-7d9b493c9990 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:37 devstack sudo[106066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7fada77a-d414-433b-aba4-7d9b493c9990 Jul 08 02:04:37 devstack sudo[106066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:37 devstack sudo[106057]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2c94e279-1fc4-44ac-8965-1236a61b2f6b tempest-VolumeImageDependencyTests-2073805245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3c72c0d9-253c-4db7-8255-3874f51e6c3d 1073741824" returned: 0 in 1.012s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2c94e279-1fc4-44ac-8965-1236a61b2f6b tempest-VolumeImageDependencyTests-2073805245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3c72c0d9-253c-4db7-8255-3874f51e6c3d {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:37 devstack sudo[106060]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-57761e4c-afd3-494e-b24e-7a85817697e9 tempest-CreateVolumesFromImageTest-193126103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.721s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:37 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-57761e4c-afd3-494e-b24e-7a85817697e9 tempest-CreateVolumesFromImageTest-193126103 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:04:37 devstack sudo[106069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3c72c0d9-253c-4db7-8255-3874f51e6c3d Jul 08 02:04:37 devstack sudo[106069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:37 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-57761e4c-afd3-494e-b24e-7a85817697e9 tempest-CreateVolumesFromImageTest-193126103 None] Deleted volume successfully. Jul 08 02:04:37 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-57761e4c-afd3-494e-b24e-7a85817697e9 tempest-CreateVolumesFromImageTest-193126103 None] Lock "cinder-6b444f07-ebc6-4177-bd19-96152dc849a7-delete_volume" released by "delete_volume" :: held 2.686s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:04:37 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-8311ffee-c573-4534-837b-b10e0f34c61c tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Acquiring lock "cinder-8e998505-1e68-4bf4-966a-cc0b1d46b32b-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:04:37 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-8311ffee-c573-4534-837b-b10e0f34c61c tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Lock "cinder-8e998505-1e68-4bf4-966a-cc0b1d46b32b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:04:37 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-8311ffee-c573-4534-837b-b10e0f34c61c tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Acquiring lock "cinder-quobyte-8e998505-1e68-4bf4-966a-cc0b1d46b32b" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:04:37 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-8311ffee-c573-4534-837b-b10e0f34c61c tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Lock "cinder-quobyte-8e998505-1e68-4bf4-966a-cc0b1d46b32b" acquired by "delete_volume" :: waited 0.017s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:04:37 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3f5d01-2614-4620-a41b-425c04fe1fd6]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:04:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8311ffee-c573-4534-837b-b10e0f34c61c tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8e998505-1e68-4bf4-966a-cc0b1d46b32b {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:37 devstack sudo[106071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8e998505-1e68-4bf4-966a-cc0b1d46b32b Jul 08 02:04:37 devstack sudo[106071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:37 devstack sudo[106066]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-caa89228-575f-4dfa-b0d9-5b009ad19b30 tempest-CreateVolumesFromImageTest-193126103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7fada77a-d414-433b-aba4-7d9b493c9990" returned: 0 in 0.879s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-caa89228-575f-4dfa-b0d9-5b009ad19b30 tempest-CreateVolumesFromImageTest-193126103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7fada77a-d414-433b-aba4-7d9b493c9990 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:38 devstack sudo[106077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7fada77a-d414-433b-aba4-7d9b493c9990 Jul 08 02:04:38 devstack sudo[106077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:38 devstack sudo[106069]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2c94e279-1fc4-44ac-8965-1236a61b2f6b tempest-VolumeImageDependencyTests-2073805245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3c72c0d9-253c-4db7-8255-3874f51e6c3d" returned: 0 in 0.675s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:38 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-2c94e279-1fc4-44ac-8965-1236a61b2f6b tempest-VolumeImageDependencyTests-2073805245 None] <== create_volume: return (1754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:04:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-2c94e279-1fc4-44ac-8965-1236a61b2f6b tempest-VolumeImageDependencyTests-2073805245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.758s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:04:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-32f069d6-6bc3-4709-b768-aba491f5f164 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.849s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:04:38 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-32f069d6-6bc3-4709-b768-aba491f5f164 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:04:20Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2fce024-0a9f-40bf-97a0-8f974fbb43de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79e3c1a92b214f009b68e2e92edd2d2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:04:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:04:21Z,use_quota=True,user_id='dc398523bb684249a7b24e3fdbba43d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e05ea9cb-bafb-4c65-875f-9bc810c3cb0e),volume_type_id=e05ea9cb-bafb-4c65-875f-9bc810c3cb0e)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:04:38 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-32f069d6-6bc3-4709-b768-aba491f5f164 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] Creating volume e2fce024-0a9f-40bf-97a0-8f974fbb43de {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:04:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-32f069d6-6bc3-4709-b768-aba491f5f164 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:04:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-32f069d6-6bc3-4709-b768-aba491f5f164 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:04:38 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-32f069d6-6bc3-4709-b768-aba491f5f164 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:04:38 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-32f069d6-6bc3-4709-b768-aba491f5f164 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:04:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-32f069d6-6bc3-4709-b768-aba491f5f164 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:04:38 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-32f069d6-6bc3-4709-b768-aba491f5f164 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:04:38 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-32f069d6-6bc3-4709-b768-aba491f5f164 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 02:04:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-32f069d6-6bc3-4709-b768-aba491f5f164 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e2fce024-0a9f-40bf-97a0-8f974fbb43de 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:38 devstack sudo[106079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e2fce024-0a9f-40bf-97a0-8f974fbb43de 1073741824 Jul 08 02:04:38 devstack sudo[106079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:38 devstack cinder-volume[87134]: DEBUG cinder.volume.volume_utils [None req-2c94e279-1fc4-44ac-8965-1236a61b2f6b tempest-VolumeImageDependencyTests-2073805245 None] Attempting download of 7acfc39f-06af-4d17-8e9e-f8f8dadb6f5f ((None, [{'url': 'file:///opt/stack/data/glance/images/7acfc39f-06af-4d17-8e9e-f8f8dadb6f5f', 'metadata': {}}])) to volume 3c72c0d9-253c-4db7-8255-3874f51e6c3d. {{(pid=87134) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 02:04:38 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b998eb-bb2d-4b97-8188-60be0925ed8b]: (4, 'raw') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:04:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2c94e279-1fc4-44ac-8965-1236a61b2f6b tempest-VolumeImageDependencyTests-2073805245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7acfc39f-06af-4d17-8e9e-f8f8dadb6f5f_0b76nxup {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:38 devstack sudo[106081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7acfc39f-06af-4d17-8e9e-f8f8dadb6f5f_0b76nxup Jul 08 02:04:38 devstack sudo[106081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:38 devstack sudo[106071]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8311ffee-c573-4534-837b-b10e0f34c61c tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8e998505-1e68-4bf4-966a-cc0b1d46b32b" returned: 0 in 0.905s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8311ffee-c573-4534-837b-b10e0f34c61c tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8e998505-1e68-4bf4-966a-cc0b1d46b32b {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:38 devstack sudo[106087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8e998505-1e68-4bf4-966a-cc0b1d46b32b Jul 08 02:04:38 devstack sudo[106087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:38 devstack sudo[106077]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-caa89228-575f-4dfa-b0d9-5b009ad19b30 tempest-CreateVolumesFromImageTest-193126103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7fada77a-d414-433b-aba4-7d9b493c9990" returned: 0 in 0.874s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:38 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-caa89228-575f-4dfa-b0d9-5b009ad19b30 tempest-CreateVolumesFromImageTest-193126103 None] Lock "cinder-quobyte-7fada77a-d414-433b-aba4-7d9b493c9990" released by "delete_volume" :: held 1.802s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:04:38 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-caa89228-575f-4dfa-b0d9-5b009ad19b30 tempest-CreateVolumesFromImageTest-193126103 None] Created reservations ['d5113bba-484c-4ac5-aba8-a9493051f15d', '9352db8a-04ee-42a1-aa55-b5dfd464237f', '71a732fc-0c11-4144-bf8a-241521f448c6', 'b9c890e6-579c-4f32-91a1-1e67cb396a6a'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:04:39 devstack sudo[106081]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2c94e279-1fc4-44ac-8965-1236a61b2f6b tempest-VolumeImageDependencyTests-2073805245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7acfc39f-06af-4d17-8e9e-f8f8dadb6f5f_0b76nxup" returned: 0 in 0.871s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2c94e279-1fc4-44ac-8965-1236a61b2f6b tempest-VolumeImageDependencyTests-2073805245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7acfc39f-06af-4d17-8e9e-f8f8dadb6f5f_0b76nxup {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-caa89228-575f-4dfa-b0d9-5b009ad19b30 tempest-CreateVolumesFromImageTest-193126103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:04:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-caa89228-575f-4dfa-b0d9-5b009ad19b30 tempest-CreateVolumesFromImageTest-193126103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:04:39 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-caa89228-575f-4dfa-b0d9-5b009ad19b30 tempest-CreateVolumesFromImageTest-193126103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:04:39 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-caa89228-575f-4dfa-b0d9-5b009ad19b30 tempest-CreateVolumesFromImageTest-193126103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:04:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-caa89228-575f-4dfa-b0d9-5b009ad19b30 tempest-CreateVolumesFromImageTest-193126103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:04:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-caa89228-575f-4dfa-b0d9-5b009ad19b30 tempest-CreateVolumesFromImageTest-193126103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:39 devstack sudo[106097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 02:04:39 devstack sudo[106097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:39 devstack sudo[106096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7acfc39f-06af-4d17-8e9e-f8f8dadb6f5f_0b76nxup Jul 08 02:04:39 devstack sudo[106096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:39 devstack sudo[106079]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-32f069d6-6bc3-4709-b768-aba491f5f164 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e2fce024-0a9f-40bf-97a0-8f974fbb43de 1073741824" returned: 0 in 1.168s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-32f069d6-6bc3-4709-b768-aba491f5f164 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e2fce024-0a9f-40bf-97a0-8f974fbb43de {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:39 devstack sudo[106101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e2fce024-0a9f-40bf-97a0-8f974fbb43de Jul 08 02:04:39 devstack sudo[106101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:39 devstack sudo[106087]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8311ffee-c573-4534-837b-b10e0f34c61c tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8e998505-1e68-4bf4-966a-cc0b1d46b32b" returned: 0 in 0.813s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:39 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-8311ffee-c573-4534-837b-b10e0f34c61c tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Lock "cinder-quobyte-8e998505-1e68-4bf4-966a-cc0b1d46b32b" released by "delete_volume" :: held 1.776s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:04:39 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-8311ffee-c573-4534-837b-b10e0f34c61c tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Created reservations ['fc6994af-d66f-4fa9-956e-d92152ac3cea', '5af6caf5-fc3d-4aa7-aee8-f1a20cdb4f4b', '71218787-15ee-44fe-a823-0ae372017e5c', 'ade45985-075a-49e5-aaa3-b863e297117e'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:04:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-8311ffee-c573-4534-837b-b10e0f34c61c tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:04:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-8311ffee-c573-4534-837b-b10e0f34c61c tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:04:39 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-8311ffee-c573-4534-837b-b10e0f34c61c tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:04:39 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-8311ffee-c573-4534-837b-b10e0f34c61c tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:04:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-8311ffee-c573-4534-837b-b10e0f34c61c tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:04:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8311ffee-c573-4534-837b-b10e0f34c61c tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:39 devstack sudo[106103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 02:04:39 devstack sudo[106103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:39 devstack sudo[106097]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:39 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-ef3957ba-bc40-4715-8ce5-0b789a75ef6a tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Acquiring lock "cinder-e5926707-7997-4d96-ace6-336caedc1e29-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:04:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-caa89228-575f-4dfa-b0d9-5b009ad19b30 tempest-CreateVolumesFromImageTest-193126103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.829s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:39 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-caa89228-575f-4dfa-b0d9-5b009ad19b30 tempest-CreateVolumesFromImageTest-193126103 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:04:39 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-ef3957ba-bc40-4715-8ce5-0b789a75ef6a tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Lock "cinder-e5926707-7997-4d96-ace6-336caedc1e29-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:04:39 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-caa89228-575f-4dfa-b0d9-5b009ad19b30 tempest-CreateVolumesFromImageTest-193126103 None] Deleted volume successfully. Jul 08 02:04:39 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-caa89228-575f-4dfa-b0d9-5b009ad19b30 tempest-CreateVolumesFromImageTest-193126103 None] Lock "cinder-7fada77a-d414-433b-aba4-7d9b493c9990-delete_volume" released by "delete_volume" :: held 2.975s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:04:40 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-ef3957ba-bc40-4715-8ce5-0b789a75ef6a tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Acquiring lock "cinder-quobyte-e5926707-7997-4d96-ace6-336caedc1e29" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:04:40 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-ef3957ba-bc40-4715-8ce5-0b789a75ef6a tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Lock "cinder-quobyte-e5926707-7997-4d96-ace6-336caedc1e29" acquired by "delete_volume" :: waited 0.025s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:04:40 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1c586a-8f1d-4131-9488-1ade78a73d26]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:04:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ef3957ba-bc40-4715-8ce5-0b789a75ef6a tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e5926707-7997-4d96-ace6-336caedc1e29 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:40 devstack sudo[106106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e5926707-7997-4d96-ace6-336caedc1e29 Jul 08 02:04:40 devstack sudo[106106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:40 devstack sudo[106101]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-32f069d6-6bc3-4709-b768-aba491f5f164 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e2fce024-0a9f-40bf-97a0-8f974fbb43de" returned: 0 in 1.094s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:40 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-32f069d6-6bc3-4709-b768-aba491f5f164 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] <== create_volume: return (2335ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:04:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-32f069d6-6bc3-4709-b768-aba491f5f164 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.345s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:04:40 devstack sudo[106096]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2c94e279-1fc4-44ac-8965-1236a61b2f6b tempest-VolumeImageDependencyTests-2073805245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7acfc39f-06af-4d17-8e9e-f8f8dadb6f5f_0b76nxup" returned: 1 in 1.416s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2c94e279-1fc4-44ac-8965-1236a61b2f6b tempest-VolumeImageDependencyTests-2073805245 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7acfc39f-06af-4d17-8e9e-f8f8dadb6f5f_0b76nxup' failed. Not Retrying. {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 02:04:40 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[2352638a-53c3-4fd6-8c3e-ce8e2ce1b921]: (4, 'raw') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:04:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2c94e279-1fc4-44ac-8965-1236a61b2f6b tempest-VolumeImageDependencyTests-2073805245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7acfc39f-06af-4d17-8e9e-f8f8dadb6f5f_5jk2ejq9devstack@QuobyteHD {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:40 devstack cinder-volume[87134]: DEBUG cinder.volume.volume_utils [None req-32f069d6-6bc3-4709-b768-aba491f5f164 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] Attempting download of 8ff43535-3a40-4446-a28e-5fbde4a7e7cf ((None, [{'url': 'file:///opt/stack/data/glance/images/8ff43535-3a40-4446-a28e-5fbde4a7e7cf', 'metadata': {}}])) to volume e2fce024-0a9f-40bf-97a0-8f974fbb43de. {{(pid=87134) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 02:04:40 devstack sudo[106103]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8311ffee-c573-4534-837b-b10e0f34c61c tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.970s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:40 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-8311ffee-c573-4534-837b-b10e0f34c61c tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:04:40 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-8311ffee-c573-4534-837b-b10e0f34c61c tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Deleted volume successfully. Jul 08 02:04:40 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-8311ffee-c573-4534-837b-b10e0f34c61c tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Lock "cinder-8e998505-1e68-4bf4-966a-cc0b1d46b32b-delete_volume" released by "delete_volume" :: held 3.012s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:04:40 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b109a4-5257-4321-bb02-300c72eedd3b]: (4, 'raw') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:04:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-32f069d6-6bc3-4709-b768-aba491f5f164 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8ff43535-3a40-4446-a28e-5fbde4a7e7cf_v1z46y7r {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:40 devstack sudo[106112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7acfc39f-06af-4d17-8e9e-f8f8dadb6f5f_5jk2ejq9devstack@QuobyteHD Jul 08 02:04:40 devstack sudo[106112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:40 devstack sudo[106113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8ff43535-3a40-4446-a28e-5fbde4a7e7cf_v1z46y7r Jul 08 02:04:40 devstack sudo[106113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:41 devstack sudo[106106]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ef3957ba-bc40-4715-8ce5-0b789a75ef6a tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e5926707-7997-4d96-ace6-336caedc1e29" returned: 0 in 1.050s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ef3957ba-bc40-4715-8ce5-0b789a75ef6a tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e5926707-7997-4d96-ace6-336caedc1e29 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:41 devstack sudo[106119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e5926707-7997-4d96-ace6-336caedc1e29 Jul 08 02:04:41 devstack sudo[106119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:41 devstack sudo[106112]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2c94e279-1fc4-44ac-8965-1236a61b2f6b tempest-VolumeImageDependencyTests-2073805245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7acfc39f-06af-4d17-8e9e-f8f8dadb6f5f_5jk2ejq9devstack@QuobyteHD" returned: 0 in 0.966s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2c94e279-1fc4-44ac-8965-1236a61b2f6b tempest-VolumeImageDependencyTests-2073805245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7acfc39f-06af-4d17-8e9e-f8f8dadb6f5f_5jk2ejq9devstack@QuobyteHD {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:41 devstack sudo[106113]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-32f069d6-6bc3-4709-b768-aba491f5f164 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8ff43535-3a40-4446-a28e-5fbde4a7e7cf_v1z46y7r" returned: 0 in 0.976s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-32f069d6-6bc3-4709-b768-aba491f5f164 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8ff43535-3a40-4446-a28e-5fbde4a7e7cf_v1z46y7r {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:41 devstack sudo[106125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7acfc39f-06af-4d17-8e9e-f8f8dadb6f5f_5jk2ejq9devstack@QuobyteHD Jul 08 02:04:41 devstack sudo[106125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:41 devstack sudo[106126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8ff43535-3a40-4446-a28e-5fbde4a7e7cf_v1z46y7r Jul 08 02:04:41 devstack sudo[106126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:41 devstack sudo[106119]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ef3957ba-bc40-4715-8ce5-0b789a75ef6a tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e5926707-7997-4d96-ace6-336caedc1e29" returned: 0 in 0.811s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:41 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-ef3957ba-bc40-4715-8ce5-0b789a75ef6a tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Lock "cinder-quobyte-e5926707-7997-4d96-ace6-336caedc1e29" released by "delete_volume" :: held 1.916s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:04:42 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-ef3957ba-bc40-4715-8ce5-0b789a75ef6a tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Created reservations ['c61c6262-0930-4efd-9cb5-ff89e263c170', '289dbed1-3242-4ef9-8c2d-75c2e6a19309', '8cf4b605-b388-446a-ac7a-c761c1abd620', '0f6dfab6-3d98-47e2-83fa-f871973082c0'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:04:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-ef3957ba-bc40-4715-8ce5-0b789a75ef6a tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:04:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-ef3957ba-bc40-4715-8ce5-0b789a75ef6a tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:04:42 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-ef3957ba-bc40-4715-8ce5-0b789a75ef6a tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:04:42 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-ef3957ba-bc40-4715-8ce5-0b789a75ef6a tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:04:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-ef3957ba-bc40-4715-8ce5-0b789a75ef6a tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:04:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ef3957ba-bc40-4715-8ce5-0b789a75ef6a tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:42 devstack sudo[106133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 02:04:42 devstack sudo[106133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:42 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-2dc006b3-0e73-401d-89e6-9b0452d9089b tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Acquiring lock "cinder-1aaca542-90b7-4b2a-9fcf-b49cd0572052-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:04:42 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-2dc006b3-0e73-401d-89e6-9b0452d9089b tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Lock "cinder-1aaca542-90b7-4b2a-9fcf-b49cd0572052-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:04:42 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-2dc006b3-0e73-401d-89e6-9b0452d9089b tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Acquiring lock "cinder-quobyte-1aaca542-90b7-4b2a-9fcf-b49cd0572052" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:04:42 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-2dc006b3-0e73-401d-89e6-9b0452d9089b tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Lock "cinder-quobyte-1aaca542-90b7-4b2a-9fcf-b49cd0572052" acquired by "delete_volume" :: waited 0.034s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:04:42 devstack sudo[106125]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2c94e279-1fc4-44ac-8965-1236a61b2f6b tempest-VolumeImageDependencyTests-2073805245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7acfc39f-06af-4d17-8e9e-f8f8dadb6f5f_5jk2ejq9devstack@QuobyteHD" returned: 1 in 0.993s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2c94e279-1fc4-44ac-8965-1236a61b2f6b tempest-VolumeImageDependencyTests-2073805245 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7acfc39f-06af-4d17-8e9e-f8f8dadb6f5f_5jk2ejq9devstack@QuobyteHD' failed. Not Retrying. {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 02:04:42 devstack cinder-volume[87134]: DEBUG cinder.image.image_utils [None req-2c94e279-1fc4-44ac-8965-1236a61b2f6b tempest-VolumeImageDependencyTests-2073805245 None] 7acfc39f-06af-4d17-8e9e-f8f8dadb6f5f was raw, converting to raw {{(pid=87134) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 02:04:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2c94e279-1fc4-44ac-8965-1236a61b2f6b tempest-VolumeImageDependencyTests-2073805245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_7acfc39f-06af-4d17-8e9e-f8f8dadb6f5f_5jk2ejq9devstack@QuobyteHD /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3c72c0d9-253c-4db7-8255-3874f51e6c3d {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:42 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[175af754-e889-44ef-842c-4f7f7cc96a09]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:04:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2dc006b3-0e73-401d-89e6-9b0452d9089b tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1aaca542-90b7-4b2a-9fcf-b49cd0572052 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:42 devstack sudo[106136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_7acfc39f-06af-4d17-8e9e-f8f8dadb6f5f_5jk2ejq9devstack@QuobyteHD /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3c72c0d9-253c-4db7-8255-3874f51e6c3d Jul 08 02:04:42 devstack sudo[106136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:42 devstack sudo[106126]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-32f069d6-6bc3-4709-b768-aba491f5f164 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8ff43535-3a40-4446-a28e-5fbde4a7e7cf_v1z46y7r" returned: 1 in 1.066s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-32f069d6-6bc3-4709-b768-aba491f5f164 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8ff43535-3a40-4446-a28e-5fbde4a7e7cf_v1z46y7r' failed. Not Retrying. {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 02:04:42 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[7626c8e8-d356-4b92-a208-44342ec5ec0b]: (4, 'raw') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:04:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-32f069d6-6bc3-4709-b768-aba491f5f164 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8ff43535-3a40-4446-a28e-5fbde4a7e7cf_3iy8xby3devstack@QuobyteHD {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:42 devstack sudo[106138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1aaca542-90b7-4b2a-9fcf-b49cd0572052 Jul 08 02:04:42 devstack sudo[106138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:42 devstack sudo[106140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8ff43535-3a40-4446-a28e-5fbde4a7e7cf_3iy8xby3devstack@QuobyteHD Jul 08 02:04:42 devstack sudo[106140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:43 devstack sudo[106133]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ef3957ba-bc40-4715-8ce5-0b789a75ef6a tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.960s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:43 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-ef3957ba-bc40-4715-8ce5-0b789a75ef6a tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:04:43 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-ef3957ba-bc40-4715-8ce5-0b789a75ef6a tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Deleted volume successfully. Jul 08 02:04:43 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-ef3957ba-bc40-4715-8ce5-0b789a75ef6a tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Lock "cinder-e5926707-7997-4d96-ace6-336caedc1e29-delete_volume" released by "delete_volume" :: held 3.295s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:04:43 devstack sudo[106138]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2dc006b3-0e73-401d-89e6-9b0452d9089b tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1aaca542-90b7-4b2a-9fcf-b49cd0572052" returned: 0 in 1.184s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2dc006b3-0e73-401d-89e6-9b0452d9089b tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1aaca542-90b7-4b2a-9fcf-b49cd0572052 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:43 devstack sudo[106140]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-32f069d6-6bc3-4709-b768-aba491f5f164 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8ff43535-3a40-4446-a28e-5fbde4a7e7cf_3iy8xby3devstack@QuobyteHD" returned: 0 in 1.015s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-32f069d6-6bc3-4709-b768-aba491f5f164 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ff43535-3a40-4446-a28e-5fbde4a7e7cf_3iy8xby3devstack@QuobyteHD {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:43 devstack sudo[106155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1aaca542-90b7-4b2a-9fcf-b49cd0572052 Jul 08 02:04:43 devstack sudo[106155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:43 devstack sudo[106136]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2c94e279-1fc4-44ac-8965-1236a61b2f6b tempest-VolumeImageDependencyTests-2073805245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_7acfc39f-06af-4d17-8e9e-f8f8dadb6f5f_5jk2ejq9devstack@QuobyteHD /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3c72c0d9-253c-4db7-8255-3874f51e6c3d" returned: 0 in 1.364s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:43 devstack sudo[106156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ff43535-3a40-4446-a28e-5fbde4a7e7cf_3iy8xby3devstack@QuobyteHD Jul 08 02:04:43 devstack sudo[106156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:43 devstack cinder-volume[87134]: DEBUG cinder.image.image_utils [None req-2c94e279-1fc4-44ac-8965-1236a61b2f6b tempest-VolumeImageDependencyTests-2073805245 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7acfc39f-06af-4d17-8e9e-f8f8dadb6f5f_5jk2ejq9devstack@QuobyteHD, size 0.00 MB, duration 1.37 sec, destination /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3c72c0d9-253c-4db7-8255-3874f51e6c3d {{(pid=87134) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 02:04:43 devstack cinder-volume[87134]: INFO cinder.image.image_utils [None req-2c94e279-1fc4-44ac-8965-1236a61b2f6b tempest-VolumeImageDependencyTests-2073805245 None] Converted 0.00 MB image at 0.00 MB/s Jul 08 02:04:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2c94e279-1fc4-44ac-8965-1236a61b2f6b tempest-VolumeImageDependencyTests-2073805245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3c72c0d9-253c-4db7-8255-3874f51e6c3d 1G {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:43 devstack sudo[106159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3c72c0d9-253c-4db7-8255-3874f51e6c3d 1G Jul 08 02:04:43 devstack sudo[106159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:44 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-07bb8325-befb-417d-9c7f-042e10377e9d tempest-CreateVolumesFromSnapshotTest-778065099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:04:44 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-07bb8325-befb-417d-9c7f-042e10377e9d tempest-CreateVolumesFromSnapshotTest-778065099 None] Flow 'volume_create_manager' (74144978-7f32-4334-a21f-5e3839d28b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:04:44 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-07bb8325-befb-417d-9c7f-042e10377e9d tempest-CreateVolumesFromSnapshotTest-778065099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cccc703-2626-4841-87dc-6b69301ca046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:44 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-07bb8325-befb-417d-9c7f-042e10377e9d tempest-CreateVolumesFromSnapshotTest-778065099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cccc703-2626-4841-87dc-6b69301ca046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:04:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-386907230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed792afe-618f-4a3c-8993-912f727893df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f02a5261bd944faea216efeb11b45b0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:04:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:04:44Z,use_quota=True,user_id='cad3538bc79b443090178669c4c6b010',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:44 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-07bb8325-befb-417d-9c7f-042e10377e9d tempest-CreateVolumesFromSnapshotTest-778065099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e64672c6-a524-4bf8-95cc-fee2f537b7f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:44 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-07bb8325-befb-417d-9c7f-042e10377e9d tempest-CreateVolumesFromSnapshotTest-778065099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e64672c6-a524-4bf8-95cc-fee2f537b7f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:44 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-07bb8325-befb-417d-9c7f-042e10377e9d tempest-CreateVolumesFromSnapshotTest-778065099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60ddf730-a92a-448d-97fc-053b6f6352d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:44 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-07bb8325-befb-417d-9c7f-042e10377e9d tempest-CreateVolumesFromSnapshotTest-778065099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60ddf730-a92a-448d-97fc-053b6f6352d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed792afe-618f-4a3c-8993-912f727893df', 'volume_name': 'volume-ed792afe-618f-4a3c-8993-912f727893df', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:44 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-07bb8325-befb-417d-9c7f-042e10377e9d tempest-CreateVolumesFromSnapshotTest-778065099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b7fb42b-0027-4893-b188-a881169b9d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:44 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-07bb8325-befb-417d-9c7f-042e10377e9d tempest-CreateVolumesFromSnapshotTest-778065099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b7fb42b-0027-4893-b188-a881169b9d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:44 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-07bb8325-befb-417d-9c7f-042e10377e9d tempest-CreateVolumesFromSnapshotTest-778065099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ece226bd-47b2-44ee-9c47-646faeeea4d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:44 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-07bb8325-befb-417d-9c7f-042e10377e9d tempest-CreateVolumesFromSnapshotTest-778065099 None] Volume ed792afe-618f-4a3c-8993-912f727893df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed792afe-618f-4a3c-8993-912f727893df', 'volume_size': 1} Jul 08 02:04:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-07bb8325-befb-417d-9c7f-042e10377e9d tempest-CreateVolumesFromSnapshotTest-778065099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:04:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-07bb8325-befb-417d-9c7f-042e10377e9d tempest-CreateVolumesFromSnapshotTest-778065099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:04:44 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-07bb8325-befb-417d-9c7f-042e10377e9d tempest-CreateVolumesFromSnapshotTest-778065099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:04:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-386907230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed792afe-618f-4a3c-8993-912f727893df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f02a5261bd944faea216efeb11b45b0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:04:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:04:44Z,use_quota=True,user_id='cad3538bc79b443090178669c4c6b010',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:04:44 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-07bb8325-befb-417d-9c7f-042e10377e9d tempest-CreateVolumesFromSnapshotTest-778065099 None] Creating volume ed792afe-618f-4a3c-8993-912f727893df {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:04:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-07bb8325-befb-417d-9c7f-042e10377e9d tempest-CreateVolumesFromSnapshotTest-778065099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:04:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-07bb8325-befb-417d-9c7f-042e10377e9d tempest-CreateVolumesFromSnapshotTest-778065099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:04:44 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-07bb8325-befb-417d-9c7f-042e10377e9d tempest-CreateVolumesFromSnapshotTest-778065099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:04:44 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-07bb8325-befb-417d-9c7f-042e10377e9d tempest-CreateVolumesFromSnapshotTest-778065099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:04:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-07bb8325-befb-417d-9c7f-042e10377e9d tempest-CreateVolumesFromSnapshotTest-778065099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:04:44 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-07bb8325-befb-417d-9c7f-042e10377e9d tempest-CreateVolumesFromSnapshotTest-778065099 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:04:44 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-07bb8325-befb-417d-9c7f-042e10377e9d tempest-CreateVolumesFromSnapshotTest-778065099 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 02:04:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-07bb8325-befb-417d-9c7f-042e10377e9d tempest-CreateVolumesFromSnapshotTest-778065099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ed792afe-618f-4a3c-8993-912f727893df 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:44 devstack sudo[106161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ed792afe-618f-4a3c-8993-912f727893df 1073741824 Jul 08 02:04:44 devstack sudo[106161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:44 devstack sudo[106155]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2dc006b3-0e73-401d-89e6-9b0452d9089b tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1aaca542-90b7-4b2a-9fcf-b49cd0572052" returned: 0 in 0.929s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:44 devstack sudo[106156]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-32f069d6-6bc3-4709-b768-aba491f5f164 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ff43535-3a40-4446-a28e-5fbde4a7e7cf_3iy8xby3devstack@QuobyteHD" returned: 1 in 0.927s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-32f069d6-6bc3-4709-b768-aba491f5f164 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ff43535-3a40-4446-a28e-5fbde4a7e7cf_3iy8xby3devstack@QuobyteHD' failed. Not Retrying. {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 02:04:44 devstack cinder-volume[87134]: DEBUG cinder.image.image_utils [None req-32f069d6-6bc3-4709-b768-aba491f5f164 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] 8ff43535-3a40-4446-a28e-5fbde4a7e7cf was raw, converting to raw {{(pid=87134) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 02:04:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-32f069d6-6bc3-4709-b768-aba491f5f164 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8ff43535-3a40-4446-a28e-5fbde4a7e7cf_3iy8xby3devstack@QuobyteHD /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e2fce024-0a9f-40bf-97a0-8f974fbb43de {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:44 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-2dc006b3-0e73-401d-89e6-9b0452d9089b tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Lock "cinder-quobyte-1aaca542-90b7-4b2a-9fcf-b49cd0572052" released by "delete_volume" :: held 2.227s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:04:44 devstack sudo[106159]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2c94e279-1fc4-44ac-8965-1236a61b2f6b tempest-VolumeImageDependencyTests-2073805245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3c72c0d9-253c-4db7-8255-3874f51e6c3d 1G" returned: 0 in 0.829s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:44 devstack sudo[106170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8ff43535-3a40-4446-a28e-5fbde4a7e7cf_3iy8xby3devstack@QuobyteHD /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e2fce024-0a9f-40bf-97a0-8f974fbb43de Jul 08 02:04:44 devstack sudo[106170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:44 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[d564efb6-9da8-47d7-9392-1a655c61f294]: (4, 'raw') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:04:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2c94e279-1fc4-44ac-8965-1236a61b2f6b tempest-VolumeImageDependencyTests-2073805245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3c72c0d9-253c-4db7-8255-3874f51e6c3d {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:44 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-2dc006b3-0e73-401d-89e6-9b0452d9089b tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Created reservations ['1af359e6-5aa4-4b34-b7d4-97bfc58f73b9', '573a0ee9-5c6c-443e-8964-8562bce0e306', '7d791598-ecc4-4622-a73b-3c39827445ca', 'b6755ad2-5b15-4896-b31c-9a392c120a48'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:04:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-2dc006b3-0e73-401d-89e6-9b0452d9089b tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:04:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-2dc006b3-0e73-401d-89e6-9b0452d9089b tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:04:44 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-2dc006b3-0e73-401d-89e6-9b0452d9089b tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:04:44 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-2dc006b3-0e73-401d-89e6-9b0452d9089b tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:04:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-2dc006b3-0e73-401d-89e6-9b0452d9089b tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:04:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2dc006b3-0e73-401d-89e6-9b0452d9089b tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:44 devstack sudo[106173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 02:04:44 devstack sudo[106173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:44 devstack sudo[106172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3c72c0d9-253c-4db7-8255-3874f51e6c3d Jul 08 02:04:44 devstack sudo[106172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:45 devstack sudo[106161]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-07bb8325-befb-417d-9c7f-042e10377e9d tempest-CreateVolumesFromSnapshotTest-778065099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ed792afe-618f-4a3c-8993-912f727893df 1073741824" returned: 0 in 1.042s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-07bb8325-befb-417d-9c7f-042e10377e9d tempest-CreateVolumesFromSnapshotTest-778065099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ed792afe-618f-4a3c-8993-912f727893df {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:45 devstack sudo[106181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ed792afe-618f-4a3c-8993-912f727893df Jul 08 02:04:45 devstack sudo[106181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:45 devstack sudo[106170]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-32f069d6-6bc3-4709-b768-aba491f5f164 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8ff43535-3a40-4446-a28e-5fbde4a7e7cf_3iy8xby3devstack@QuobyteHD /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e2fce024-0a9f-40bf-97a0-8f974fbb43de" returned: 0 in 1.021s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:45 devstack cinder-volume[87134]: DEBUG cinder.image.image_utils [None req-32f069d6-6bc3-4709-b768-aba491f5f164 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8ff43535-3a40-4446-a28e-5fbde4a7e7cf_3iy8xby3devstack@QuobyteHD, size 0.00 MB, duration 1.02 sec, destination /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e2fce024-0a9f-40bf-97a0-8f974fbb43de {{(pid=87134) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 02:04:45 devstack cinder-volume[87134]: INFO cinder.image.image_utils [None req-32f069d6-6bc3-4709-b768-aba491f5f164 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] Converted 0.00 MB image at 0.00 MB/s Jul 08 02:04:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-32f069d6-6bc3-4709-b768-aba491f5f164 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e2fce024-0a9f-40bf-97a0-8f974fbb43de 1G {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:45 devstack sudo[106172]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2c94e279-1fc4-44ac-8965-1236a61b2f6b tempest-VolumeImageDependencyTests-2073805245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3c72c0d9-253c-4db7-8255-3874f51e6c3d" returned: 0 in 0.980s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2c94e279-1fc4-44ac-8965-1236a61b2f6b tempest-VolumeImageDependencyTests-2073805245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3c72c0d9-253c-4db7-8255-3874f51e6c3d {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:45 devstack sudo[106187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e2fce024-0a9f-40bf-97a0-8f974fbb43de 1G Jul 08 02:04:45 devstack sudo[106187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:45 devstack sudo[106173]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2dc006b3-0e73-401d-89e6-9b0452d9089b tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.896s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:45 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-2dc006b3-0e73-401d-89e6-9b0452d9089b tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:04:45 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-2dc006b3-0e73-401d-89e6-9b0452d9089b tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Deleted volume successfully. Jul 08 02:04:45 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-2f4c7dac-40fb-4b69-a7dc-eea19d5e5ed8 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Acquiring lock "cinder-1ded5792-df72-4160-89c4-4837a5e2f0b0-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:04:45 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-2f4c7dac-40fb-4b69-a7dc-eea19d5e5ed8 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Lock "cinder-1ded5792-df72-4160-89c4-4837a5e2f0b0-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:04:45 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-2dc006b3-0e73-401d-89e6-9b0452d9089b tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Lock "cinder-1aaca542-90b7-4b2a-9fcf-b49cd0572052-delete_volume" released by "delete_volume" :: held 3.545s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:04:45 devstack sudo[106189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3c72c0d9-253c-4db7-8255-3874f51e6c3d Jul 08 02:04:45 devstack sudo[106189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:45 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-2f4c7dac-40fb-4b69-a7dc-eea19d5e5ed8 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Acquiring lock "cinder-quobyte-1ded5792-df72-4160-89c4-4837a5e2f0b0" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:04:45 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-2f4c7dac-40fb-4b69-a7dc-eea19d5e5ed8 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Lock "cinder-quobyte-1ded5792-df72-4160-89c4-4837a5e2f0b0" acquired by "delete_volume" :: waited 0.034s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:04:46 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb00d15-dec4-4e27-9e9c-9db2cab7d09b]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:04:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2f4c7dac-40fb-4b69-a7dc-eea19d5e5ed8 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1ded5792-df72-4160-89c4-4837a5e2f0b0 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:46 devstack sudo[106191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1ded5792-df72-4160-89c4-4837a5e2f0b0 Jul 08 02:04:46 devstack sudo[106191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:46 devstack sudo[106181]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-07bb8325-befb-417d-9c7f-042e10377e9d tempest-CreateVolumesFromSnapshotTest-778065099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ed792afe-618f-4a3c-8993-912f727893df" returned: 0 in 0.879s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:46 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-07bb8325-befb-417d-9c7f-042e10377e9d tempest-CreateVolumesFromSnapshotTest-778065099 None] <== create_volume: return (2001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:04:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-07bb8325-befb-417d-9c7f-042e10377e9d tempest-CreateVolumesFromSnapshotTest-778065099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.004s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:04:46 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-07bb8325-befb-417d-9c7f-042e10377e9d tempest-CreateVolumesFromSnapshotTest-778065099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ece226bd-47b2-44ee-9c47-646faeeea4d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed792afe-618f-4a3c-8993-912f727893df', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:46 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-07bb8325-befb-417d-9c7f-042e10377e9d tempest-CreateVolumesFromSnapshotTest-778065099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b657046-faf7-40b9-b5f7-b48ec7bc7934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:46 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-07bb8325-befb-417d-9c7f-042e10377e9d tempest-CreateVolumesFromSnapshotTest-778065099 None] Volume volume-ed792afe-618f-4a3c-8993-912f727893df (ed792afe-618f-4a3c-8993-912f727893df): created successfully Jul 08 02:04:46 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-07bb8325-befb-417d-9c7f-042e10377e9d tempest-CreateVolumesFromSnapshotTest-778065099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b657046-faf7-40b9-b5f7-b48ec7bc7934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:46 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-07bb8325-befb-417d-9c7f-042e10377e9d tempest-CreateVolumesFromSnapshotTest-778065099 None] Flow 'volume_create_manager' (74144978-7f32-4334-a21f-5e3839d28b34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:04:46 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-07bb8325-befb-417d-9c7f-042e10377e9d tempest-CreateVolumesFromSnapshotTest-778065099 None] Created volume successfully. Jul 08 02:04:46 devstack sudo[106187]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-32f069d6-6bc3-4709-b768-aba491f5f164 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e2fce024-0a9f-40bf-97a0-8f974fbb43de 1G" returned: 0 in 0.886s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:46 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[17960028-9d5c-46da-8772-de02fe5d8085]: (4, 'raw') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:04:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-32f069d6-6bc3-4709-b768-aba491f5f164 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e2fce024-0a9f-40bf-97a0-8f974fbb43de {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:46 devstack sudo[106197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e2fce024-0a9f-40bf-97a0-8f974fbb43de Jul 08 02:04:46 devstack sudo[106197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:46 devstack sudo[106189]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2c94e279-1fc4-44ac-8965-1236a61b2f6b tempest-VolumeImageDependencyTests-2073805245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3c72c0d9-253c-4db7-8255-3874f51e6c3d" returned: 1 in 1.040s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2c94e279-1fc4-44ac-8965-1236a61b2f6b tempest-VolumeImageDependencyTests-2073805245 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3c72c0d9-253c-4db7-8255-3874f51e6c3d' failed. Not Retrying. {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 02:04:46 devstack cinder-volume[87134]: DEBUG cinder.volume.volume_utils [None req-2c94e279-1fc4-44ac-8965-1236a61b2f6b tempest-VolumeImageDependencyTests-2073805245 None] Downloaded image 7acfc39f-06af-4d17-8e9e-f8f8dadb6f5f ((None, [{'url': 'file:///opt/stack/data/glance/images/7acfc39f-06af-4d17-8e9e-f8f8dadb6f5f', 'metadata': {}}])) to volume 3c72c0d9-253c-4db7-8255-3874f51e6c3d successfully. {{(pid=87134) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 02:04:46 devstack cinder-volume[87134]: DEBUG cinder.image.image_utils [None req-2c94e279-1fc4-44ac-8965-1236a61b2f6b tempest-VolumeImageDependencyTests-2073805245 None] Temporary image 7acfc39f-06af-4d17-8e9e-f8f8dadb6f5f for user 2c8af564cbde434aa6b1595e1e36da33 is deleted. {{(pid=87134) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 02:04:46 devstack cinder-volume[87134]: DEBUG cinder.volume.volume_utils [None req-2c94e279-1fc4-44ac-8965-1236a61b2f6b tempest-VolumeImageDependencyTests-2073805245 None] Marking volume 3c72c0d9-253c-4db7-8255-3874f51e6c3d as bootable. {{(pid=87134) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 02:04:46 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c94e279-1fc4-44ac-8965-1236a61b2f6b tempest-VolumeImageDependencyTests-2073805245 None] Copying metadata from image 7acfc39f-06af-4d17-8e9e-f8f8dadb6f5f to 3c72c0d9-253c-4db7-8255-3874f51e6c3d. {{(pid=87134) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 02:04:46 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c94e279-1fc4-44ac-8965-1236a61b2f6b tempest-VolumeImageDependencyTests-2073805245 None] Creating volume glance metadata for volume 3c72c0d9-253c-4db7-8255-3874f51e6c3d backed by image 7acfc39f-06af-4d17-8e9e-f8f8dadb6f5f with: {'image_id': '7acfc39f-06af-4d17-8e9e-f8f8dadb6f5f', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '399c8bf3f3de985a0ad4e0c984f394e1', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87134) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 02:04:46 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-2c94e279-1fc4-44ac-8965-1236a61b2f6b tempest-VolumeImageDependencyTests-2073805245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27bed7d8-b63e-40f3-a8a2-9a83f688e3ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c72c0d9-253c-4db7-8255-3874f51e6c3d', 'volume_size': 1, 'image_id': '7acfc39f-06af-4d17-8e9e-f8f8dadb6f5f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7acfc39f-06af-4d17-8e9e-f8f8dadb6f5f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '399c8bf3f3de985a0ad4e0c984f394e1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '486b39d7801645518f19c8d6aa5fc1ad', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e0fd5c2da6234ae70ac6db6e7e2f7886301b516825780b40105dd88b9e9bab012d58afe068dfd56f5f4879df81124be91f765d9354cb77d9ce6cc18e8bdab632', 'id': '7acfc39f-06af-4d17-8e9e-f8f8dadb6f5f', 'created_at': datetime.datetime(2026, 7, 8, 0, 4, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 0, 4, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7acfc39f-06af-4d17-8e9e-f8f8dadb6f5f/file', 'properties': {}}, 'image_service': }' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:46 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-2c94e279-1fc4-44ac-8965-1236a61b2f6b tempest-VolumeImageDependencyTests-2073805245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b867b10-1fa3-4b9a-9366-2f9a7d83c0f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:46 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-2c94e279-1fc4-44ac-8965-1236a61b2f6b tempest-VolumeImageDependencyTests-2073805245 None] Volume volume-3c72c0d9-253c-4db7-8255-3874f51e6c3d (3c72c0d9-253c-4db7-8255-3874f51e6c3d): created successfully Jul 08 02:04:46 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-2c94e279-1fc4-44ac-8965-1236a61b2f6b tempest-VolumeImageDependencyTests-2073805245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b867b10-1fa3-4b9a-9366-2f9a7d83c0f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:46 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-2c94e279-1fc4-44ac-8965-1236a61b2f6b tempest-VolumeImageDependencyTests-2073805245 None] Flow 'volume_create_manager' (2fcca2d3-da6e-4e77-b972-d722fea11ce7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:04:46 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-2c94e279-1fc4-44ac-8965-1236a61b2f6b tempest-VolumeImageDependencyTests-2073805245 None] Created volume successfully. Jul 08 02:04:46 devstack sudo[106191]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2f4c7dac-40fb-4b69-a7dc-eea19d5e5ed8 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1ded5792-df72-4160-89c4-4837a5e2f0b0" returned: 0 in 0.899s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2f4c7dac-40fb-4b69-a7dc-eea19d5e5ed8 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1ded5792-df72-4160-89c4-4837a5e2f0b0 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:46 devstack sudo[106206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1ded5792-df72-4160-89c4-4837a5e2f0b0 Jul 08 02:04:46 devstack sudo[106206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:47 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-e8120b66-510b-4218-acd7-9ab8f5fba07e tempest-VolumeImageDependencyTests-2073805245 None] Acquiring lock "cinder-3c72c0d9-253c-4db7-8255-3874f51e6c3d-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:04:47 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-e8120b66-510b-4218-acd7-9ab8f5fba07e tempest-VolumeImageDependencyTests-2073805245 None] Lock "cinder-3c72c0d9-253c-4db7-8255-3874f51e6c3d-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:04:47 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-e8120b66-510b-4218-acd7-9ab8f5fba07e tempest-VolumeImageDependencyTests-2073805245 None] Acquiring lock "cinder-quobyte-3c72c0d9-253c-4db7-8255-3874f51e6c3d" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:04:47 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-e8120b66-510b-4218-acd7-9ab8f5fba07e tempest-VolumeImageDependencyTests-2073805245 None] Lock "cinder-quobyte-3c72c0d9-253c-4db7-8255-3874f51e6c3d" acquired by "delete_volume" :: waited 0.020s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:04:47 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2465125-8954-4d66-a9b5-34c8e3c2f1cb]: (4, 'raw') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:04:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e8120b66-510b-4218-acd7-9ab8f5fba07e tempest-VolumeImageDependencyTests-2073805245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3c72c0d9-253c-4db7-8255-3874f51e6c3d {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:47 devstack sudo[106197]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-32f069d6-6bc3-4709-b768-aba491f5f164 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e2fce024-0a9f-40bf-97a0-8f974fbb43de" returned: 0 in 0.956s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-32f069d6-6bc3-4709-b768-aba491f5f164 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e2fce024-0a9f-40bf-97a0-8f974fbb43de {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:47 devstack sudo[106210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3c72c0d9-253c-4db7-8255-3874f51e6c3d Jul 08 02:04:47 devstack sudo[106210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-fcf2a0ee-63ef-4642-a88b-d7412f8187d8 tempest-CreateVolumesFromSnapshotTest-778065099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:04:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-fcf2a0ee-63ef-4642-a88b-d7412f8187d8 tempest-CreateVolumesFromSnapshotTest-778065099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:04:47 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-fcf2a0ee-63ef-4642-a88b-d7412f8187d8 tempest-CreateVolumesFromSnapshotTest-778065099 None] Creating offline snapshot 457637e6-0f1b-4239-befd-9830c9f4284d of volume ed792afe-618f-4a3c-8993-912f727893df {{(pid=87134) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 02:04:47 devstack sudo[106211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e2fce024-0a9f-40bf-97a0-8f974fbb43de Jul 08 02:04:47 devstack sudo[106211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:47 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b36957-3356-4b6b-8995-fc0a1cd4fe4e]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:04:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-fcf2a0ee-63ef-4642-a88b-d7412f8187d8 tempest-CreateVolumesFromSnapshotTest-778065099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ed792afe-618f-4a3c-8993-912f727893df {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:47 devstack sudo[106206]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2f4c7dac-40fb-4b69-a7dc-eea19d5e5ed8 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1ded5792-df72-4160-89c4-4837a5e2f0b0" returned: 0 in 0.892s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:47 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-2f4c7dac-40fb-4b69-a7dc-eea19d5e5ed8 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Lock "cinder-quobyte-1ded5792-df72-4160-89c4-4837a5e2f0b0" released by "delete_volume" :: held 1.850s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:04:47 devstack sudo[106215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ed792afe-618f-4a3c-8993-912f727893df Jul 08 02:04:47 devstack sudo[106215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:47 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-2f4c7dac-40fb-4b69-a7dc-eea19d5e5ed8 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Created reservations ['05da63ad-d823-4702-b8c4-2ea7230e308e', 'ec378f45-8ea7-4490-99da-02d561902c5e', '083a8444-0a9c-4975-b77d-62aecc7a4014', 'cd99079f-9d7a-42ad-b89f-0f5411b62122'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:04:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-2f4c7dac-40fb-4b69-a7dc-eea19d5e5ed8 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:04:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-2f4c7dac-40fb-4b69-a7dc-eea19d5e5ed8 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:04:48 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-2f4c7dac-40fb-4b69-a7dc-eea19d5e5ed8 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:04:48 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-2f4c7dac-40fb-4b69-a7dc-eea19d5e5ed8 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:04:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-2f4c7dac-40fb-4b69-a7dc-eea19d5e5ed8 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:04:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2f4c7dac-40fb-4b69-a7dc-eea19d5e5ed8 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:48 devstack sudo[106217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 02:04:48 devstack sudo[106217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:48 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-e16d9c66-e341-4483-988b-18e1f4405dbe tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Acquiring lock "cinder-2a3bf812-e904-426d-92c4-4fdd3d65f702-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:04:48 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-e16d9c66-e341-4483-988b-18e1f4405dbe tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Lock "cinder-2a3bf812-e904-426d-92c4-4fdd3d65f702-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:04:48 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-e16d9c66-e341-4483-988b-18e1f4405dbe tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Acquiring lock "cinder-quobyte-2a3bf812-e904-426d-92c4-4fdd3d65f702" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:04:48 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-e16d9c66-e341-4483-988b-18e1f4405dbe tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Lock "cinder-quobyte-2a3bf812-e904-426d-92c4-4fdd3d65f702" acquired by "delete_volume" :: waited 0.041s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:04:48 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3091f63-27c5-4f8a-b7d4-8c800076a0e4]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:04:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e16d9c66-e341-4483-988b-18e1f4405dbe tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-2a3bf812-e904-426d-92c4-4fdd3d65f702 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:48 devstack sudo[106221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-2a3bf812-e904-426d-92c4-4fdd3d65f702 Jul 08 02:04:48 devstack sudo[106221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:48 devstack sudo[106211]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-32f069d6-6bc3-4709-b768-aba491f5f164 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e2fce024-0a9f-40bf-97a0-8f974fbb43de" returned: 1 in 1.182s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-32f069d6-6bc3-4709-b768-aba491f5f164 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e2fce024-0a9f-40bf-97a0-8f974fbb43de' failed. Not Retrying. {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 02:04:48 devstack cinder-volume[87134]: DEBUG cinder.volume.volume_utils [None req-32f069d6-6bc3-4709-b768-aba491f5f164 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] Downloaded image 8ff43535-3a40-4446-a28e-5fbde4a7e7cf ((None, [{'url': 'file:///opt/stack/data/glance/images/8ff43535-3a40-4446-a28e-5fbde4a7e7cf', 'metadata': {}}])) to volume e2fce024-0a9f-40bf-97a0-8f974fbb43de successfully. {{(pid=87134) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 02:04:48 devstack cinder-volume[87134]: DEBUG cinder.image.image_utils [None req-32f069d6-6bc3-4709-b768-aba491f5f164 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] Temporary image 8ff43535-3a40-4446-a28e-5fbde4a7e7cf for user dc398523bb684249a7b24e3fdbba43d4 is deleted. {{(pid=87134) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 02:04:48 devstack cinder-volume[87134]: DEBUG cinder.volume.volume_utils [None req-32f069d6-6bc3-4709-b768-aba491f5f164 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] Marking volume e2fce024-0a9f-40bf-97a0-8f974fbb43de as bootable. {{(pid=87134) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 02:04:48 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-32f069d6-6bc3-4709-b768-aba491f5f164 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] Copying metadata from image 8ff43535-3a40-4446-a28e-5fbde4a7e7cf to e2fce024-0a9f-40bf-97a0-8f974fbb43de. {{(pid=87134) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 02:04:48 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-32f069d6-6bc3-4709-b768-aba491f5f164 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] Creating volume glance metadata for volume e2fce024-0a9f-40bf-97a0-8f974fbb43de backed by image 8ff43535-3a40-4446-a28e-5fbde4a7e7cf with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '8ff43535-3a40-4446-a28e-5fbde4a7e7cf', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '12945d36d1743ab50a0bfa8aef89b4ad', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87134) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 02:04:48 devstack sudo[106210]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e8120b66-510b-4218-acd7-9ab8f5fba07e tempest-VolumeImageDependencyTests-2073805245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3c72c0d9-253c-4db7-8255-3874f51e6c3d" returned: 0 in 1.288s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e8120b66-510b-4218-acd7-9ab8f5fba07e tempest-VolumeImageDependencyTests-2073805245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3c72c0d9-253c-4db7-8255-3874f51e6c3d {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:48 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-32f069d6-6bc3-4709-b768-aba491f5f164 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7948b006-4420-456f-ad2b-cdc57ab342b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2fce024-0a9f-40bf-97a0-8f974fbb43de', 'volume_size': 1, 'image_id': '8ff43535-3a40-4446-a28e-5fbde4a7e7cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8ff43535-3a40-4446-a28e-5fbde4a7e7cf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '12945d36d1743ab50a0bfa8aef89b4ad', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '79e3c1a92b214f009b68e2e92edd2d2c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'eba9d9d17f35bac98826d6fda08b0aee23a8091b4062e1370e30f4871208878627d07bdbca27b348c97a0baf130c3ff40137f5013e5823875f3af86f2159d6de', 'id': '8ff43535-3a40-4446-a28e-5fbde4a7e7cf', 'created_at': datetime.datetime(2026, 7, 8, 0, 4, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 0, 4, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8ff43535-3a40-4446-a28e-5fbde4a7e7cf/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:48 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-32f069d6-6bc3-4709-b768-aba491f5f164 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecbd8648-c113-4955-9c87-45b487e7461b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:48 devstack sudo[106215]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-fcf2a0ee-63ef-4642-a88b-d7412f8187d8 tempest-CreateVolumesFromSnapshotTest-778065099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ed792afe-618f-4a3c-8993-912f727893df" returned: 0 in 1.227s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-fcf2a0ee-63ef-4642-a88b-d7412f8187d8 tempest-CreateVolumesFromSnapshotTest-778065099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ed792afe-618f-4a3c-8993-912f727893df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ed792afe-618f-4a3c-8993-912f727893df.457637e6-0f1b-4239-befd-9830c9f4284d 1G {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:48 devstack sudo[106229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3c72c0d9-253c-4db7-8255-3874f51e6c3d Jul 08 02:04:48 devstack sudo[106229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:48 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-32f069d6-6bc3-4709-b768-aba491f5f164 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] Volume volume-e2fce024-0a9f-40bf-97a0-8f974fbb43de (e2fce024-0a9f-40bf-97a0-8f974fbb43de): created successfully Jul 08 02:04:48 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-32f069d6-6bc3-4709-b768-aba491f5f164 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecbd8648-c113-4955-9c87-45b487e7461b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:48 devstack sudo[106232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ed792afe-618f-4a3c-8993-912f727893df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ed792afe-618f-4a3c-8993-912f727893df.457637e6-0f1b-4239-befd-9830c9f4284d 1G Jul 08 02:04:48 devstack sudo[106232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:48 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-32f069d6-6bc3-4709-b768-aba491f5f164 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] Flow 'volume_create_manager' (e9d99d3e-ef0f-4d74-ac3d-4576fa951a6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:04:49 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-32f069d6-6bc3-4709-b768-aba491f5f164 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] Created volume successfully. Jul 08 02:04:49 devstack sudo[106217]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:49 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2f4c7dac-40fb-4b69-a7dc-eea19d5e5ed8 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 1.072s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:49 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-2f4c7dac-40fb-4b69-a7dc-eea19d5e5ed8 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:04:49 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-2f4c7dac-40fb-4b69-a7dc-eea19d5e5ed8 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Deleted volume successfully. Jul 08 02:04:49 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-2f4c7dac-40fb-4b69-a7dc-eea19d5e5ed8 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Lock "cinder-1ded5792-df72-4160-89c4-4837a5e2f0b0-delete_volume" released by "delete_volume" :: held 3.298s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:04:49 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-5cfa401d-d0e1-4e3d-813b-0bb4c56fd296 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] Acquiring lock "cinder-e2fce024-0a9f-40bf-97a0-8f974fbb43de-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:04:49 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-5cfa401d-d0e1-4e3d-813b-0bb4c56fd296 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] Lock "cinder-e2fce024-0a9f-40bf-97a0-8f974fbb43de-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:04:49 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-5cfa401d-d0e1-4e3d-813b-0bb4c56fd296 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] Acquiring lock "cinder-quobyte-e2fce024-0a9f-40bf-97a0-8f974fbb43de" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:04:49 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-5cfa401d-d0e1-4e3d-813b-0bb4c56fd296 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] Lock "cinder-quobyte-e2fce024-0a9f-40bf-97a0-8f974fbb43de" acquired by "delete_volume" :: waited 0.020s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:04:49 devstack sudo[106221]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:49 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e16d9c66-e341-4483-988b-18e1f4405dbe tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-2a3bf812-e904-426d-92c4-4fdd3d65f702" returned: 0 in 1.057s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:49 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e16d9c66-e341-4483-988b-18e1f4405dbe tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-2a3bf812-e904-426d-92c4-4fdd3d65f702 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:49 devstack sudo[106238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-2a3bf812-e904-426d-92c4-4fdd3d65f702 Jul 08 02:04:49 devstack sudo[106238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:49 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec3d02e4-7bad-4064-8d75-802d04e56fd9]: (4, 'raw') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:04:49 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5cfa401d-d0e1-4e3d-813b-0bb4c56fd296 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e2fce024-0a9f-40bf-97a0-8f974fbb43de {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:49 devstack sudo[106240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e2fce024-0a9f-40bf-97a0-8f974fbb43de Jul 08 02:04:49 devstack sudo[106240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:49 devstack sudo[106229]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:49 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e8120b66-510b-4218-acd7-9ab8f5fba07e tempest-VolumeImageDependencyTests-2073805245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3c72c0d9-253c-4db7-8255-3874f51e6c3d" returned: 1 in 1.120s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:49 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e8120b66-510b-4218-acd7-9ab8f5fba07e tempest-VolumeImageDependencyTests-2073805245 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3c72c0d9-253c-4db7-8255-3874f51e6c3d' failed. Not Retrying. {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 02:04:49 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e8120b66-510b-4218-acd7-9ab8f5fba07e tempest-VolumeImageDependencyTests-2073805245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3c72c0d9-253c-4db7-8255-3874f51e6c3d {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:49 devstack sudo[106249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3c72c0d9-253c-4db7-8255-3874f51e6c3d Jul 08 02:04:49 devstack sudo[106249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:50 devstack sudo[106232]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:50 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-fcf2a0ee-63ef-4642-a88b-d7412f8187d8 tempest-CreateVolumesFromSnapshotTest-778065099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ed792afe-618f-4a3c-8993-912f727893df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ed792afe-618f-4a3c-8993-912f727893df.457637e6-0f1b-4239-befd-9830c9f4284d 1G" returned: 0 in 1.090s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:50 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-fcf2a0ee-63ef-4642-a88b-d7412f8187d8 tempest-CreateVolumesFromSnapshotTest-778065099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed792afe-618f-4a3c-8993-912f727893df -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ed792afe-618f-4a3c-8993-912f727893df.457637e6-0f1b-4239-befd-9830c9f4284d {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:50 devstack sudo[106251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed792afe-618f-4a3c-8993-912f727893df -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ed792afe-618f-4a3c-8993-912f727893df.457637e6-0f1b-4239-befd-9830c9f4284d Jul 08 02:04:50 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:50 devstack sudo[106238]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:50 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e16d9c66-e341-4483-988b-18e1f4405dbe tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-2a3bf812-e904-426d-92c4-4fdd3d65f702" returned: 0 in 0.799s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:50 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-e16d9c66-e341-4483-988b-18e1f4405dbe tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Lock "cinder-quobyte-2a3bf812-e904-426d-92c4-4fdd3d65f702" released by "delete_volume" :: held 1.941s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:04:50 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-e16d9c66-e341-4483-988b-18e1f4405dbe tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Created reservations ['1edc81c0-bead-4d45-aa77-1a549b87c972', '636ba120-101f-4dd8-bf7e-afbeb715aaa3', 'b65ed261-2b51-461f-a8ea-fb56cbc2d2dd', 'c4bb3a44-9272-409e-b107-d07c704a5bbb'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:04:50 devstack sudo[106240]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:50 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5cfa401d-d0e1-4e3d-813b-0bb4c56fd296 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e2fce024-0a9f-40bf-97a0-8f974fbb43de" returned: 0 in 0.841s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:50 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5cfa401d-d0e1-4e3d-813b-0bb4c56fd296 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e2fce024-0a9f-40bf-97a0-8f974fbb43de {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:50 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e16d9c66-e341-4483-988b-18e1f4405dbe tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:04:50 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e16d9c66-e341-4483-988b-18e1f4405dbe tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:04:50 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-e16d9c66-e341-4483-988b-18e1f4405dbe tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:04:50 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-e16d9c66-e341-4483-988b-18e1f4405dbe tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:04:50 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e16d9c66-e341-4483-988b-18e1f4405dbe tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:04:50 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e16d9c66-e341-4483-988b-18e1f4405dbe tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:50 devstack sudo[106256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e2fce024-0a9f-40bf-97a0-8f974fbb43de Jul 08 02:04:50 devstack sudo[106256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:50 devstack sudo[106258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 02:04:50 devstack sudo[106258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:50 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-457fd0fb-8e5b-483a-88c1-b2adbd7a86f8 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Acquiring lock "cinder-f4233b2f-ddf5-4238-a6fb-6290ec975f46-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:04:50 devstack sudo[106249]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:50 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-457fd0fb-8e5b-483a-88c1-b2adbd7a86f8 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Lock "cinder-f4233b2f-ddf5-4238-a6fb-6290ec975f46-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:04:50 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e8120b66-510b-4218-acd7-9ab8f5fba07e tempest-VolumeImageDependencyTests-2073805245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3c72c0d9-253c-4db7-8255-3874f51e6c3d" returned: 0 in 0.903s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:50 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-e8120b66-510b-4218-acd7-9ab8f5fba07e tempest-VolumeImageDependencyTests-2073805245 None] Lock "cinder-quobyte-3c72c0d9-253c-4db7-8255-3874f51e6c3d" released by "delete_volume" :: held 3.420s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:04:50 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-457fd0fb-8e5b-483a-88c1-b2adbd7a86f8 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Acquiring lock "cinder-quobyte-f4233b2f-ddf5-4238-a6fb-6290ec975f46" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:04:50 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-457fd0fb-8e5b-483a-88c1-b2adbd7a86f8 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Lock "cinder-quobyte-f4233b2f-ddf5-4238-a6fb-6290ec975f46" acquired by "delete_volume" :: waited 0.022s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:04:50 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c1975e5-bbc3-4084-bbaa-fac90db51280]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:04:50 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-457fd0fb-8e5b-483a-88c1-b2adbd7a86f8 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f4233b2f-ddf5-4238-a6fb-6290ec975f46 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:50 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-e8120b66-510b-4218-acd7-9ab8f5fba07e tempest-VolumeImageDependencyTests-2073805245 None] Created reservations ['35e3d23e-d370-49d6-adb7-45a4af414830', '10ad086d-fef9-4e44-ae25-3a2e01167fe0', 'a28e9053-44d0-4427-9cf8-b27273115e93', '2d67f96f-aec3-46d8-8963-b2e90ec821f2'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:04:51 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-fcf2a0ee-63ef-4642-a88b-d7412f8187d8 tempest-CreateVolumesFromSnapshotTest-778065099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed792afe-618f-4a3c-8993-912f727893df -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ed792afe-618f-4a3c-8993-912f727893df.457637e6-0f1b-4239-befd-9830c9f4284d" returned: 0 in 1.036s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:51 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-fcf2a0ee-63ef-4642-a88b-d7412f8187d8 tempest-CreateVolumesFromSnapshotTest-778065099 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ed792afe-618f-4a3c-8993-912f727893df.457637e6-0f1b-4239-befd-9830c9f4284d is being set with open permissions: ugo+rw Jul 08 02:04:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-fcf2a0ee-63ef-4642-a88b-d7412f8187d8 tempest-CreateVolumesFromSnapshotTest-778065099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ed792afe-618f-4a3c-8993-912f727893df.457637e6-0f1b-4239-befd-9830c9f4284d {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:51 devstack sudo[106264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f4233b2f-ddf5-4238-a6fb-6290ec975f46 Jul 08 02:04:51 devstack sudo[106264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:51 devstack sudo[106265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ed792afe-618f-4a3c-8993-912f727893df.457637e6-0f1b-4239-befd-9830c9f4284d Jul 08 02:04:51 devstack sudo[106265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e8120b66-510b-4218-acd7-9ab8f5fba07e tempest-VolumeImageDependencyTests-2073805245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:04:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e8120b66-510b-4218-acd7-9ab8f5fba07e tempest-VolumeImageDependencyTests-2073805245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:04:51 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-e8120b66-510b-4218-acd7-9ab8f5fba07e tempest-VolumeImageDependencyTests-2073805245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:04:51 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-e8120b66-510b-4218-acd7-9ab8f5fba07e tempest-VolumeImageDependencyTests-2073805245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:04:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e8120b66-510b-4218-acd7-9ab8f5fba07e tempest-VolumeImageDependencyTests-2073805245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:04:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e8120b66-510b-4218-acd7-9ab8f5fba07e tempest-VolumeImageDependencyTests-2073805245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:51 devstack sudo[106268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 02:04:51 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:51 devstack sudo[106256]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5cfa401d-d0e1-4e3d-813b-0bb4c56fd296 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e2fce024-0a9f-40bf-97a0-8f974fbb43de" returned: 1 in 1.135s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5cfa401d-d0e1-4e3d-813b-0bb4c56fd296 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e2fce024-0a9f-40bf-97a0-8f974fbb43de' failed. Not Retrying. {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 02:04:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5cfa401d-d0e1-4e3d-813b-0bb4c56fd296 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e2fce024-0a9f-40bf-97a0-8f974fbb43de {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:51 devstack sudo[106274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e2fce024-0a9f-40bf-97a0-8f974fbb43de Jul 08 02:04:51 devstack sudo[106274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:51 devstack sudo[106258]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e16d9c66-e341-4483-988b-18e1f4405dbe tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 1.088s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:51 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-e16d9c66-e341-4483-988b-18e1f4405dbe tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:04:51 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-e16d9c66-e341-4483-988b-18e1f4405dbe tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Deleted volume successfully. Jul 08 02:04:51 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-e16d9c66-e341-4483-988b-18e1f4405dbe tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Lock "cinder-2a3bf812-e904-426d-92c4-4fdd3d65f702-delete_volume" released by "delete_volume" :: held 3.442s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:04:52 devstack sudo[106265]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:52 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-fcf2a0ee-63ef-4642-a88b-d7412f8187d8 tempest-CreateVolumesFromSnapshotTest-778065099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ed792afe-618f-4a3c-8993-912f727893df.457637e6-0f1b-4239-befd-9830c9f4284d" returned: 0 in 1.036s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:52 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:52 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-fcf2a0ee-63ef-4642-a88b-d7412f8187d8 tempest-CreateVolumesFromSnapshotTest-778065099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ed792afe-618f-4a3c-8993-912f727893df.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:52 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e8120b66-510b-4218-acd7-9ab8f5fba07e tempest-VolumeImageDependencyTests-2073805245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 1.012s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:52 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-e8120b66-510b-4218-acd7-9ab8f5fba07e tempest-VolumeImageDependencyTests-2073805245 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:04:52 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-e8120b66-510b-4218-acd7-9ab8f5fba07e tempest-VolumeImageDependencyTests-2073805245 None] Deleted volume successfully. Jul 08 02:04:52 devstack sudo[106281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ed792afe-618f-4a3c-8993-912f727893df.info Jul 08 02:04:52 devstack sudo[106281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:52 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-e8120b66-510b-4218-acd7-9ab8f5fba07e tempest-VolumeImageDependencyTests-2073805245 None] Lock "cinder-3c72c0d9-253c-4db7-8255-3874f51e6c3d-delete_volume" released by "delete_volume" :: held 4.930s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:04:52 devstack sudo[106264]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:52 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-457fd0fb-8e5b-483a-88c1-b2adbd7a86f8 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f4233b2f-ddf5-4238-a6fb-6290ec975f46" returned: 0 in 1.407s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:52 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-457fd0fb-8e5b-483a-88c1-b2adbd7a86f8 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f4233b2f-ddf5-4238-a6fb-6290ec975f46 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:52 devstack sudo[106283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f4233b2f-ddf5-4238-a6fb-6290ec975f46 Jul 08 02:04:52 devstack sudo[106283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:52 devstack sudo[106274]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:52 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5cfa401d-d0e1-4e3d-813b-0bb4c56fd296 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e2fce024-0a9f-40bf-97a0-8f974fbb43de" returned: 0 in 1.098s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:52 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-5cfa401d-d0e1-4e3d-813b-0bb4c56fd296 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] Lock "cinder-quobyte-e2fce024-0a9f-40bf-97a0-8f974fbb43de" released by "delete_volume" :: held 3.181s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:04:52 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-5cfa401d-d0e1-4e3d-813b-0bb4c56fd296 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] Created reservations ['807eddc6-38ed-4150-a398-417a249d0b8b', 'bbb08ba4-765c-4019-9823-70276faa2d60', '68e83516-d1b7-455e-b584-ffb888788265', '23de283d-fd55-4822-a396-808cd542b7a2'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:04:52 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5cfa401d-d0e1-4e3d-813b-0bb4c56fd296 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:04:52 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5cfa401d-d0e1-4e3d-813b-0bb4c56fd296 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:04:52 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-5cfa401d-d0e1-4e3d-813b-0bb4c56fd296 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:04:52 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-5cfa401d-d0e1-4e3d-813b-0bb4c56fd296 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:04:52 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5cfa401d-d0e1-4e3d-813b-0bb4c56fd296 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:04:52 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5cfa401d-d0e1-4e3d-813b-0bb4c56fd296 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:52 devstack sudo[106286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 02:04:52 devstack sudo[106286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:52 devstack sudo[106281]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:52 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-fcf2a0ee-63ef-4642-a88b-d7412f8187d8 tempest-CreateVolumesFromSnapshotTest-778065099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ed792afe-618f-4a3c-8993-912f727893df.info" returned: 0 in 0.845s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:53 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-fcf2a0ee-63ef-4642-a88b-d7412f8187d8 tempest-CreateVolumesFromSnapshotTest-778065099 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ed792afe-618f-4a3c-8993-912f727893df.info is being set with open permissions: ugo+rw Jul 08 02:04:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-fcf2a0ee-63ef-4642-a88b-d7412f8187d8 tempest-CreateVolumesFromSnapshotTest-778065099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ed792afe-618f-4a3c-8993-912f727893df.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:53 devstack sudo[106289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ed792afe-618f-4a3c-8993-912f727893df.info Jul 08 02:04:53 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:53 devstack sudo[106283]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-457fd0fb-8e5b-483a-88c1-b2adbd7a86f8 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-f4233b2f-ddf5-4238-a6fb-6290ec975f46" returned: 0 in 0.897s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:53 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-457fd0fb-8e5b-483a-88c1-b2adbd7a86f8 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Lock "cinder-quobyte-f4233b2f-ddf5-4238-a6fb-6290ec975f46" released by "delete_volume" :: held 2.373s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:04:53 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-457fd0fb-8e5b-483a-88c1-b2adbd7a86f8 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Created reservations ['1feb1199-8b5f-47a0-b0f8-bb5f922af277', 'e820231e-83bd-411f-ac50-d4373219d6ca', '52d0a21a-91d0-46b6-975b-4d2db7e0149c', '7c10f0c9-bb51-4c65-9686-37babacfa6b0'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:04:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-457fd0fb-8e5b-483a-88c1-b2adbd7a86f8 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:04:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-457fd0fb-8e5b-483a-88c1-b2adbd7a86f8 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:04:53 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-457fd0fb-8e5b-483a-88c1-b2adbd7a86f8 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:04:53 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-457fd0fb-8e5b-483a-88c1-b2adbd7a86f8 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:04:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-457fd0fb-8e5b-483a-88c1-b2adbd7a86f8 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:04:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-457fd0fb-8e5b-483a-88c1-b2adbd7a86f8 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:53 devstack sudo[106293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 02:04:53 devstack sudo[106293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:53 devstack sudo[106286]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5cfa401d-d0e1-4e3d-813b-0bb4c56fd296 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.861s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:53 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-5cfa401d-d0e1-4e3d-813b-0bb4c56fd296 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:04:53 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-5cfa401d-d0e1-4e3d-813b-0bb4c56fd296 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] Deleted volume successfully. Jul 08 02:04:53 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-5cfa401d-d0e1-4e3d-813b-0bb4c56fd296 tempest-VolumeAndVolumeTypeFromImageTest-1122944317 None] Lock "cinder-e2fce024-0a9f-40bf-97a0-8f974fbb43de-delete_volume" released by "delete_volume" :: held 4.367s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:04:54 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-fcf2a0ee-63ef-4642-a88b-d7412f8187d8 tempest-CreateVolumesFromSnapshotTest-778065099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ed792afe-618f-4a3c-8993-912f727893df.info" returned: 0 in 1.055s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-fcf2a0ee-63ef-4642-a88b-d7412f8187d8 tempest-CreateVolumesFromSnapshotTest-778065099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.449s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:04:54 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-fcf2a0ee-63ef-4642-a88b-d7412f8187d8 tempest-CreateVolumesFromSnapshotTest-778065099 None] Create snapshot completed successfully Jul 08 02:04:54 devstack sudo[106293]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-457fd0fb-8e5b-483a-88c1-b2adbd7a86f8 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.935s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:54 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-457fd0fb-8e5b-483a-88c1-b2adbd7a86f8 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:04:54 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-457fd0fb-8e5b-483a-88c1-b2adbd7a86f8 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Deleted volume successfully. Jul 08 02:04:54 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-457fd0fb-8e5b-483a-88c1-b2adbd7a86f8 tempest-CreateVolumesFromSourceVolumeTest-1067903415 None] Lock "cinder-f4233b2f-ddf5-4238-a6fb-6290ec975f46-delete_volume" released by "delete_volume" :: held 3.658s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:04:55 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2cb8962-9a7a-4064-a597-9bb41aa84ede tempest-CreateVolumesFromSnapshotTest-778065099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:04:55 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-d2cb8962-9a7a-4064-a597-9bb41aa84ede tempest-CreateVolumesFromSnapshotTest-778065099 None] Flow 'volume_create_manager' (17a9079e-e3f5-4943-a018-bb6fc2992d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:04:55 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-d2cb8962-9a7a-4064-a597-9bb41aa84ede tempest-CreateVolumesFromSnapshotTest-778065099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92804b52-cc1d-4ee1-88b5-621dade288bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:55 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-d2cb8962-9a7a-4064-a597-9bb41aa84ede tempest-CreateVolumesFromSnapshotTest-778065099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92804b52-cc1d-4ee1-88b5-621dade288bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:04:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-747000768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=976f07c3-8168-4e74-aa99-4618d4bb1c3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f02a5261bd944faea216efeb11b45b0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:04:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:04:56Z,use_quota=True,user_id='cad3538bc79b443090178669c4c6b010',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:55 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-d2cb8962-9a7a-4064-a597-9bb41aa84ede tempest-CreateVolumesFromSnapshotTest-778065099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6bc919d-22ab-4208-a5bd-fd9eff1e5e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:55 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-d2cb8962-9a7a-4064-a597-9bb41aa84ede tempest-CreateVolumesFromSnapshotTest-778065099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6bc919d-22ab-4208-a5bd-fd9eff1e5e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:55 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-d2cb8962-9a7a-4064-a597-9bb41aa84ede tempest-CreateVolumesFromSnapshotTest-778065099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (126e091c-807a-4ece-8707-d5e8d01da58a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:55 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-d2cb8962-9a7a-4064-a597-9bb41aa84ede tempest-CreateVolumesFromSnapshotTest-778065099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (126e091c-807a-4ece-8707-d5e8d01da58a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '976f07c3-8168-4e74-aa99-4618d4bb1c3f', 'volume_name': 'volume-976f07c3-8168-4e74-aa99-4618d4bb1c3f', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:55 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-d2cb8962-9a7a-4064-a597-9bb41aa84ede tempest-CreateVolumesFromSnapshotTest-778065099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (703bd447-60ed-4dd3-b6b0-088b01f63c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:55 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-d2cb8962-9a7a-4064-a597-9bb41aa84ede tempest-CreateVolumesFromSnapshotTest-778065099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (703bd447-60ed-4dd3-b6b0-088b01f63c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:55 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-d2cb8962-9a7a-4064-a597-9bb41aa84ede tempest-CreateVolumesFromSnapshotTest-778065099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17206735-e88e-4c9d-8d5d-53a2d27ba89c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:55 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-d2cb8962-9a7a-4064-a597-9bb41aa84ede tempest-CreateVolumesFromSnapshotTest-778065099 None] Volume 976f07c3-8168-4e74-aa99-4618d4bb1c3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-976f07c3-8168-4e74-aa99-4618d4bb1c3f', 'volume_size': 1} Jul 08 02:04:55 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-d2cb8962-9a7a-4064-a597-9bb41aa84ede tempest-CreateVolumesFromSnapshotTest-778065099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:04:55 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-d2cb8962-9a7a-4064-a597-9bb41aa84ede tempest-CreateVolumesFromSnapshotTest-778065099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:04:55 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-d2cb8962-9a7a-4064-a597-9bb41aa84ede tempest-CreateVolumesFromSnapshotTest-778065099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:04:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-747000768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=976f07c3-8168-4e74-aa99-4618d4bb1c3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f02a5261bd944faea216efeb11b45b0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:04:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:04:56Z,use_quota=True,user_id='cad3538bc79b443090178669c4c6b010',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:04:55 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-d2cb8962-9a7a-4064-a597-9bb41aa84ede tempest-CreateVolumesFromSnapshotTest-778065099 None] Creating volume 976f07c3-8168-4e74-aa99-4618d4bb1c3f {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:04:55 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-d2cb8962-9a7a-4064-a597-9bb41aa84ede tempest-CreateVolumesFromSnapshotTest-778065099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:04:55 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-d2cb8962-9a7a-4064-a597-9bb41aa84ede tempest-CreateVolumesFromSnapshotTest-778065099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:04:55 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-d2cb8962-9a7a-4064-a597-9bb41aa84ede tempest-CreateVolumesFromSnapshotTest-778065099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:04:55 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-d2cb8962-9a7a-4064-a597-9bb41aa84ede tempest-CreateVolumesFromSnapshotTest-778065099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:04:55 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-d2cb8962-9a7a-4064-a597-9bb41aa84ede tempest-CreateVolumesFromSnapshotTest-778065099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:04:55 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-d2cb8962-9a7a-4064-a597-9bb41aa84ede tempest-CreateVolumesFromSnapshotTest-778065099 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:04:55 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-d2cb8962-9a7a-4064-a597-9bb41aa84ede tempest-CreateVolumesFromSnapshotTest-778065099 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 02:04:55 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d2cb8962-9a7a-4064-a597-9bb41aa84ede tempest-CreateVolumesFromSnapshotTest-778065099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-976f07c3-8168-4e74-aa99-4618d4bb1c3f 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:56 devstack sudo[106299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-976f07c3-8168-4e74-aa99-4618d4bb1c3f 1073741824 Jul 08 02:04:56 devstack sudo[106299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:56 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-9829c901-fbd7-4675-8d14-a833cd261d98 tempest-CreateVolumesFromSnapshotTest-778065099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:04:56 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-9829c901-fbd7-4675-8d14-a833cd261d98 tempest-CreateVolumesFromSnapshotTest-778065099 None] Flow 'volume_create_manager' (b0e82af0-c021-462f-8fcd-6710c1a7d0a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:04:56 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-9829c901-fbd7-4675-8d14-a833cd261d98 tempest-CreateVolumesFromSnapshotTest-778065099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c664b19-9203-4d84-b8fd-6212e5cffea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:56 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-9829c901-fbd7-4675-8d14-a833cd261d98 tempest-CreateVolumesFromSnapshotTest-778065099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c664b19-9203-4d84-b8fd-6212e5cffea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:04:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-402665486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de624bb9-849f-4b89-9334-15874ec94dca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f02a5261bd944faea216efeb11b45b0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:04:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:04:57Z,use_quota=True,user_id='cad3538bc79b443090178669c4c6b010',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:56 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-9829c901-fbd7-4675-8d14-a833cd261d98 tempest-CreateVolumesFromSnapshotTest-778065099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9abb6c1b-0df9-4168-9326-dec855ca659e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:56 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-9829c901-fbd7-4675-8d14-a833cd261d98 tempest-CreateVolumesFromSnapshotTest-778065099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9abb6c1b-0df9-4168-9326-dec855ca659e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:56 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-9829c901-fbd7-4675-8d14-a833cd261d98 tempest-CreateVolumesFromSnapshotTest-778065099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c874e6ab-3374-4192-a986-a13c3c326121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:56 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-9829c901-fbd7-4675-8d14-a833cd261d98 tempest-CreateVolumesFromSnapshotTest-778065099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c874e6ab-3374-4192-a986-a13c3c326121) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de624bb9-849f-4b89-9334-15874ec94dca', 'volume_name': 'volume-de624bb9-849f-4b89-9334-15874ec94dca', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:56 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-9829c901-fbd7-4675-8d14-a833cd261d98 tempest-CreateVolumesFromSnapshotTest-778065099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (619d99c7-d011-4545-be56-7beaedf5e329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:56 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-9829c901-fbd7-4675-8d14-a833cd261d98 tempest-CreateVolumesFromSnapshotTest-778065099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (619d99c7-d011-4545-be56-7beaedf5e329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:56 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-9829c901-fbd7-4675-8d14-a833cd261d98 tempest-CreateVolumesFromSnapshotTest-778065099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (782050a9-2af1-4f9f-a3a8-432e57189663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:56 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-9829c901-fbd7-4675-8d14-a833cd261d98 tempest-CreateVolumesFromSnapshotTest-778065099 None] Volume de624bb9-849f-4b89-9334-15874ec94dca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de624bb9-849f-4b89-9334-15874ec94dca', 'volume_size': 1} Jul 08 02:04:56 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-9829c901-fbd7-4675-8d14-a833cd261d98 tempest-CreateVolumesFromSnapshotTest-778065099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:04:57 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-e02a82ad-94b1-424a-9286-4b1c4f6affc6 tempest-CreateVolumesFromSnapshotTest-778065099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:04:57 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e02a82ad-94b1-424a-9286-4b1c4f6affc6 tempest-CreateVolumesFromSnapshotTest-778065099 None] Flow 'volume_create_manager' (8c1afa61-0375-4d35-9971-8514745f13db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:04:57 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e02a82ad-94b1-424a-9286-4b1c4f6affc6 tempest-CreateVolumesFromSnapshotTest-778065099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ff71f2a-4709-41ba-ad36-db00f13ef97e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:57 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e02a82ad-94b1-424a-9286-4b1c4f6affc6 tempest-CreateVolumesFromSnapshotTest-778065099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ff71f2a-4709-41ba-ad36-db00f13ef97e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:04:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1265134754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5ad9b85-5cf0-4271-8a19-4c9ec7ddafb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f02a5261bd944faea216efeb11b45b0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:04:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:04:57Z,use_quota=True,user_id='cad3538bc79b443090178669c4c6b010',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:57 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e02a82ad-94b1-424a-9286-4b1c4f6affc6 tempest-CreateVolumesFromSnapshotTest-778065099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7352c6d6-5185-4094-ab69-978980d886a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:57 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e02a82ad-94b1-424a-9286-4b1c4f6affc6 tempest-CreateVolumesFromSnapshotTest-778065099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7352c6d6-5185-4094-ab69-978980d886a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:57 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e02a82ad-94b1-424a-9286-4b1c4f6affc6 tempest-CreateVolumesFromSnapshotTest-778065099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (765320d8-69e1-4a85-ac4d-027d772d39b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:57 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e02a82ad-94b1-424a-9286-4b1c4f6affc6 tempest-CreateVolumesFromSnapshotTest-778065099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (765320d8-69e1-4a85-ac4d-027d772d39b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5ad9b85-5cf0-4271-8a19-4c9ec7ddafb5', 'volume_name': 'volume-c5ad9b85-5cf0-4271-8a19-4c9ec7ddafb5', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:57 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e02a82ad-94b1-424a-9286-4b1c4f6affc6 tempest-CreateVolumesFromSnapshotTest-778065099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20e1d019-292a-4571-ab11-6fb51e4010ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:57 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e02a82ad-94b1-424a-9286-4b1c4f6affc6 tempest-CreateVolumesFromSnapshotTest-778065099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20e1d019-292a-4571-ab11-6fb51e4010ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:57 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e02a82ad-94b1-424a-9286-4b1c4f6affc6 tempest-CreateVolumesFromSnapshotTest-778065099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d193763-e09b-4b5c-b610-f35a8c2c9303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:57 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-e02a82ad-94b1-424a-9286-4b1c4f6affc6 tempest-CreateVolumesFromSnapshotTest-778065099 None] Volume c5ad9b85-5cf0-4271-8a19-4c9ec7ddafb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5ad9b85-5cf0-4271-8a19-4c9ec7ddafb5', 'volume_size': 1} Jul 08 02:04:57 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e02a82ad-94b1-424a-9286-4b1c4f6affc6 tempest-CreateVolumesFromSnapshotTest-778065099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:04:57 devstack sudo[106299]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:57 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d2cb8962-9a7a-4064-a597-9bb41aa84ede tempest-CreateVolumesFromSnapshotTest-778065099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-976f07c3-8168-4e74-aa99-4618d4bb1c3f 1073741824" returned: 0 in 1.660s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:57 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d2cb8962-9a7a-4064-a597-9bb41aa84ede tempest-CreateVolumesFromSnapshotTest-778065099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-976f07c3-8168-4e74-aa99-4618d4bb1c3f {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:57 devstack sudo[106304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-976f07c3-8168-4e74-aa99-4618d4bb1c3f Jul 08 02:04:57 devstack sudo[106304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:58 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-58b8d150-0134-4a64-b4f9-9c876eb40d1c tempest-CinderUnicodeTest-1150296208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:04:58 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-58b8d150-0134-4a64-b4f9-9c876eb40d1c tempest-CinderUnicodeTest-1150296208 None] Flow 'volume_create_manager' (02bfcf8c-5d84-434b-9268-7ed5933ace3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:04:58 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-58b8d150-0134-4a64-b4f9-9c876eb40d1c tempest-CinderUnicodeTest-1150296208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2efa1d9a-9dea-4f14-8963-4ff5a9004646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:58 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-58b8d150-0134-4a64-b4f9-9c876eb40d1c tempest-CinderUnicodeTest-1150296208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2efa1d9a-9dea-4f14-8963-4ff5a9004646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:04:57Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c43693a7-1290-4b4b-bb70-b0756bdbc110,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3cd09c84ab242d4b46264d5ff227e81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:04:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:04:58Z,use_quota=True,user_id='b8852d68476b4c05bd27c4b84a839292',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:58 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-58b8d150-0134-4a64-b4f9-9c876eb40d1c tempest-CinderUnicodeTest-1150296208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (589fea0e-8bc7-42cf-90af-767a41b018a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:58 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-58b8d150-0134-4a64-b4f9-9c876eb40d1c tempest-CinderUnicodeTest-1150296208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (589fea0e-8bc7-42cf-90af-767a41b018a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:58 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-58b8d150-0134-4a64-b4f9-9c876eb40d1c tempest-CinderUnicodeTest-1150296208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae23ec79-8b53-4022-9a24-3c7edbdb1e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:58 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-58b8d150-0134-4a64-b4f9-9c876eb40d1c tempest-CinderUnicodeTest-1150296208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae23ec79-8b53-4022-9a24-3c7edbdb1e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c43693a7-1290-4b4b-bb70-b0756bdbc110', 'volume_name': 'volume-c43693a7-1290-4b4b-bb70-b0756bdbc110', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:58 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-58b8d150-0134-4a64-b4f9-9c876eb40d1c tempest-CinderUnicodeTest-1150296208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a503ab90-777f-41f8-bc28-1fa042904b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:58 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-58b8d150-0134-4a64-b4f9-9c876eb40d1c tempest-CinderUnicodeTest-1150296208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a503ab90-777f-41f8-bc28-1fa042904b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:58 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-58b8d150-0134-4a64-b4f9-9c876eb40d1c tempest-CinderUnicodeTest-1150296208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52431d71-0894-4522-803c-6cc67cbe0f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:58 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-58b8d150-0134-4a64-b4f9-9c876eb40d1c tempest-CinderUnicodeTest-1150296208 None] Volume c43693a7-1290-4b4b-bb70-b0756bdbc110: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c43693a7-1290-4b4b-bb70-b0756bdbc110', 'volume_size': 1} Jul 08 02:04:58 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-58b8d150-0134-4a64-b4f9-9c876eb40d1c tempest-CinderUnicodeTest-1150296208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:04:58 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea4ec005-6cd8-4397-bb77-7bd8492a65b1 tempest-CreateVolumesFromSnapshotTest-778065099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:04:58 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ea4ec005-6cd8-4397-bb77-7bd8492a65b1 tempest-CreateVolumesFromSnapshotTest-778065099 None] Flow 'volume_create_manager' (3026c022-4fb3-4375-a60b-ca1bd3cd5a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:04:58 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ea4ec005-6cd8-4397-bb77-7bd8492a65b1 tempest-CreateVolumesFromSnapshotTest-778065099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4074691-f89b-4617-b500-7ff3c46b296d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:58 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ea4ec005-6cd8-4397-bb77-7bd8492a65b1 tempest-CreateVolumesFromSnapshotTest-778065099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4074691-f89b-4617-b500-7ff3c46b296d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:04:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-794362803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed4f5442-1930-4b37-844e-194f0e56bbe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f02a5261bd944faea216efeb11b45b0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:04:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:04:58Z,use_quota=True,user_id='cad3538bc79b443090178669c4c6b010',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:58 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ea4ec005-6cd8-4397-bb77-7bd8492a65b1 tempest-CreateVolumesFromSnapshotTest-778065099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a90013e-97ad-440e-9955-080da210ffb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:58 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ea4ec005-6cd8-4397-bb77-7bd8492a65b1 tempest-CreateVolumesFromSnapshotTest-778065099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a90013e-97ad-440e-9955-080da210ffb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:58 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ea4ec005-6cd8-4397-bb77-7bd8492a65b1 tempest-CreateVolumesFromSnapshotTest-778065099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1a58ae8-0e4c-43e9-a776-7afd836aad54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:58 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ea4ec005-6cd8-4397-bb77-7bd8492a65b1 tempest-CreateVolumesFromSnapshotTest-778065099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1a58ae8-0e4c-43e9-a776-7afd836aad54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed4f5442-1930-4b37-844e-194f0e56bbe6', 'volume_name': 'volume-ed4f5442-1930-4b37-844e-194f0e56bbe6', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:58 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ea4ec005-6cd8-4397-bb77-7bd8492a65b1 tempest-CreateVolumesFromSnapshotTest-778065099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb88ce3a-a68a-4038-922e-8e622bac0eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:58 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ea4ec005-6cd8-4397-bb77-7bd8492a65b1 tempest-CreateVolumesFromSnapshotTest-778065099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb88ce3a-a68a-4038-922e-8e622bac0eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:58 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ea4ec005-6cd8-4397-bb77-7bd8492a65b1 tempest-CreateVolumesFromSnapshotTest-778065099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9700684-6bb0-479a-9543-cf28d79cd6bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:58 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-ea4ec005-6cd8-4397-bb77-7bd8492a65b1 tempest-CreateVolumesFromSnapshotTest-778065099 None] Volume ed4f5442-1930-4b37-844e-194f0e56bbe6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed4f5442-1930-4b37-844e-194f0e56bbe6', 'volume_size': 1} Jul 08 02:04:58 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-ea4ec005-6cd8-4397-bb77-7bd8492a65b1 tempest-CreateVolumesFromSnapshotTest-778065099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:04:58 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f1586c8-ce6b-433a-9e70-f566d61ebbd0 tempest-CreateVolumesFromSnapshotTest-778065099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:04:58 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-3f1586c8-ce6b-433a-9e70-f566d61ebbd0 tempest-CreateVolumesFromSnapshotTest-778065099 None] Flow 'volume_create_manager' (2559e5d4-c51a-4261-9fb5-c78eefc974e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:04:58 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-3f1586c8-ce6b-433a-9e70-f566d61ebbd0 tempest-CreateVolumesFromSnapshotTest-778065099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56a983e1-d2b7-4f1b-9e60-a1291db52683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:58 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-3f1586c8-ce6b-433a-9e70-f566d61ebbd0 tempest-CreateVolumesFromSnapshotTest-778065099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56a983e1-d2b7-4f1b-9e60-a1291db52683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:04:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-193206217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ece3a2ec-3e24-499a-b8fa-f7559e25aca5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f02a5261bd944faea216efeb11b45b0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:04:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:04:59Z,use_quota=True,user_id='cad3538bc79b443090178669c4c6b010',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:58 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-3f1586c8-ce6b-433a-9e70-f566d61ebbd0 tempest-CreateVolumesFromSnapshotTest-778065099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85a9a650-7d9a-4ec8-ba0e-5d0d9f2557c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:58 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-3f1586c8-ce6b-433a-9e70-f566d61ebbd0 tempest-CreateVolumesFromSnapshotTest-778065099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85a9a650-7d9a-4ec8-ba0e-5d0d9f2557c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:58 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-3f1586c8-ce6b-433a-9e70-f566d61ebbd0 tempest-CreateVolumesFromSnapshotTest-778065099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f89f4902-7571-4c3d-8661-1dc864839715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:58 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-3f1586c8-ce6b-433a-9e70-f566d61ebbd0 tempest-CreateVolumesFromSnapshotTest-778065099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f89f4902-7571-4c3d-8661-1dc864839715) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ece3a2ec-3e24-499a-b8fa-f7559e25aca5', 'volume_name': 'volume-ece3a2ec-3e24-499a-b8fa-f7559e25aca5', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:58 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-3f1586c8-ce6b-433a-9e70-f566d61ebbd0 tempest-CreateVolumesFromSnapshotTest-778065099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2856afe-cae4-4851-ab1d-323c5ef271ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:58 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-3f1586c8-ce6b-433a-9e70-f566d61ebbd0 tempest-CreateVolumesFromSnapshotTest-778065099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2856afe-cae4-4851-ab1d-323c5ef271ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:58 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-3f1586c8-ce6b-433a-9e70-f566d61ebbd0 tempest-CreateVolumesFromSnapshotTest-778065099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6ba2fbb-95ea-42f5-8fd8-040a03df3a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:58 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-3f1586c8-ce6b-433a-9e70-f566d61ebbd0 tempest-CreateVolumesFromSnapshotTest-778065099 None] Volume ece3a2ec-3e24-499a-b8fa-f7559e25aca5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ece3a2ec-3e24-499a-b8fa-f7559e25aca5', 'volume_size': 1} Jul 08 02:04:58 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-3f1586c8-ce6b-433a-9e70-f566d61ebbd0 tempest-CreateVolumesFromSnapshotTest-778065099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:04:58 devstack sudo[106304]: pam_unix(sudo:session): session closed for user root Jul 08 02:04:58 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d2cb8962-9a7a-4064-a597-9bb41aa84ede tempest-CreateVolumesFromSnapshotTest-778065099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-976f07c3-8168-4e74-aa99-4618d4bb1c3f" returned: 0 in 1.218s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:04:58 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-d2cb8962-9a7a-4064-a597-9bb41aa84ede tempest-CreateVolumesFromSnapshotTest-778065099 None] <== create_volume: return (2956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:04:58 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-d2cb8962-9a7a-4064-a597-9bb41aa84ede tempest-CreateVolumesFromSnapshotTest-778065099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.961s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:04:58 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-9829c901-fbd7-4675-8d14-a833cd261d98 tempest-CreateVolumesFromSnapshotTest-778065099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.108s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:04:58 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-9829c901-fbd7-4675-8d14-a833cd261d98 tempest-CreateVolumesFromSnapshotTest-778065099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:04:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-402665486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de624bb9-849f-4b89-9334-15874ec94dca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f02a5261bd944faea216efeb11b45b0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:04:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:04:57Z,use_quota=True,user_id='cad3538bc79b443090178669c4c6b010',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:04:58 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-9829c901-fbd7-4675-8d14-a833cd261d98 tempest-CreateVolumesFromSnapshotTest-778065099 None] Creating volume de624bb9-849f-4b89-9334-15874ec94dca {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:04:58 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-9829c901-fbd7-4675-8d14-a833cd261d98 tempest-CreateVolumesFromSnapshotTest-778065099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:04:58 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-9829c901-fbd7-4675-8d14-a833cd261d98 tempest-CreateVolumesFromSnapshotTest-778065099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:04:58 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-9829c901-fbd7-4675-8d14-a833cd261d98 tempest-CreateVolumesFromSnapshotTest-778065099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:04:58 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-9829c901-fbd7-4675-8d14-a833cd261d98 tempest-CreateVolumesFromSnapshotTest-778065099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:04:58 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-9829c901-fbd7-4675-8d14-a833cd261d98 tempest-CreateVolumesFromSnapshotTest-778065099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:04:58 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-9829c901-fbd7-4675-8d14-a833cd261d98 tempest-CreateVolumesFromSnapshotTest-778065099 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:04:58 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-9829c901-fbd7-4675-8d14-a833cd261d98 tempest-CreateVolumesFromSnapshotTest-778065099 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 02:04:58 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9829c901-fbd7-4675-8d14-a833cd261d98 tempest-CreateVolumesFromSnapshotTest-778065099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-de624bb9-849f-4b89-9334-15874ec94dca 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:04:58 devstack sudo[106307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-de624bb9-849f-4b89-9334-15874ec94dca 1073741824 Jul 08 02:04:58 devstack sudo[106307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:04:59 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-d2cb8962-9a7a-4064-a597-9bb41aa84ede tempest-CreateVolumesFromSnapshotTest-778065099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17206735-e88e-4c9d-8d5d-53a2d27ba89c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-976f07c3-8168-4e74-aa99-4618d4bb1c3f', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:59 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-d2cb8962-9a7a-4064-a597-9bb41aa84ede tempest-CreateVolumesFromSnapshotTest-778065099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d635b5f-6669-472c-b872-53ca8e0bc2ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:04:59 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-d2cb8962-9a7a-4064-a597-9bb41aa84ede tempest-CreateVolumesFromSnapshotTest-778065099 None] Volume volume-976f07c3-8168-4e74-aa99-4618d4bb1c3f (976f07c3-8168-4e74-aa99-4618d4bb1c3f): created successfully Jul 08 02:04:59 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-d2cb8962-9a7a-4064-a597-9bb41aa84ede tempest-CreateVolumesFromSnapshotTest-778065099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d635b5f-6669-472c-b872-53ca8e0bc2ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:04:59 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-d2cb8962-9a7a-4064-a597-9bb41aa84ede tempest-CreateVolumesFromSnapshotTest-778065099 None] Flow 'volume_create_manager' (17a9079e-e3f5-4943-a018-bb6fc2992d48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:04:59 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-d2cb8962-9a7a-4064-a597-9bb41aa84ede tempest-CreateVolumesFromSnapshotTest-778065099 None] Created volume successfully. Jul 08 02:05:00 devstack sudo[106307]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9829c901-fbd7-4675-8d14-a833cd261d98 tempest-CreateVolumesFromSnapshotTest-778065099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-de624bb9-849f-4b89-9334-15874ec94dca 1073741824" returned: 0 in 1.084s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9829c901-fbd7-4675-8d14-a833cd261d98 tempest-CreateVolumesFromSnapshotTest-778065099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-de624bb9-849f-4b89-9334-15874ec94dca {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:00 devstack sudo[106313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-de624bb9-849f-4b89-9334-15874ec94dca Jul 08 02:05:00 devstack sudo[106313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:00 devstack sudo[106313]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9829c901-fbd7-4675-8d14-a833cd261d98 tempest-CreateVolumesFromSnapshotTest-778065099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-de624bb9-849f-4b89-9334-15874ec94dca" returned: 0 in 0.704s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:00 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-9829c901-fbd7-4675-8d14-a833cd261d98 tempest-CreateVolumesFromSnapshotTest-778065099 None] <== create_volume: return (1835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:05:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-9829c901-fbd7-4675-8d14-a833cd261d98 tempest-CreateVolumesFromSnapshotTest-778065099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.838s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:05:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e02a82ad-94b1-424a-9286-4b1c4f6affc6 tempest-CreateVolumesFromSnapshotTest-778065099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.204s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:05:00 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-e02a82ad-94b1-424a-9286-4b1c4f6affc6 tempest-CreateVolumesFromSnapshotTest-778065099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:04:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1265134754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5ad9b85-5cf0-4271-8a19-4c9ec7ddafb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f02a5261bd944faea216efeb11b45b0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:04:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:04:57Z,use_quota=True,user_id='cad3538bc79b443090178669c4c6b010',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:05:00 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-e02a82ad-94b1-424a-9286-4b1c4f6affc6 tempest-CreateVolumesFromSnapshotTest-778065099 None] Creating volume c5ad9b85-5cf0-4271-8a19-4c9ec7ddafb5 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:05:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e02a82ad-94b1-424a-9286-4b1c4f6affc6 tempest-CreateVolumesFromSnapshotTest-778065099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:05:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e02a82ad-94b1-424a-9286-4b1c4f6affc6 tempest-CreateVolumesFromSnapshotTest-778065099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:05:00 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-e02a82ad-94b1-424a-9286-4b1c4f6affc6 tempest-CreateVolumesFromSnapshotTest-778065099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:05:00 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-e02a82ad-94b1-424a-9286-4b1c4f6affc6 tempest-CreateVolumesFromSnapshotTest-778065099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:05:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e02a82ad-94b1-424a-9286-4b1c4f6affc6 tempest-CreateVolumesFromSnapshotTest-778065099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:05:00 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-e02a82ad-94b1-424a-9286-4b1c4f6affc6 tempest-CreateVolumesFromSnapshotTest-778065099 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:05:00 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-e02a82ad-94b1-424a-9286-4b1c4f6affc6 tempest-CreateVolumesFromSnapshotTest-778065099 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 02:05:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e02a82ad-94b1-424a-9286-4b1c4f6affc6 tempest-CreateVolumesFromSnapshotTest-778065099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c5ad9b85-5cf0-4271-8a19-4c9ec7ddafb5 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:00 devstack sudo[106316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c5ad9b85-5cf0-4271-8a19-4c9ec7ddafb5 1073741824 Jul 08 02:05:00 devstack sudo[106316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:00 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-9829c901-fbd7-4675-8d14-a833cd261d98 tempest-CreateVolumesFromSnapshotTest-778065099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (782050a9-2af1-4f9f-a3a8-432e57189663) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de624bb9-849f-4b89-9334-15874ec94dca', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:05:00 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-9829c901-fbd7-4675-8d14-a833cd261d98 tempest-CreateVolumesFromSnapshotTest-778065099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45ea8e0b-c88d-4530-ad58-6dd6b20f65a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:05:00 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-9829c901-fbd7-4675-8d14-a833cd261d98 tempest-CreateVolumesFromSnapshotTest-778065099 None] Volume volume-de624bb9-849f-4b89-9334-15874ec94dca (de624bb9-849f-4b89-9334-15874ec94dca): created successfully Jul 08 02:05:00 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-9829c901-fbd7-4675-8d14-a833cd261d98 tempest-CreateVolumesFromSnapshotTest-778065099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45ea8e0b-c88d-4530-ad58-6dd6b20f65a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:05:00 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-9829c901-fbd7-4675-8d14-a833cd261d98 tempest-CreateVolumesFromSnapshotTest-778065099 None] Flow 'volume_create_manager' (b0e82af0-c021-462f-8fcd-6710c1a7d0a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:05:00 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-9829c901-fbd7-4675-8d14-a833cd261d98 tempest-CreateVolumesFromSnapshotTest-778065099 None] Created volume successfully. Jul 08 02:05:01 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-b26ec37a-fc05-4089-9391-e758a9da7302 tempest-VolumeDependencyTests-1851628812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:05:01 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b26ec37a-fc05-4089-9391-e758a9da7302 tempest-VolumeDependencyTests-1851628812 None] Flow 'volume_create_manager' (38366185-4250-4528-a75d-138b390a4e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:05:01 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b26ec37a-fc05-4089-9391-e758a9da7302 tempest-VolumeDependencyTests-1851628812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70fa4f6b-22ab-44ad-ab4e-8f5cd35682a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:05:01 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b26ec37a-fc05-4089-9391-e758a9da7302 tempest-VolumeDependencyTests-1851628812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70fa4f6b-22ab-44ad-ab4e-8f5cd35682a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:05:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1525957602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b8d99b5-ab2e-46e1-bab3-1f03aa238713,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92b5893263a34c99a9e77140ba2345cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:05:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:05:01Z,use_quota=True,user_id='6614ba15035b49a098b565f50bab32a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:05:01 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b26ec37a-fc05-4089-9391-e758a9da7302 tempest-VolumeDependencyTests-1851628812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bfa2e87-5027-4b9e-bb7a-1ec99c6884eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:05:01 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b26ec37a-fc05-4089-9391-e758a9da7302 tempest-VolumeDependencyTests-1851628812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bfa2e87-5027-4b9e-bb7a-1ec99c6884eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:05:01 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b26ec37a-fc05-4089-9391-e758a9da7302 tempest-VolumeDependencyTests-1851628812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9edd2e9d-3c49-407e-9054-aae291deb8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:05:01 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b26ec37a-fc05-4089-9391-e758a9da7302 tempest-VolumeDependencyTests-1851628812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9edd2e9d-3c49-407e-9054-aae291deb8e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b8d99b5-ab2e-46e1-bab3-1f03aa238713', 'volume_name': 'volume-3b8d99b5-ab2e-46e1-bab3-1f03aa238713', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:05:01 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b26ec37a-fc05-4089-9391-e758a9da7302 tempest-VolumeDependencyTests-1851628812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5e9dce1-5cb0-45c3-8b30-6809e4ef2bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:05:01 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b26ec37a-fc05-4089-9391-e758a9da7302 tempest-VolumeDependencyTests-1851628812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5e9dce1-5cb0-45c3-8b30-6809e4ef2bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:05:01 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b26ec37a-fc05-4089-9391-e758a9da7302 tempest-VolumeDependencyTests-1851628812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5268b6e1-042a-4cd0-9468-ef0fca8e6b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:05:01 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-b26ec37a-fc05-4089-9391-e758a9da7302 tempest-VolumeDependencyTests-1851628812 None] Volume 3b8d99b5-ab2e-46e1-bab3-1f03aa238713: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b8d99b5-ab2e-46e1-bab3-1f03aa238713', 'volume_size': 1} Jul 08 02:05:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b26ec37a-fc05-4089-9391-e758a9da7302 tempest-VolumeDependencyTests-1851628812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:05:01 devstack sudo[106316]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e02a82ad-94b1-424a-9286-4b1c4f6affc6 tempest-CreateVolumesFromSnapshotTest-778065099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c5ad9b85-5cf0-4271-8a19-4c9ec7ddafb5 1073741824" returned: 0 in 0.958s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e02a82ad-94b1-424a-9286-4b1c4f6affc6 tempest-CreateVolumesFromSnapshotTest-778065099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c5ad9b85-5cf0-4271-8a19-4c9ec7ddafb5 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:01 devstack sudo[106324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c5ad9b85-5cf0-4271-8a19-4c9ec7ddafb5 Jul 08 02:05:01 devstack sudo[106324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:02 devstack sudo[106324]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e02a82ad-94b1-424a-9286-4b1c4f6affc6 tempest-CreateVolumesFromSnapshotTest-778065099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c5ad9b85-5cf0-4271-8a19-4c9ec7ddafb5" returned: 0 in 0.726s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:02 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-e02a82ad-94b1-424a-9286-4b1c4f6affc6 tempest-CreateVolumesFromSnapshotTest-778065099 None] <== create_volume: return (1737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:05:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e02a82ad-94b1-424a-9286-4b1c4f6affc6 tempest-CreateVolumesFromSnapshotTest-778065099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.740s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:05:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-58b8d150-0134-4a64-b4f9-9c876eb40d1c tempest-CinderUnicodeTest-1150296208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.318s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:05:02 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-58b8d150-0134-4a64-b4f9-9c876eb40d1c tempest-CinderUnicodeTest-1150296208 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:04:57Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c43693a7-1290-4b4b-bb70-b0756bdbc110,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3cd09c84ab242d4b46264d5ff227e81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:04:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:04:58Z,use_quota=True,user_id='b8852d68476b4c05bd27c4b84a839292',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:05:02 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-58b8d150-0134-4a64-b4f9-9c876eb40d1c tempest-CinderUnicodeTest-1150296208 None] Creating volume c43693a7-1290-4b4b-bb70-b0756bdbc110 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:05:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-58b8d150-0134-4a64-b4f9-9c876eb40d1c tempest-CinderUnicodeTest-1150296208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:05:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-58b8d150-0134-4a64-b4f9-9c876eb40d1c tempest-CinderUnicodeTest-1150296208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:05:02 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-58b8d150-0134-4a64-b4f9-9c876eb40d1c tempest-CinderUnicodeTest-1150296208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:05:02 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-58b8d150-0134-4a64-b4f9-9c876eb40d1c tempest-CinderUnicodeTest-1150296208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:05:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-58b8d150-0134-4a64-b4f9-9c876eb40d1c tempest-CinderUnicodeTest-1150296208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:05:02 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-58b8d150-0134-4a64-b4f9-9c876eb40d1c tempest-CinderUnicodeTest-1150296208 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:05:02 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-58b8d150-0134-4a64-b4f9-9c876eb40d1c tempest-CinderUnicodeTest-1150296208 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 02:05:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-58b8d150-0134-4a64-b4f9-9c876eb40d1c tempest-CinderUnicodeTest-1150296208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c43693a7-1290-4b4b-bb70-b0756bdbc110 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:02 devstack sudo[106327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c43693a7-1290-4b4b-bb70-b0756bdbc110 1073741824 Jul 08 02:05:02 devstack sudo[106327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:02 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e02a82ad-94b1-424a-9286-4b1c4f6affc6 tempest-CreateVolumesFromSnapshotTest-778065099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d193763-e09b-4b5c-b610-f35a8c2c9303) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5ad9b85-5cf0-4271-8a19-4c9ec7ddafb5', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:05:02 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e02a82ad-94b1-424a-9286-4b1c4f6affc6 tempest-CreateVolumesFromSnapshotTest-778065099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (118adb37-5be1-4738-9b4d-66995ae90ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:05:02 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-e02a82ad-94b1-424a-9286-4b1c4f6affc6 tempest-CreateVolumesFromSnapshotTest-778065099 None] Volume volume-c5ad9b85-5cf0-4271-8a19-4c9ec7ddafb5 (c5ad9b85-5cf0-4271-8a19-4c9ec7ddafb5): created successfully Jul 08 02:05:02 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e02a82ad-94b1-424a-9286-4b1c4f6affc6 tempest-CreateVolumesFromSnapshotTest-778065099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (118adb37-5be1-4738-9b4d-66995ae90ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:05:02 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e02a82ad-94b1-424a-9286-4b1c4f6affc6 tempest-CreateVolumesFromSnapshotTest-778065099 None] Flow 'volume_create_manager' (8c1afa61-0375-4d35-9971-8514745f13db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:05:02 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-e02a82ad-94b1-424a-9286-4b1c4f6affc6 tempest-CreateVolumesFromSnapshotTest-778065099 None] Created volume successfully. Jul 08 02:05:03 devstack sudo[106327]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:03 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-58b8d150-0134-4a64-b4f9-9c876eb40d1c tempest-CinderUnicodeTest-1150296208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c43693a7-1290-4b4b-bb70-b0756bdbc110 1073741824" returned: 0 in 1.034s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:03 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-58b8d150-0134-4a64-b4f9-9c876eb40d1c tempest-CinderUnicodeTest-1150296208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c43693a7-1290-4b4b-bb70-b0756bdbc110 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:03 devstack sudo[106334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c43693a7-1290-4b4b-bb70-b0756bdbc110 Jul 08 02:05:03 devstack sudo[106334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:04 devstack sudo[106334]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:04 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-58b8d150-0134-4a64-b4f9-9c876eb40d1c tempest-CinderUnicodeTest-1150296208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c43693a7-1290-4b4b-bb70-b0756bdbc110" returned: 0 in 0.703s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:04 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-58b8d150-0134-4a64-b4f9-9c876eb40d1c tempest-CinderUnicodeTest-1150296208 None] <== create_volume: return (1804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:05:04 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-58b8d150-0134-4a64-b4f9-9c876eb40d1c tempest-CinderUnicodeTest-1150296208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.808s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:05:04 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-ea4ec005-6cd8-4397-bb77-7bd8492a65b1 tempest-CreateVolumesFromSnapshotTest-778065099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.680s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:05:04 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-ea4ec005-6cd8-4397-bb77-7bd8492a65b1 tempest-CreateVolumesFromSnapshotTest-778065099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:04:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-794362803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed4f5442-1930-4b37-844e-194f0e56bbe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f02a5261bd944faea216efeb11b45b0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:04:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:04:58Z,use_quota=True,user_id='cad3538bc79b443090178669c4c6b010',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:05:04 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-ea4ec005-6cd8-4397-bb77-7bd8492a65b1 tempest-CreateVolumesFromSnapshotTest-778065099 None] Creating volume ed4f5442-1930-4b37-844e-194f0e56bbe6 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:05:04 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-ea4ec005-6cd8-4397-bb77-7bd8492a65b1 tempest-CreateVolumesFromSnapshotTest-778065099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:05:04 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-ea4ec005-6cd8-4397-bb77-7bd8492a65b1 tempest-CreateVolumesFromSnapshotTest-778065099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:05:04 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-ea4ec005-6cd8-4397-bb77-7bd8492a65b1 tempest-CreateVolumesFromSnapshotTest-778065099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:05:04 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-ea4ec005-6cd8-4397-bb77-7bd8492a65b1 tempest-CreateVolumesFromSnapshotTest-778065099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:05:04 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-ea4ec005-6cd8-4397-bb77-7bd8492a65b1 tempest-CreateVolumesFromSnapshotTest-778065099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:05:04 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-ea4ec005-6cd8-4397-bb77-7bd8492a65b1 tempest-CreateVolumesFromSnapshotTest-778065099 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:05:04 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-ea4ec005-6cd8-4397-bb77-7bd8492a65b1 tempest-CreateVolumesFromSnapshotTest-778065099 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 02:05:04 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ea4ec005-6cd8-4397-bb77-7bd8492a65b1 tempest-CreateVolumesFromSnapshotTest-778065099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ed4f5442-1930-4b37-844e-194f0e56bbe6 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:04 devstack sudo[106337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ed4f5442-1930-4b37-844e-194f0e56bbe6 1073741824 Jul 08 02:05:04 devstack sudo[106337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:04 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-58b8d150-0134-4a64-b4f9-9c876eb40d1c tempest-CinderUnicodeTest-1150296208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52431d71-0894-4522-803c-6cc67cbe0f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c43693a7-1290-4b4b-bb70-b0756bdbc110', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:05:04 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-58b8d150-0134-4a64-b4f9-9c876eb40d1c tempest-CinderUnicodeTest-1150296208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73676856-6ca4-4442-b49d-332ac8ff8c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:05:04 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-58b8d150-0134-4a64-b4f9-9c876eb40d1c tempest-CinderUnicodeTest-1150296208 None] Volume volume-c43693a7-1290-4b4b-bb70-b0756bdbc110 (c43693a7-1290-4b4b-bb70-b0756bdbc110): created successfully Jul 08 02:05:04 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-58b8d150-0134-4a64-b4f9-9c876eb40d1c tempest-CinderUnicodeTest-1150296208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73676856-6ca4-4442-b49d-332ac8ff8c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:05:04 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-58b8d150-0134-4a64-b4f9-9c876eb40d1c tempest-CinderUnicodeTest-1150296208 None] Flow 'volume_create_manager' (02bfcf8c-5d84-434b-9268-7ed5933ace3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:05:04 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-58b8d150-0134-4a64-b4f9-9c876eb40d1c tempest-CinderUnicodeTest-1150296208 None] Created volume successfully. Jul 08 02:05:05 devstack sudo[106337]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:05 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ea4ec005-6cd8-4397-bb77-7bd8492a65b1 tempest-CreateVolumesFromSnapshotTest-778065099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ed4f5442-1930-4b37-844e-194f0e56bbe6 1073741824" returned: 0 in 0.918s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:05 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ea4ec005-6cd8-4397-bb77-7bd8492a65b1 tempest-CreateVolumesFromSnapshotTest-778065099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ed4f5442-1930-4b37-844e-194f0e56bbe6 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:05 devstack sudo[106342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ed4f5442-1930-4b37-844e-194f0e56bbe6 Jul 08 02:05:05 devstack sudo[106342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:05 devstack sudo[106342]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:05 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ea4ec005-6cd8-4397-bb77-7bd8492a65b1 tempest-CreateVolumesFromSnapshotTest-778065099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ed4f5442-1930-4b37-844e-194f0e56bbe6" returned: 0 in 0.688s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:05 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-ea4ec005-6cd8-4397-bb77-7bd8492a65b1 tempest-CreateVolumesFromSnapshotTest-778065099 None] <== create_volume: return (1653ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:05:05 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-ea4ec005-6cd8-4397-bb77-7bd8492a65b1 tempest-CreateVolumesFromSnapshotTest-778065099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.657s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:05:05 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-3f1586c8-ce6b-433a-9e70-f566d61ebbd0 tempest-CreateVolumesFromSnapshotTest-778065099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.142s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:05:05 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-3f1586c8-ce6b-433a-9e70-f566d61ebbd0 tempest-CreateVolumesFromSnapshotTest-778065099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:04:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-193206217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ece3a2ec-3e24-499a-b8fa-f7559e25aca5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f02a5261bd944faea216efeb11b45b0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:04:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:04:59Z,use_quota=True,user_id='cad3538bc79b443090178669c4c6b010',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:05:05 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-3f1586c8-ce6b-433a-9e70-f566d61ebbd0 tempest-CreateVolumesFromSnapshotTest-778065099 None] Creating volume ece3a2ec-3e24-499a-b8fa-f7559e25aca5 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:05:05 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-3f1586c8-ce6b-433a-9e70-f566d61ebbd0 tempest-CreateVolumesFromSnapshotTest-778065099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:05:05 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-3f1586c8-ce6b-433a-9e70-f566d61ebbd0 tempest-CreateVolumesFromSnapshotTest-778065099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:05:05 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-3f1586c8-ce6b-433a-9e70-f566d61ebbd0 tempest-CreateVolumesFromSnapshotTest-778065099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:05:05 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-3f1586c8-ce6b-433a-9e70-f566d61ebbd0 tempest-CreateVolumesFromSnapshotTest-778065099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:05:05 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-3f1586c8-ce6b-433a-9e70-f566d61ebbd0 tempest-CreateVolumesFromSnapshotTest-778065099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:05:05 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-3f1586c8-ce6b-433a-9e70-f566d61ebbd0 tempest-CreateVolumesFromSnapshotTest-778065099 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:05:05 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-3f1586c8-ce6b-433a-9e70-f566d61ebbd0 tempest-CreateVolumesFromSnapshotTest-778065099 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 02:05:05 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-3f1586c8-ce6b-433a-9e70-f566d61ebbd0 tempest-CreateVolumesFromSnapshotTest-778065099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ece3a2ec-3e24-499a-b8fa-f7559e25aca5 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:06 devstack sudo[106345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ece3a2ec-3e24-499a-b8fa-f7559e25aca5 1073741824 Jul 08 02:05:06 devstack sudo[106345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:06 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ea4ec005-6cd8-4397-bb77-7bd8492a65b1 tempest-CreateVolumesFromSnapshotTest-778065099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9700684-6bb0-479a-9543-cf28d79cd6bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed4f5442-1930-4b37-844e-194f0e56bbe6', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:05:06 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ea4ec005-6cd8-4397-bb77-7bd8492a65b1 tempest-CreateVolumesFromSnapshotTest-778065099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01f8b33c-3c94-4934-93ce-031c632b2721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:05:06 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab27eed8-eff8-41df-a808-a53186d9c912 tempest-CinderUnicodeTest-1150296208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:05:06 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ab27eed8-eff8-41df-a808-a53186d9c912 tempest-CinderUnicodeTest-1150296208 None] Flow 'volume_create_manager' (10884060-389f-4765-adb7-35743aba0e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:05:06 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ab27eed8-eff8-41df-a808-a53186d9c912 tempest-CinderUnicodeTest-1150296208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a8137b1-9fc3-4e78-b470-8338da9d76c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:05:06 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-ea4ec005-6cd8-4397-bb77-7bd8492a65b1 tempest-CreateVolumesFromSnapshotTest-778065099 None] Volume volume-ed4f5442-1930-4b37-844e-194f0e56bbe6 (ed4f5442-1930-4b37-844e-194f0e56bbe6): created successfully Jul 08 02:05:06 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ea4ec005-6cd8-4397-bb77-7bd8492a65b1 tempest-CreateVolumesFromSnapshotTest-778065099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01f8b33c-3c94-4934-93ce-031c632b2721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:05:06 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ea4ec005-6cd8-4397-bb77-7bd8492a65b1 tempest-CreateVolumesFromSnapshotTest-778065099 None] Flow 'volume_create_manager' (3026c022-4fb3-4375-a60b-ca1bd3cd5a32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:05:06 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ab27eed8-eff8-41df-a808-a53186d9c912 tempest-CinderUnicodeTest-1150296208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a8137b1-9fc3-4e78-b470-8338da9d76c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:05:06Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-712858209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1002d122-87cd-454f-bbab-34047435c8ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3cd09c84ab242d4b46264d5ff227e81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:05:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:05:06Z,use_quota=True,user_id='b8852d68476b4c05bd27c4b84a839292',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:05:06 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ab27eed8-eff8-41df-a808-a53186d9c912 tempest-CinderUnicodeTest-1150296208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57bdfd43-6894-4db9-b8ad-919c6d082ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:05:06 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ab27eed8-eff8-41df-a808-a53186d9c912 tempest-CinderUnicodeTest-1150296208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57bdfd43-6894-4db9-b8ad-919c6d082ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:05:06 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ab27eed8-eff8-41df-a808-a53186d9c912 tempest-CinderUnicodeTest-1150296208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (373358b2-7934-4bc0-aee1-6e0131d74b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:05:06 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ab27eed8-eff8-41df-a808-a53186d9c912 tempest-CinderUnicodeTest-1150296208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (373358b2-7934-4bc0-aee1-6e0131d74b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1002d122-87cd-454f-bbab-34047435c8ab', 'volume_name': 'volume-1002d122-87cd-454f-bbab-34047435c8ab', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:05:06 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ab27eed8-eff8-41df-a808-a53186d9c912 tempest-CinderUnicodeTest-1150296208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbb0e583-07b9-406c-b7ff-59c6fe90c57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:05:06 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ab27eed8-eff8-41df-a808-a53186d9c912 tempest-CinderUnicodeTest-1150296208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbb0e583-07b9-406c-b7ff-59c6fe90c57f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:05:06 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ab27eed8-eff8-41df-a808-a53186d9c912 tempest-CinderUnicodeTest-1150296208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (892920c1-3449-4123-8498-282459db7f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:05:06 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-ab27eed8-eff8-41df-a808-a53186d9c912 tempest-CinderUnicodeTest-1150296208 None] Volume 1002d122-87cd-454f-bbab-34047435c8ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1002d122-87cd-454f-bbab-34047435c8ab', 'volume_size': 1} Jul 08 02:05:06 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-ab27eed8-eff8-41df-a808-a53186d9c912 tempest-CinderUnicodeTest-1150296208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:05:06 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-ea4ec005-6cd8-4397-bb77-7bd8492a65b1 tempest-CreateVolumesFromSnapshotTest-778065099 None] Created volume successfully. Jul 08 02:05:06 devstack sudo[106345]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:06 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-3f1586c8-ce6b-433a-9e70-f566d61ebbd0 tempest-CreateVolumesFromSnapshotTest-778065099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ece3a2ec-3e24-499a-b8fa-f7559e25aca5 1073741824" returned: 0 in 0.906s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:06 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-3f1586c8-ce6b-433a-9e70-f566d61ebbd0 tempest-CreateVolumesFromSnapshotTest-778065099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ece3a2ec-3e24-499a-b8fa-f7559e25aca5 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:06 devstack sudo[106351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ece3a2ec-3e24-499a-b8fa-f7559e25aca5 Jul 08 02:05:06 devstack sudo[106351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:07 devstack sudo[106351]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:07 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-3f1586c8-ce6b-433a-9e70-f566d61ebbd0 tempest-CreateVolumesFromSnapshotTest-778065099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ece3a2ec-3e24-499a-b8fa-f7559e25aca5" returned: 0 in 0.632s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:07 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-3f1586c8-ce6b-433a-9e70-f566d61ebbd0 tempest-CreateVolumesFromSnapshotTest-778065099 None] <== create_volume: return (1581ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:05:07 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-3f1586c8-ce6b-433a-9e70-f566d61ebbd0 tempest-CreateVolumesFromSnapshotTest-778065099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.584s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:05:07 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b26ec37a-fc05-4089-9391-e758a9da7302 tempest-VolumeDependencyTests-1851628812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.327s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:05:07 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-b26ec37a-fc05-4089-9391-e758a9da7302 tempest-VolumeDependencyTests-1851628812 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:05:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1525957602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b8d99b5-ab2e-46e1-bab3-1f03aa238713,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92b5893263a34c99a9e77140ba2345cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:05:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:05:01Z,use_quota=True,user_id='6614ba15035b49a098b565f50bab32a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:05:07 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-b26ec37a-fc05-4089-9391-e758a9da7302 tempest-VolumeDependencyTests-1851628812 None] Creating volume 3b8d99b5-ab2e-46e1-bab3-1f03aa238713 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:05:07 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b26ec37a-fc05-4089-9391-e758a9da7302 tempest-VolumeDependencyTests-1851628812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:05:07 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b26ec37a-fc05-4089-9391-e758a9da7302 tempest-VolumeDependencyTests-1851628812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:05:07 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-b26ec37a-fc05-4089-9391-e758a9da7302 tempest-VolumeDependencyTests-1851628812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:05:07 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-b26ec37a-fc05-4089-9391-e758a9da7302 tempest-VolumeDependencyTests-1851628812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:05:07 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b26ec37a-fc05-4089-9391-e758a9da7302 tempest-VolumeDependencyTests-1851628812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:05:07 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-b26ec37a-fc05-4089-9391-e758a9da7302 tempest-VolumeDependencyTests-1851628812 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:05:07 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-b26ec37a-fc05-4089-9391-e758a9da7302 tempest-VolumeDependencyTests-1851628812 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 02:05:07 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b26ec37a-fc05-4089-9391-e758a9da7302 tempest-VolumeDependencyTests-1851628812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3b8d99b5-ab2e-46e1-bab3-1f03aa238713 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:07 devstack sudo[106354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3b8d99b5-ab2e-46e1-bab3-1f03aa238713 1073741824 Jul 08 02:05:07 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:07 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-3f1586c8-ce6b-433a-9e70-f566d61ebbd0 tempest-CreateVolumesFromSnapshotTest-778065099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6ba2fbb-95ea-42f5-8fd8-040a03df3a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ece3a2ec-3e24-499a-b8fa-f7559e25aca5', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:05:07 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-3f1586c8-ce6b-433a-9e70-f566d61ebbd0 tempest-CreateVolumesFromSnapshotTest-778065099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c83924c7-6d53-41d6-94c7-04b57f11625d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:05:07 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-3f1586c8-ce6b-433a-9e70-f566d61ebbd0 tempest-CreateVolumesFromSnapshotTest-778065099 None] Volume volume-ece3a2ec-3e24-499a-b8fa-f7559e25aca5 (ece3a2ec-3e24-499a-b8fa-f7559e25aca5): created successfully Jul 08 02:05:07 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-3f1586c8-ce6b-433a-9e70-f566d61ebbd0 tempest-CreateVolumesFromSnapshotTest-778065099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c83924c7-6d53-41d6-94c7-04b57f11625d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:05:07 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-3f1586c8-ce6b-433a-9e70-f566d61ebbd0 tempest-CreateVolumesFromSnapshotTest-778065099 None] Flow 'volume_create_manager' (2559e5d4-c51a-4261-9fb5-c78eefc974e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:05:07 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-3f1586c8-ce6b-433a-9e70-f566d61ebbd0 tempest-CreateVolumesFromSnapshotTest-778065099 None] Created volume successfully. Jul 08 02:05:07 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-b5739382-3e9d-49b6-b6c3-685d835df9fe tempest-CreateVolumesFromSnapshotTest-778065099 None] Acquiring lock "cinder-ece3a2ec-3e24-499a-b8fa-f7559e25aca5-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:05:07 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-b5739382-3e9d-49b6-b6c3-685d835df9fe tempest-CreateVolumesFromSnapshotTest-778065099 None] Lock "cinder-ece3a2ec-3e24-499a-b8fa-f7559e25aca5-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:05:07 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-b5739382-3e9d-49b6-b6c3-685d835df9fe tempest-CreateVolumesFromSnapshotTest-778065099 None] Acquiring lock "cinder-quobyte-ece3a2ec-3e24-499a-b8fa-f7559e25aca5" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:05:07 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-b5739382-3e9d-49b6-b6c3-685d835df9fe tempest-CreateVolumesFromSnapshotTest-778065099 None] Lock "cinder-quobyte-ece3a2ec-3e24-499a-b8fa-f7559e25aca5" acquired by "delete_volume" :: waited 0.014s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:05:07 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d598afb-8418-4407-9398-89d2b5503f10]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:05:07 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b5739382-3e9d-49b6-b6c3-685d835df9fe tempest-CreateVolumesFromSnapshotTest-778065099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ece3a2ec-3e24-499a-b8fa-f7559e25aca5 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:08 devstack sudo[106356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ece3a2ec-3e24-499a-b8fa-f7559e25aca5 Jul 08 02:05:08 devstack sudo[106356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:08 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:08 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b26ec37a-fc05-4089-9391-e758a9da7302 tempest-VolumeDependencyTests-1851628812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3b8d99b5-ab2e-46e1-bab3-1f03aa238713 1073741824" returned: 0 in 1.015s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:08 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b26ec37a-fc05-4089-9391-e758a9da7302 tempest-VolumeDependencyTests-1851628812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3b8d99b5-ab2e-46e1-bab3-1f03aa238713 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:08 devstack sudo[106363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3b8d99b5-ab2e-46e1-bab3-1f03aa238713 Jul 08 02:05:08 devstack sudo[106363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:08 devstack sudo[106356]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:08 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b5739382-3e9d-49b6-b6c3-685d835df9fe tempest-CreateVolumesFromSnapshotTest-778065099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ece3a2ec-3e24-499a-b8fa-f7559e25aca5" returned: 0 in 0.955s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:08 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b5739382-3e9d-49b6-b6c3-685d835df9fe tempest-CreateVolumesFromSnapshotTest-778065099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ece3a2ec-3e24-499a-b8fa-f7559e25aca5 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:08 devstack sudo[106368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ece3a2ec-3e24-499a-b8fa-f7559e25aca5 Jul 08 02:05:08 devstack sudo[106368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:09 devstack sudo[106363]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:09 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b26ec37a-fc05-4089-9391-e758a9da7302 tempest-VolumeDependencyTests-1851628812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3b8d99b5-ab2e-46e1-bab3-1f03aa238713" returned: 0 in 0.785s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:09 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-b26ec37a-fc05-4089-9391-e758a9da7302 tempest-VolumeDependencyTests-1851628812 None] <== create_volume: return (1867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:05:09 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b26ec37a-fc05-4089-9391-e758a9da7302 tempest-VolumeDependencyTests-1851628812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.871s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:05:09 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-ab27eed8-eff8-41df-a808-a53186d9c912 tempest-CinderUnicodeTest-1150296208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.319s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:05:09 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-ab27eed8-eff8-41df-a808-a53186d9c912 tempest-CinderUnicodeTest-1150296208 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:05:06Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-712858209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1002d122-87cd-454f-bbab-34047435c8ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3cd09c84ab242d4b46264d5ff227e81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:05:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:05:06Z,use_quota=True,user_id='b8852d68476b4c05bd27c4b84a839292',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:05:09 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-ab27eed8-eff8-41df-a808-a53186d9c912 tempest-CinderUnicodeTest-1150296208 None] Creating volume 1002d122-87cd-454f-bbab-34047435c8ab {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:05:09 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-ab27eed8-eff8-41df-a808-a53186d9c912 tempest-CinderUnicodeTest-1150296208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:05:09 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-ab27eed8-eff8-41df-a808-a53186d9c912 tempest-CinderUnicodeTest-1150296208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:05:09 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-ab27eed8-eff8-41df-a808-a53186d9c912 tempest-CinderUnicodeTest-1150296208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:05:09 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-ab27eed8-eff8-41df-a808-a53186d9c912 tempest-CinderUnicodeTest-1150296208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:05:09 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-ab27eed8-eff8-41df-a808-a53186d9c912 tempest-CinderUnicodeTest-1150296208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:05:09 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-ab27eed8-eff8-41df-a808-a53186d9c912 tempest-CinderUnicodeTest-1150296208 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:05:09 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-ab27eed8-eff8-41df-a808-a53186d9c912 tempest-CinderUnicodeTest-1150296208 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 02:05:09 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ab27eed8-eff8-41df-a808-a53186d9c912 tempest-CinderUnicodeTest-1150296208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1002d122-87cd-454f-bbab-34047435c8ab 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:09 devstack sudo[106371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1002d122-87cd-454f-bbab-34047435c8ab 1073741824 Jul 08 02:05:09 devstack sudo[106371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:09 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b26ec37a-fc05-4089-9391-e758a9da7302 tempest-VolumeDependencyTests-1851628812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5268b6e1-042a-4cd0-9468-ef0fca8e6b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b8d99b5-ab2e-46e1-bab3-1f03aa238713', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:05:09 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b26ec37a-fc05-4089-9391-e758a9da7302 tempest-VolumeDependencyTests-1851628812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16824b99-468f-49ae-90e3-330f6d8be431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:05:09 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-b26ec37a-fc05-4089-9391-e758a9da7302 tempest-VolumeDependencyTests-1851628812 None] Volume volume-3b8d99b5-ab2e-46e1-bab3-1f03aa238713 (3b8d99b5-ab2e-46e1-bab3-1f03aa238713): created successfully Jul 08 02:05:09 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b26ec37a-fc05-4089-9391-e758a9da7302 tempest-VolumeDependencyTests-1851628812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16824b99-468f-49ae-90e3-330f6d8be431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:05:09 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-b26ec37a-fc05-4089-9391-e758a9da7302 tempest-VolumeDependencyTests-1851628812 None] Flow 'volume_create_manager' (38366185-4250-4528-a75d-138b390a4e36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:05:09 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-b26ec37a-fc05-4089-9391-e758a9da7302 tempest-VolumeDependencyTests-1851628812 None] Created volume successfully. Jul 08 02:05:09 devstack sudo[106368]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:09 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b5739382-3e9d-49b6-b6c3-685d835df9fe tempest-CreateVolumesFromSnapshotTest-778065099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ece3a2ec-3e24-499a-b8fa-f7559e25aca5" returned: 0 in 0.755s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:09 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-b5739382-3e9d-49b6-b6c3-685d835df9fe tempest-CreateVolumesFromSnapshotTest-778065099 None] Lock "cinder-quobyte-ece3a2ec-3e24-499a-b8fa-f7559e25aca5" released by "delete_volume" :: held 1.755s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:05:09 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-b5739382-3e9d-49b6-b6c3-685d835df9fe tempest-CreateVolumesFromSnapshotTest-778065099 None] Created reservations ['801455fd-e4e0-4c94-be5d-9be546fe2b1c', '15b9eae1-a820-4588-b047-4b94f67cc5db', '00c37af4-9629-4033-b624-19b07f816ecc', '9ae7dd0d-4fe9-4be2-8c83-08b40db4d092'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:05:09 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b5739382-3e9d-49b6-b6c3-685d835df9fe tempest-CreateVolumesFromSnapshotTest-778065099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:05:09 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b5739382-3e9d-49b6-b6c3-685d835df9fe tempest-CreateVolumesFromSnapshotTest-778065099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:05:09 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-b5739382-3e9d-49b6-b6c3-685d835df9fe tempest-CreateVolumesFromSnapshotTest-778065099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:05:09 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-b5739382-3e9d-49b6-b6c3-685d835df9fe tempest-CreateVolumesFromSnapshotTest-778065099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:05:09 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b5739382-3e9d-49b6-b6c3-685d835df9fe tempest-CreateVolumesFromSnapshotTest-778065099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:05:09 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b5739382-3e9d-49b6-b6c3-685d835df9fe tempest-CreateVolumesFromSnapshotTest-778065099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:09 devstack sudo[106376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 02:05:09 devstack sudo[106376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:10 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-99444590-5953-4387-a61a-61ac5a5be1f1 tempest-VolumeDependencyTests-1851628812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:05:10 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-b44cc6b4-34d1-4e1e-89a2-68ec1d40086a tempest-CreateVolumesFromSnapshotTest-778065099 None] Acquiring lock "cinder-ed4f5442-1930-4b37-844e-194f0e56bbe6-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:05:10 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-b44cc6b4-34d1-4e1e-89a2-68ec1d40086a tempest-CreateVolumesFromSnapshotTest-778065099 None] Lock "cinder-ed4f5442-1930-4b37-844e-194f0e56bbe6-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:05:10 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-b44cc6b4-34d1-4e1e-89a2-68ec1d40086a tempest-CreateVolumesFromSnapshotTest-778065099 None] Acquiring lock "cinder-quobyte-ed4f5442-1930-4b37-844e-194f0e56bbe6" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:05:10 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-b44cc6b4-34d1-4e1e-89a2-68ec1d40086a tempest-CreateVolumesFromSnapshotTest-778065099 None] Lock "cinder-quobyte-ed4f5442-1930-4b37-844e-194f0e56bbe6" acquired by "delete_volume" :: waited 0.037s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:05:10 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdab5ff6-eaba-4b7d-a52a-69aad04b0028]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:05:10 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b44cc6b4-34d1-4e1e-89a2-68ec1d40086a tempest-CreateVolumesFromSnapshotTest-778065099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ed4f5442-1930-4b37-844e-194f0e56bbe6 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:10 devstack sudo[106381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ed4f5442-1930-4b37-844e-194f0e56bbe6 Jul 08 02:05:10 devstack sudo[106381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:10 devstack sudo[106371]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:10 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ab27eed8-eff8-41df-a808-a53186d9c912 tempest-CinderUnicodeTest-1150296208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1002d122-87cd-454f-bbab-34047435c8ab 1073741824" returned: 0 in 1.227s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:10 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ab27eed8-eff8-41df-a808-a53186d9c912 tempest-CinderUnicodeTest-1150296208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1002d122-87cd-454f-bbab-34047435c8ab {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:10 devstack sudo[106385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1002d122-87cd-454f-bbab-34047435c8ab Jul 08 02:05:10 devstack sudo[106385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:10 devstack sudo[106376]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:10 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b5739382-3e9d-49b6-b6c3-685d835df9fe tempest-CreateVolumesFromSnapshotTest-778065099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 1.000s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:10 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-b5739382-3e9d-49b6-b6c3-685d835df9fe tempest-CreateVolumesFromSnapshotTest-778065099 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:05:10 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-b5739382-3e9d-49b6-b6c3-685d835df9fe tempest-CreateVolumesFromSnapshotTest-778065099 None] Deleted volume successfully. Jul 08 02:05:10 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-b5739382-3e9d-49b6-b6c3-685d835df9fe tempest-CreateVolumesFromSnapshotTest-778065099 None] Lock "cinder-ece3a2ec-3e24-499a-b8fa-f7559e25aca5-delete_volume" released by "delete_volume" :: held 3.067s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:05:11 devstack sudo[106381]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:11 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b44cc6b4-34d1-4e1e-89a2-68ec1d40086a tempest-CreateVolumesFromSnapshotTest-778065099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ed4f5442-1930-4b37-844e-194f0e56bbe6" returned: 0 in 0.907s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:11 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b44cc6b4-34d1-4e1e-89a2-68ec1d40086a tempest-CreateVolumesFromSnapshotTest-778065099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ed4f5442-1930-4b37-844e-194f0e56bbe6 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:11 devstack sudo[106392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ed4f5442-1930-4b37-844e-194f0e56bbe6 Jul 08 02:05:11 devstack sudo[106392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:11 devstack sudo[106385]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:11 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ab27eed8-eff8-41df-a808-a53186d9c912 tempest-CinderUnicodeTest-1150296208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1002d122-87cd-454f-bbab-34047435c8ab" returned: 0 in 0.699s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:11 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-ab27eed8-eff8-41df-a808-a53186d9c912 tempest-CinderUnicodeTest-1150296208 None] <== create_volume: return (1987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:05:11 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-ab27eed8-eff8-41df-a808-a53186d9c912 tempest-CinderUnicodeTest-1150296208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.993s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:05:11 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-99444590-5953-4387-a61a-61ac5a5be1f1 tempest-VolumeDependencyTests-1851628812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.405s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:05:11 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ab27eed8-eff8-41df-a808-a53186d9c912 tempest-CinderUnicodeTest-1150296208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (892920c1-3449-4123-8498-282459db7f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1002d122-87cd-454f-bbab-34047435c8ab', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:05:11 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ab27eed8-eff8-41df-a808-a53186d9c912 tempest-CinderUnicodeTest-1150296208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34ecdfac-ea24-4d20-9f22-98d37ad01b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:05:11 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-99444590-5953-4387-a61a-61ac5a5be1f1 tempest-VolumeDependencyTests-1851628812 None] Creating offline snapshot 98531c57-a483-4717-9da8-4c4fdc92ca13 of volume 3b8d99b5-ab2e-46e1-bab3-1f03aa238713 {{(pid=87134) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 02:05:11 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-ab27eed8-eff8-41df-a808-a53186d9c912 tempest-CinderUnicodeTest-1150296208 None] Volume volume-1002d122-87cd-454f-bbab-34047435c8ab (1002d122-87cd-454f-bbab-34047435c8ab): created successfully Jul 08 02:05:11 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ab27eed8-eff8-41df-a808-a53186d9c912 tempest-CinderUnicodeTest-1150296208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34ecdfac-ea24-4d20-9f22-98d37ad01b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:05:11 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-ab27eed8-eff8-41df-a808-a53186d9c912 tempest-CinderUnicodeTest-1150296208 None] Flow 'volume_create_manager' (10884060-389f-4765-adb7-35743aba0e41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:05:11 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1932c8-4c7f-4300-b2cd-285cef22cbdc]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:05:11 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-99444590-5953-4387-a61a-61ac5a5be1f1 tempest-VolumeDependencyTests-1851628812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3b8d99b5-ab2e-46e1-bab3-1f03aa238713 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:11 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-ab27eed8-eff8-41df-a808-a53186d9c912 tempest-CinderUnicodeTest-1150296208 None] Created volume successfully. Jul 08 02:05:11 devstack sudo[106395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3b8d99b5-ab2e-46e1-bab3-1f03aa238713 Jul 08 02:05:11 devstack sudo[106395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:12 devstack sudo[106392]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:12 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b44cc6b4-34d1-4e1e-89a2-68ec1d40086a tempest-CreateVolumesFromSnapshotTest-778065099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ed4f5442-1930-4b37-844e-194f0e56bbe6" returned: 0 in 0.738s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:12 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-b44cc6b4-34d1-4e1e-89a2-68ec1d40086a tempest-CreateVolumesFromSnapshotTest-778065099 None] Lock "cinder-quobyte-ed4f5442-1930-4b37-844e-194f0e56bbe6" released by "delete_volume" :: held 1.711s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:05:12 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-b44cc6b4-34d1-4e1e-89a2-68ec1d40086a tempest-CreateVolumesFromSnapshotTest-778065099 None] Created reservations ['47cdf7f4-5022-4ed3-9fa5-e8f9df86f9fd', '790e083a-1d8f-4f61-a680-d0744a221f37', '81ca6a08-aed9-47f8-9976-d632d17492da', '91f58070-6bbf-461e-9340-72fc71b7cd0c'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:05:12 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b44cc6b4-34d1-4e1e-89a2-68ec1d40086a tempest-CreateVolumesFromSnapshotTest-778065099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:05:12 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b44cc6b4-34d1-4e1e-89a2-68ec1d40086a tempest-CreateVolumesFromSnapshotTest-778065099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:05:12 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-b44cc6b4-34d1-4e1e-89a2-68ec1d40086a tempest-CreateVolumesFromSnapshotTest-778065099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:05:12 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-b44cc6b4-34d1-4e1e-89a2-68ec1d40086a tempest-CreateVolumesFromSnapshotTest-778065099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:05:12 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b44cc6b4-34d1-4e1e-89a2-68ec1d40086a tempest-CreateVolumesFromSnapshotTest-778065099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:05:12 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b44cc6b4-34d1-4e1e-89a2-68ec1d40086a tempest-CreateVolumesFromSnapshotTest-778065099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:12 devstack sudo[106398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 02:05:12 devstack sudo[106398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:12 devstack sudo[106395]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:12 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-99444590-5953-4387-a61a-61ac5a5be1f1 tempest-VolumeDependencyTests-1851628812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3b8d99b5-ab2e-46e1-bab3-1f03aa238713" returned: 0 in 0.895s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:12 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-99444590-5953-4387-a61a-61ac5a5be1f1 tempest-VolumeDependencyTests-1851628812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3b8d99b5-ab2e-46e1-bab3-1f03aa238713,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3b8d99b5-ab2e-46e1-bab3-1f03aa238713.98531c57-a483-4717-9da8-4c4fdc92ca13 1G {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:12 devstack sudo[106404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3b8d99b5-ab2e-46e1-bab3-1f03aa238713,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3b8d99b5-ab2e-46e1-bab3-1f03aa238713.98531c57-a483-4717-9da8-4c4fdc92ca13 1G Jul 08 02:05:12 devstack sudo[106404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:12 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-303cd763-82fb-4cdd-9c27-a5062461dceb tempest-CreateVolumesFromSnapshotTest-778065099 None] Acquiring lock "cinder-c5ad9b85-5cf0-4271-8a19-4c9ec7ddafb5-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:05:12 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-303cd763-82fb-4cdd-9c27-a5062461dceb tempest-CreateVolumesFromSnapshotTest-778065099 None] Lock "cinder-c5ad9b85-5cf0-4271-8a19-4c9ec7ddafb5-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:05:12 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-303cd763-82fb-4cdd-9c27-a5062461dceb tempest-CreateVolumesFromSnapshotTest-778065099 None] Acquiring lock "cinder-quobyte-c5ad9b85-5cf0-4271-8a19-4c9ec7ddafb5" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:05:12 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-303cd763-82fb-4cdd-9c27-a5062461dceb tempest-CreateVolumesFromSnapshotTest-778065099 None] Lock "cinder-quobyte-c5ad9b85-5cf0-4271-8a19-4c9ec7ddafb5" acquired by "delete_volume" :: waited 0.026s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:05:12 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[25259748-6a79-474c-a03f-53910087c1ba]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:05:12 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-303cd763-82fb-4cdd-9c27-a5062461dceb tempest-CreateVolumesFromSnapshotTest-778065099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c5ad9b85-5cf0-4271-8a19-4c9ec7ddafb5 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:12 devstack sudo[106406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c5ad9b85-5cf0-4271-8a19-4c9ec7ddafb5 Jul 08 02:05:12 devstack sudo[106406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-906ffb3b-29de-4138-aaec-7e32b8acc63c tempest-CinderUnicodeTest-1150296208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:05:13 devstack sudo[106398]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b44cc6b4-34d1-4e1e-89a2-68ec1d40086a tempest-CreateVolumesFromSnapshotTest-778065099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 1.028s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:13 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-b44cc6b4-34d1-4e1e-89a2-68ec1d40086a tempest-CreateVolumesFromSnapshotTest-778065099 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:05:13 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-b44cc6b4-34d1-4e1e-89a2-68ec1d40086a tempest-CreateVolumesFromSnapshotTest-778065099 None] Deleted volume successfully. Jul 08 02:05:13 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-b44cc6b4-34d1-4e1e-89a2-68ec1d40086a tempest-CreateVolumesFromSnapshotTest-778065099 None] Lock "cinder-ed4f5442-1930-4b37-844e-194f0e56bbe6-delete_volume" released by "delete_volume" :: held 3.084s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:05:13 devstack sudo[106404]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-99444590-5953-4387-a61a-61ac5a5be1f1 tempest-VolumeDependencyTests-1851628812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3b8d99b5-ab2e-46e1-bab3-1f03aa238713,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3b8d99b5-ab2e-46e1-bab3-1f03aa238713.98531c57-a483-4717-9da8-4c4fdc92ca13 1G" returned: 0 in 1.177s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-99444590-5953-4387-a61a-61ac5a5be1f1 tempest-VolumeDependencyTests-1851628812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b8d99b5-ab2e-46e1-bab3-1f03aa238713 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3b8d99b5-ab2e-46e1-bab3-1f03aa238713.98531c57-a483-4717-9da8-4c4fdc92ca13 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:13 devstack sudo[106414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b8d99b5-ab2e-46e1-bab3-1f03aa238713 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3b8d99b5-ab2e-46e1-bab3-1f03aa238713.98531c57-a483-4717-9da8-4c4fdc92ca13 Jul 08 02:05:13 devstack sudo[106414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:13 devstack sudo[106406]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-303cd763-82fb-4cdd-9c27-a5062461dceb tempest-CreateVolumesFromSnapshotTest-778065099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c5ad9b85-5cf0-4271-8a19-4c9ec7ddafb5" returned: 0 in 1.101s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-303cd763-82fb-4cdd-9c27-a5062461dceb tempest-CreateVolumesFromSnapshotTest-778065099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c5ad9b85-5cf0-4271-8a19-4c9ec7ddafb5 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:13 devstack sudo[106419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c5ad9b85-5cf0-4271-8a19-4c9ec7ddafb5 Jul 08 02:05:13 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:14 devstack sudo[106414]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:14 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-99444590-5953-4387-a61a-61ac5a5be1f1 tempest-VolumeDependencyTests-1851628812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b8d99b5-ab2e-46e1-bab3-1f03aa238713 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3b8d99b5-ab2e-46e1-bab3-1f03aa238713.98531c57-a483-4717-9da8-4c4fdc92ca13" returned: 0 in 0.838s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:14 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-99444590-5953-4387-a61a-61ac5a5be1f1 tempest-VolumeDependencyTests-1851628812 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3b8d99b5-ab2e-46e1-bab3-1f03aa238713.98531c57-a483-4717-9da8-4c4fdc92ca13 is being set with open permissions: ugo+rw Jul 08 02:05:14 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-99444590-5953-4387-a61a-61ac5a5be1f1 tempest-VolumeDependencyTests-1851628812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3b8d99b5-ab2e-46e1-bab3-1f03aa238713.98531c57-a483-4717-9da8-4c4fdc92ca13 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:14 devstack sudo[106426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3b8d99b5-ab2e-46e1-bab3-1f03aa238713.98531c57-a483-4717-9da8-4c4fdc92ca13 Jul 08 02:05:14 devstack sudo[106426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:14 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:14 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-303cd763-82fb-4cdd-9c27-a5062461dceb tempest-CreateVolumesFromSnapshotTest-778065099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c5ad9b85-5cf0-4271-8a19-4c9ec7ddafb5" returned: 0 in 0.798s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:14 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-303cd763-82fb-4cdd-9c27-a5062461dceb tempest-CreateVolumesFromSnapshotTest-778065099 None] Lock "cinder-quobyte-c5ad9b85-5cf0-4271-8a19-4c9ec7ddafb5" released by "delete_volume" :: held 1.972s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:05:14 devstack cinder-volume[87134]: DEBUG dbcounter [-] [87134] Writing DB stats cinder:SELECT=138,cinder:UPDATE=200,cinder:INSERT=47,cinder:DELETE=15 {{(pid=87134) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:05:14 devstack cinder-volume[87134]: DEBUG dbcounter [-] [87134] Writing DB stats cinder:SELECT=137,cinder:UPDATE=184,cinder:INSERT=55,cinder:DELETE=23 {{(pid=87134) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:05:14 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-303cd763-82fb-4cdd-9c27-a5062461dceb tempest-CreateVolumesFromSnapshotTest-778065099 None] Created reservations ['01ddcdff-f1a6-49e9-953b-7a0f175b3f86', '09e4367b-1682-4242-9dd7-5a8244a240b2', '4d36460b-c197-4d84-8806-6412cc8dd357', '7921f38e-b2de-451f-9c89-206628b119eb'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:05:14 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-303cd763-82fb-4cdd-9c27-a5062461dceb tempest-CreateVolumesFromSnapshotTest-778065099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:05:14 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-303cd763-82fb-4cdd-9c27-a5062461dceb tempest-CreateVolumesFromSnapshotTest-778065099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:05:14 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-303cd763-82fb-4cdd-9c27-a5062461dceb tempest-CreateVolumesFromSnapshotTest-778065099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:05:14 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-303cd763-82fb-4cdd-9c27-a5062461dceb tempest-CreateVolumesFromSnapshotTest-778065099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:05:14 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-303cd763-82fb-4cdd-9c27-a5062461dceb tempest-CreateVolumesFromSnapshotTest-778065099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:05:14 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-303cd763-82fb-4cdd-9c27-a5062461dceb tempest-CreateVolumesFromSnapshotTest-778065099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:14 devstack sudo[106429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 02:05:14 devstack sudo[106429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:14 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-40415a69-3151-43e5-b310-37cf9d4579bd tempest-CreateVolumesFromSnapshotTest-778065099 None] Acquiring lock "cinder-de624bb9-849f-4b89-9334-15874ec94dca-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:05:14 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-40415a69-3151-43e5-b310-37cf9d4579bd tempest-CreateVolumesFromSnapshotTest-778065099 None] Lock "cinder-de624bb9-849f-4b89-9334-15874ec94dca-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:05:14 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-40415a69-3151-43e5-b310-37cf9d4579bd tempest-CreateVolumesFromSnapshotTest-778065099 None] Acquiring lock "cinder-quobyte-de624bb9-849f-4b89-9334-15874ec94dca" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:05:15 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-40415a69-3151-43e5-b310-37cf9d4579bd tempest-CreateVolumesFromSnapshotTest-778065099 None] Lock "cinder-quobyte-de624bb9-849f-4b89-9334-15874ec94dca" acquired by "delete_volume" :: waited 0.028s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:05:15 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a6c1f9-7557-4f1a-a53f-c58e357049f7]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:05:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-40415a69-3151-43e5-b310-37cf9d4579bd tempest-CreateVolumesFromSnapshotTest-778065099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-de624bb9-849f-4b89-9334-15874ec94dca {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:15 devstack sudo[106431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-de624bb9-849f-4b89-9334-15874ec94dca Jul 08 02:05:15 devstack sudo[106431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:15 devstack sudo[106426]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-99444590-5953-4387-a61a-61ac5a5be1f1 tempest-VolumeDependencyTests-1851628812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3b8d99b5-ab2e-46e1-bab3-1f03aa238713.98531c57-a483-4717-9da8-4c4fdc92ca13" returned: 0 in 1.077s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-99444590-5953-4387-a61a-61ac5a5be1f1 tempest-VolumeDependencyTests-1851628812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3b8d99b5-ab2e-46e1-bab3-1f03aa238713.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:15 devstack sudo[106434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3b8d99b5-ab2e-46e1-bab3-1f03aa238713.info Jul 08 02:05:15 devstack sudo[106434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:15 devstack sudo[106429]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-303cd763-82fb-4cdd-9c27-a5062461dceb tempest-CreateVolumesFromSnapshotTest-778065099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 1.053s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:15 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-303cd763-82fb-4cdd-9c27-a5062461dceb tempest-CreateVolumesFromSnapshotTest-778065099 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:05:15 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-303cd763-82fb-4cdd-9c27-a5062461dceb tempest-CreateVolumesFromSnapshotTest-778065099 None] Deleted volume successfully. Jul 08 02:05:15 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-303cd763-82fb-4cdd-9c27-a5062461dceb tempest-CreateVolumesFromSnapshotTest-778065099 None] Lock "cinder-c5ad9b85-5cf0-4271-8a19-4c9ec7ddafb5-delete_volume" released by "delete_volume" :: held 3.443s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:05:16 devstack sudo[106431]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-40415a69-3151-43e5-b310-37cf9d4579bd tempest-CreateVolumesFromSnapshotTest-778065099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-de624bb9-849f-4b89-9334-15874ec94dca" returned: 0 in 1.139s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-40415a69-3151-43e5-b310-37cf9d4579bd tempest-CreateVolumesFromSnapshotTest-778065099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-de624bb9-849f-4b89-9334-15874ec94dca {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:16 devstack sudo[106441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-de624bb9-849f-4b89-9334-15874ec94dca Jul 08 02:05:16 devstack sudo[106441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:16 devstack sudo[106434]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-99444590-5953-4387-a61a-61ac5a5be1f1 tempest-VolumeDependencyTests-1851628812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3b8d99b5-ab2e-46e1-bab3-1f03aa238713.info" returned: 0 in 0.884s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:16 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-99444590-5953-4387-a61a-61ac5a5be1f1 tempest-VolumeDependencyTests-1851628812 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3b8d99b5-ab2e-46e1-bab3-1f03aa238713.info is being set with open permissions: ugo+rw Jul 08 02:05:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-99444590-5953-4387-a61a-61ac5a5be1f1 tempest-VolumeDependencyTests-1851628812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3b8d99b5-ab2e-46e1-bab3-1f03aa238713.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:16 devstack sudo[106444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3b8d99b5-ab2e-46e1-bab3-1f03aa238713.info Jul 08 02:05:16 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:16 devstack sudo[106441]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-40415a69-3151-43e5-b310-37cf9d4579bd tempest-CreateVolumesFromSnapshotTest-778065099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-de624bb9-849f-4b89-9334-15874ec94dca" returned: 0 in 0.770s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:16 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-40415a69-3151-43e5-b310-37cf9d4579bd tempest-CreateVolumesFromSnapshotTest-778065099 None] Lock "cinder-quobyte-de624bb9-849f-4b89-9334-15874ec94dca" released by "delete_volume" :: held 1.978s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:05:17 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-40415a69-3151-43e5-b310-37cf9d4579bd tempest-CreateVolumesFromSnapshotTest-778065099 None] Created reservations ['31fdbbf8-1011-4c7a-a5d5-f9f877c3a3ef', '46fa4f82-c879-47d8-8687-ec3715b3462f', '9562895b-0331-4cb7-8f24-234916495cb9', '43e93537-ee86-4850-a063-e03bd900e83e'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:05:17 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-99444590-5953-4387-a61a-61ac5a5be1f1 tempest-VolumeDependencyTests-1851628812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3b8d99b5-ab2e-46e1-bab3-1f03aa238713.info" returned: 0 in 0.699s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-99444590-5953-4387-a61a-61ac5a5be1f1 tempest-VolumeDependencyTests-1851628812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.721s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:05:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-906ffb3b-29de-4138-aaec-7e32b8acc63c tempest-CinderUnicodeTest-1150296208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.067s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:05:17 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-906ffb3b-29de-4138-aaec-7e32b8acc63c tempest-CinderUnicodeTest-1150296208 None] Creating offline snapshot c939f3ca-59a9-40f2-ad50-216aa834646c of volume 1002d122-87cd-454f-bbab-34047435c8ab {{(pid=87134) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 02:05:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-40415a69-3151-43e5-b310-37cf9d4579bd tempest-CreateVolumesFromSnapshotTest-778065099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:05:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-40415a69-3151-43e5-b310-37cf9d4579bd tempest-CreateVolumesFromSnapshotTest-778065099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:05:17 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-40415a69-3151-43e5-b310-37cf9d4579bd tempest-CreateVolumesFromSnapshotTest-778065099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:05:17 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-40415a69-3151-43e5-b310-37cf9d4579bd tempest-CreateVolumesFromSnapshotTest-778065099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:05:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-40415a69-3151-43e5-b310-37cf9d4579bd tempest-CreateVolumesFromSnapshotTest-778065099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:05:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-40415a69-3151-43e5-b310-37cf9d4579bd tempest-CreateVolumesFromSnapshotTest-778065099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:17 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[5503e153-9ca5-4648-8463-4897f669120f]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:05:17 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-3cf9bf93-345f-48c9-9a38-fc8d30ae1a9d tempest-CreateVolumesFromSnapshotTest-778065099 None] Acquiring lock "cinder-976f07c3-8168-4e74-aa99-4618d4bb1c3f-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:05:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-906ffb3b-29de-4138-aaec-7e32b8acc63c tempest-CinderUnicodeTest-1150296208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1002d122-87cd-454f-bbab-34047435c8ab {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:17 devstack sudo[106448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 02:05:17 devstack sudo[106448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:17 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-99444590-5953-4387-a61a-61ac5a5be1f1 tempest-VolumeDependencyTests-1851628812 None] Create snapshot completed successfully Jul 08 02:05:17 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-3cf9bf93-345f-48c9-9a38-fc8d30ae1a9d tempest-CreateVolumesFromSnapshotTest-778065099 None] Lock "cinder-976f07c3-8168-4e74-aa99-4618d4bb1c3f-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:05:17 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-3cf9bf93-345f-48c9-9a38-fc8d30ae1a9d tempest-CreateVolumesFromSnapshotTest-778065099 None] Acquiring lock "cinder-quobyte-976f07c3-8168-4e74-aa99-4618d4bb1c3f" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:05:17 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-3cf9bf93-345f-48c9-9a38-fc8d30ae1a9d tempest-CreateVolumesFromSnapshotTest-778065099 None] Lock "cinder-quobyte-976f07c3-8168-4e74-aa99-4618d4bb1c3f" acquired by "delete_volume" :: waited 0.025s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:05:17 devstack sudo[106449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1002d122-87cd-454f-bbab-34047435c8ab Jul 08 02:05:17 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:17 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1cdaafd-6595-499a-aada-dae3c5022ed5]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:05:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-3cf9bf93-345f-48c9-9a38-fc8d30ae1a9d tempest-CreateVolumesFromSnapshotTest-778065099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-976f07c3-8168-4e74-aa99-4618d4bb1c3f {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:17 devstack sudo[106452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-976f07c3-8168-4e74-aa99-4618d4bb1c3f Jul 08 02:05:17 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:18 devstack sudo[106448]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-40415a69-3151-43e5-b310-37cf9d4579bd tempest-CreateVolumesFromSnapshotTest-778065099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.909s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:18 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-40415a69-3151-43e5-b310-37cf9d4579bd tempest-CreateVolumesFromSnapshotTest-778065099 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:05:18 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-40415a69-3151-43e5-b310-37cf9d4579bd tempest-CreateVolumesFromSnapshotTest-778065099 None] Deleted volume successfully. Jul 08 02:05:18 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-40415a69-3151-43e5-b310-37cf9d4579bd tempest-CreateVolumesFromSnapshotTest-778065099 None] Lock "cinder-de624bb9-849f-4b89-9334-15874ec94dca-delete_volume" released by "delete_volume" :: held 3.312s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:05:18 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-906ffb3b-29de-4138-aaec-7e32b8acc63c tempest-CinderUnicodeTest-1150296208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1002d122-87cd-454f-bbab-34047435c8ab" returned: 0 in 1.011s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-906ffb3b-29de-4138-aaec-7e32b8acc63c tempest-CinderUnicodeTest-1150296208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1002d122-87cd-454f-bbab-34047435c8ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1002d122-87cd-454f-bbab-34047435c8ab.c939f3ca-59a9-40f2-ad50-216aa834646c 1G {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:18 devstack sudo[106459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1002d122-87cd-454f-bbab-34047435c8ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1002d122-87cd-454f-bbab-34047435c8ab.c939f3ca-59a9-40f2-ad50-216aa834646c 1G Jul 08 02:05:18 devstack sudo[106459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:18 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-3cf9bf93-345f-48c9-9a38-fc8d30ae1a9d tempest-CreateVolumesFromSnapshotTest-778065099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-976f07c3-8168-4e74-aa99-4618d4bb1c3f" returned: 0 in 1.077s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-3cf9bf93-345f-48c9-9a38-fc8d30ae1a9d tempest-CreateVolumesFromSnapshotTest-778065099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-976f07c3-8168-4e74-aa99-4618d4bb1c3f {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:18 devstack sudo[106464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-976f07c3-8168-4e74-aa99-4618d4bb1c3f Jul 08 02:05:18 devstack sudo[106464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:19 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-7db3b96d-0125-4cb6-98af-24bd4d6360c8 tempest-VolumeDependencyTests-1851628812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:05:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-7db3b96d-0125-4cb6-98af-24bd4d6360c8 tempest-VolumeDependencyTests-1851628812 None] Flow 'volume_create_manager' (b3737f8e-5a5e-465a-b399-5a689bec0c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:05:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-7db3b96d-0125-4cb6-98af-24bd4d6360c8 tempest-VolumeDependencyTests-1851628812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (547eed33-d498-405d-a373-6efbbf235eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:05:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-7db3b96d-0125-4cb6-98af-24bd4d6360c8 tempest-VolumeDependencyTests-1851628812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (547eed33-d498-405d-a373-6efbbf235eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:05:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2029226988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00c54faa-1757-4ea5-b6aa-d01ca43bbf31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92b5893263a34c99a9e77140ba2345cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:05:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=98531c57-a483-4717-9da8-4c4fdc92ca13,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:05:19Z,use_quota=True,user_id='6614ba15035b49a098b565f50bab32a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:05:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-7db3b96d-0125-4cb6-98af-24bd4d6360c8 tempest-VolumeDependencyTests-1851628812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5796d9b-a1a2-4dfa-b003-a2384b49f4a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:05:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-7db3b96d-0125-4cb6-98af-24bd4d6360c8 tempest-VolumeDependencyTests-1851628812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5796d9b-a1a2-4dfa-b003-a2384b49f4a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:05:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-7db3b96d-0125-4cb6-98af-24bd4d6360c8 tempest-VolumeDependencyTests-1851628812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e38d6c0b-abf7-41f2-8e1c-64b8fa2163a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:05:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-7db3b96d-0125-4cb6-98af-24bd4d6360c8 tempest-VolumeDependencyTests-1851628812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e38d6c0b-abf7-41f2-8e1c-64b8fa2163a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '00c54faa-1757-4ea5-b6aa-d01ca43bbf31', 'volume_name': 'volume-00c54faa-1757-4ea5-b6aa-d01ca43bbf31', 'volume_size': 1, 'snapshot_id': '98531c57-a483-4717-9da8-4c4fdc92ca13'}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:05:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-7db3b96d-0125-4cb6-98af-24bd4d6360c8 tempest-VolumeDependencyTests-1851628812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d4e444a-9433-4e1c-82ed-144077898687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:05:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-7db3b96d-0125-4cb6-98af-24bd4d6360c8 tempest-VolumeDependencyTests-1851628812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d4e444a-9433-4e1c-82ed-144077898687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:05:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-7db3b96d-0125-4cb6-98af-24bd4d6360c8 tempest-VolumeDependencyTests-1851628812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60e1c0dc-5019-47f4-b7c0-84516e4c99d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:05:19 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-7db3b96d-0125-4cb6-98af-24bd4d6360c8 tempest-VolumeDependencyTests-1851628812 None] Volume 00c54faa-1757-4ea5-b6aa-d01ca43bbf31: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-00c54faa-1757-4ea5-b6aa-d01ca43bbf31', 'volume_size': 1, 'snapshot_id': '98531c57-a483-4717-9da8-4c4fdc92ca13'} Jul 08 02:05:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7db3b96d-0125-4cb6-98af-24bd4d6360c8 tempest-VolumeDependencyTests-1851628812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:05:19 devstack sudo[106464]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-3cf9bf93-345f-48c9-9a38-fc8d30ae1a9d tempest-CreateVolumesFromSnapshotTest-778065099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-976f07c3-8168-4e74-aa99-4618d4bb1c3f" returned: 0 in 0.861s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:19 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-3cf9bf93-345f-48c9-9a38-fc8d30ae1a9d tempest-CreateVolumesFromSnapshotTest-778065099 None] Lock "cinder-quobyte-976f07c3-8168-4e74-aa99-4618d4bb1c3f" released by "delete_volume" :: held 2.010s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:05:19 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-3cf9bf93-345f-48c9-9a38-fc8d30ae1a9d tempest-CreateVolumesFromSnapshotTest-778065099 None] Created reservations ['e66264db-d124-4793-b480-0631b761e01f', '887ea095-7d4f-46c2-91c6-cd901243944e', '64839ac2-3eb0-4d40-b64e-bbac6813c5d0', '3e2ad965-d82b-45c3-be10-2112792c6148'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:05:19 devstack sudo[106459]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-906ffb3b-29de-4138-aaec-7e32b8acc63c tempest-CinderUnicodeTest-1150296208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1002d122-87cd-454f-bbab-34047435c8ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1002d122-87cd-454f-bbab-34047435c8ab.c939f3ca-59a9-40f2-ad50-216aa834646c 1G" returned: 0 in 1.351s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-906ffb3b-29de-4138-aaec-7e32b8acc63c tempest-CinderUnicodeTest-1150296208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1002d122-87cd-454f-bbab-34047435c8ab -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1002d122-87cd-454f-bbab-34047435c8ab.c939f3ca-59a9-40f2-ad50-216aa834646c {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:19 devstack sudo[106471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1002d122-87cd-454f-bbab-34047435c8ab -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1002d122-87cd-454f-bbab-34047435c8ab.c939f3ca-59a9-40f2-ad50-216aa834646c Jul 08 02:05:19 devstack sudo[106471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-3cf9bf93-345f-48c9-9a38-fc8d30ae1a9d tempest-CreateVolumesFromSnapshotTest-778065099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:05:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-3cf9bf93-345f-48c9-9a38-fc8d30ae1a9d tempest-CreateVolumesFromSnapshotTest-778065099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:05:19 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-3cf9bf93-345f-48c9-9a38-fc8d30ae1a9d tempest-CreateVolumesFromSnapshotTest-778065099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:05:19 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-3cf9bf93-345f-48c9-9a38-fc8d30ae1a9d tempest-CreateVolumesFromSnapshotTest-778065099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:05:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-3cf9bf93-345f-48c9-9a38-fc8d30ae1a9d tempest-CreateVolumesFromSnapshotTest-778065099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:05:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-3cf9bf93-345f-48c9-9a38-fc8d30ae1a9d tempest-CreateVolumesFromSnapshotTest-778065099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:19 devstack sudo[106473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 02:05:19 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:20 devstack sudo[106471]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-906ffb3b-29de-4138-aaec-7e32b8acc63c tempest-CinderUnicodeTest-1150296208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1002d122-87cd-454f-bbab-34047435c8ab -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1002d122-87cd-454f-bbab-34047435c8ab.c939f3ca-59a9-40f2-ad50-216aa834646c" returned: 0 in 0.805s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:20 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-906ffb3b-29de-4138-aaec-7e32b8acc63c tempest-CinderUnicodeTest-1150296208 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1002d122-87cd-454f-bbab-34047435c8ab.c939f3ca-59a9-40f2-ad50-216aa834646c is being set with open permissions: ugo+rw Jul 08 02:05:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-906ffb3b-29de-4138-aaec-7e32b8acc63c tempest-CinderUnicodeTest-1150296208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1002d122-87cd-454f-bbab-34047435c8ab.c939f3ca-59a9-40f2-ad50-216aa834646c {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:20 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-3cf9bf93-345f-48c9-9a38-fc8d30ae1a9d tempest-CreateVolumesFromSnapshotTest-778065099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.753s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:20 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-3cf9bf93-345f-48c9-9a38-fc8d30ae1a9d tempest-CreateVolumesFromSnapshotTest-778065099 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:05:20 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-3cf9bf93-345f-48c9-9a38-fc8d30ae1a9d tempest-CreateVolumesFromSnapshotTest-778065099 None] Deleted volume successfully. Jul 08 02:05:20 devstack sudo[106480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1002d122-87cd-454f-bbab-34047435c8ab.c939f3ca-59a9-40f2-ad50-216aa834646c Jul 08 02:05:20 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:20 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-3cf9bf93-345f-48c9-9a38-fc8d30ae1a9d tempest-CreateVolumesFromSnapshotTest-778065099 None] Lock "cinder-976f07c3-8168-4e74-aa99-4618d4bb1c3f-delete_volume" released by "delete_volume" :: held 3.167s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:05:20 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-cf932f9f-775c-4a98-aeaa-a7b76081d129 tempest-CreateVolumesFromSnapshotTest-778065099 None] Acquiring lock "cinder-457637e6-0f1b-4239-befd-9830c9f4284d-delete_snapshot" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:05:20 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-cf932f9f-775c-4a98-aeaa-a7b76081d129 tempest-CreateVolumesFromSnapshotTest-778065099 None] Lock "cinder-457637e6-0f1b-4239-befd-9830c9f4284d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:05:20 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-cf932f9f-775c-4a98-aeaa-a7b76081d129 tempest-CreateVolumesFromSnapshotTest-778065099 None] Acquiring lock "cinder-quobyte-ed792afe-618f-4a3c-8993-912f727893df" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:05:20 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-cf932f9f-775c-4a98-aeaa-a7b76081d129 tempest-CreateVolumesFromSnapshotTest-778065099 None] Lock "cinder-quobyte-ed792afe-618f-4a3c-8993-912f727893df" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:05:20 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-cf932f9f-775c-4a98-aeaa-a7b76081d129 tempest-CreateVolumesFromSnapshotTest-778065099 None] Acquiring lock "cinder-quobyte-457637e6-0f1b-4239-befd-9830c9f4284d" by "_delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:05:20 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-cf932f9f-775c-4a98-aeaa-a7b76081d129 tempest-CreateVolumesFromSnapshotTest-778065099 None] Lock "cinder-quobyte-457637e6-0f1b-4239-befd-9830c9f4284d" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:05:20 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-cf932f9f-775c-4a98-aeaa-a7b76081d129 tempest-CreateVolumesFromSnapshotTest-778065099 None] Deleting offline snapshot 457637e6-0f1b-4239-befd-9830c9f4284d of volume ed792afe-618f-4a3c-8993-912f727893df {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 02:05:20 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-cf932f9f-775c-4a98-aeaa-a7b76081d129 tempest-CreateVolumesFromSnapshotTest-778065099 None] snapshot_file for this snap is: volume-ed792afe-618f-4a3c-8993-912f727893df.457637e6-0f1b-4239-befd-9830c9f4284d {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 02:05:20 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd367a1a-6f50-4897-845d-fd1289a230fb]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:05:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-cf932f9f-775c-4a98-aeaa-a7b76081d129 tempest-CreateVolumesFromSnapshotTest-778065099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ed792afe-618f-4a3c-8993-912f727893df.457637e6-0f1b-4239-befd-9830c9f4284d {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:20 devstack cinder-volume[87134]: DEBUG oslo_service.periodic_task [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87134) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 02:05:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:05:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:05:20 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:05:20 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:05:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:05:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:20 devstack sudo[106482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ed792afe-618f-4a3c-8993-912f727893df.457637e6-0f1b-4239-befd-9830c9f4284d Jul 08 02:05:20 devstack sudo[106482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:20 devstack sudo[106483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 02:05:20 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:21 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-906ffb3b-29de-4138-aaec-7e32b8acc63c tempest-CinderUnicodeTest-1150296208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1002d122-87cd-454f-bbab-34047435c8ab.c939f3ca-59a9-40f2-ad50-216aa834646c" returned: 0 in 0.786s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-906ffb3b-29de-4138-aaec-7e32b8acc63c tempest-CinderUnicodeTest-1150296208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1002d122-87cd-454f-bbab-34047435c8ab.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:21 devstack sudo[106487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1002d122-87cd-454f-bbab-34047435c8ab.info Jul 08 02:05:21 devstack sudo[106487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:21 devstack sudo[106482]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-cf932f9f-775c-4a98-aeaa-a7b76081d129 tempest-CreateVolumesFromSnapshotTest-778065099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ed792afe-618f-4a3c-8993-912f727893df.457637e6-0f1b-4239-befd-9830c9f4284d" returned: 0 in 0.957s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:21 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-cf932f9f-775c-4a98-aeaa-a7b76081d129 tempest-CreateVolumesFromSnapshotTest-778065099 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed792afe-618f-4a3c-8993-912f727893df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:05:21 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.905s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:21 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:05:21 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af92f63-0a85-4590-88af-89af4a05259b]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:05:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-cf932f9f-775c-4a98-aeaa-a7b76081d129 tempest-CreateVolumesFromSnapshotTest-778065099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ed792afe-618f-4a3c-8993-912f727893df {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:21 devstack cinder-volume[87134]: DEBUG oslo_service.periodic_task [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running periodic task VolumeManager._thread_info {{(pid=87134) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 02:05:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] thread count: 28 {{(pid=87134) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 02:05:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] thread info: [<_MainThread(MainThread, started 129378964615296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87134) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 02:05:21 devstack sudo[106493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ed792afe-618f-4a3c-8993-912f727893df Jul 08 02:05:21 devstack sudo[106493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:22 devstack sudo[106487]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-906ffb3b-29de-4138-aaec-7e32b8acc63c tempest-CinderUnicodeTest-1150296208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1002d122-87cd-454f-bbab-34047435c8ab.info" returned: 0 in 0.810s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:22 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-906ffb3b-29de-4138-aaec-7e32b8acc63c tempest-CinderUnicodeTest-1150296208 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1002d122-87cd-454f-bbab-34047435c8ab.info is being set with open permissions: ugo+rw Jul 08 02:05:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-906ffb3b-29de-4138-aaec-7e32b8acc63c tempest-CinderUnicodeTest-1150296208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1002d122-87cd-454f-bbab-34047435c8ab.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:22 devstack sudo[106496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1002d122-87cd-454f-bbab-34047435c8ab.info Jul 08 02:05:22 devstack sudo[106496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:22 devstack sudo[106493]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-cf932f9f-775c-4a98-aeaa-a7b76081d129 tempest-CreateVolumesFromSnapshotTest-778065099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ed792afe-618f-4a3c-8993-912f727893df" returned: 0 in 0.899s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-cf932f9f-775c-4a98-aeaa-a7b76081d129 tempest-CreateVolumesFromSnapshotTest-778065099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ed792afe-618f-4a3c-8993-912f727893df.457637e6-0f1b-4239-befd-9830c9f4284d {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:22 devstack sudo[106501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ed792afe-618f-4a3c-8993-912f727893df.457637e6-0f1b-4239-befd-9830c9f4284d Jul 08 02:05:22 devstack sudo[106501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:22 devstack sudo[106496]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-906ffb3b-29de-4138-aaec-7e32b8acc63c tempest-CinderUnicodeTest-1150296208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1002d122-87cd-454f-bbab-34047435c8ab.info" returned: 0 in 0.757s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-906ffb3b-29de-4138-aaec-7e32b8acc63c tempest-CinderUnicodeTest-1150296208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.705s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:05:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7db3b96d-0125-4cb6-98af-24bd4d6360c8 tempest-VolumeDependencyTests-1851628812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.564s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:05:22 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7db3b96d-0125-4cb6-98af-24bd4d6360c8 tempest-VolumeDependencyTests-1851628812 None] Acquiring lock "cinder-quobyte-98531c57-a483-4717-9da8-4c4fdc92ca13-00c54faa-1757-4ea5-b6aa-d01ca43bbf31" by "_create_volume_from_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:05:22 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7db3b96d-0125-4cb6-98af-24bd4d6360c8 tempest-VolumeDependencyTests-1851628812 None] Lock "cinder-quobyte-98531c57-a483-4717-9da8-4c4fdc92ca13-00c54faa-1757-4ea5-b6aa-d01ca43bbf31" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:05:22 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-7db3b96d-0125-4cb6-98af-24bd4d6360c8 tempest-VolumeDependencyTests-1851628812 None] Creating volume 00c54faa-1757-4ea5-b6aa-d01ca43bbf31 from snapshot 98531c57-a483-4717-9da8-4c4fdc92ca13 {{(pid=87134) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 02:05:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7db3b96d-0125-4cb6-98af-24bd4d6360c8 tempest-VolumeDependencyTests-1851628812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:05:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7db3b96d-0125-4cb6-98af-24bd4d6360c8 tempest-VolumeDependencyTests-1851628812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:05:22 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-7db3b96d-0125-4cb6-98af-24bd4d6360c8 tempest-VolumeDependencyTests-1851628812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:05:22 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-7db3b96d-0125-4cb6-98af-24bd4d6360c8 tempest-VolumeDependencyTests-1851628812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:05:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7db3b96d-0125-4cb6-98af-24bd4d6360c8 tempest-VolumeDependencyTests-1851628812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:05:22 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-7db3b96d-0125-4cb6-98af-24bd4d6360c8 tempest-VolumeDependencyTests-1851628812 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:05:22 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7db3b96d-0125-4cb6-98af-24bd4d6360c8 tempest-VolumeDependencyTests-1851628812 None] Acquiring lock "cinder-quobyte-00c54faa-1757-4ea5-b6aa-d01ca43bbf31" by "_copy_volume_from_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:05:22 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-906ffb3b-29de-4138-aaec-7e32b8acc63c tempest-CinderUnicodeTest-1150296208 None] Create snapshot completed successfully Jul 08 02:05:22 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7db3b96d-0125-4cb6-98af-24bd4d6360c8 tempest-VolumeDependencyTests-1851628812 None] Lock "cinder-quobyte-00c54faa-1757-4ea5-b6aa-d01ca43bbf31" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:05:22 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-7db3b96d-0125-4cb6-98af-24bd4d6360c8 tempest-VolumeDependencyTests-1851628812 None] snapshot: 98531c57-a483-4717-9da8-4c4fdc92ca13, volume: 00c54faa-1757-4ea5-b6aa-d01ca43bbf31, {{(pid=87134) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 02:05:23 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7db3b96d-0125-4cb6-98af-24bd4d6360c8 tempest-VolumeDependencyTests-1851628812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:05:23 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7db3b96d-0125-4cb6-98af-24bd4d6360c8 tempest-VolumeDependencyTests-1851628812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:05:23 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-7db3b96d-0125-4cb6-98af-24bd4d6360c8 tempest-VolumeDependencyTests-1851628812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:05:23 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-7db3b96d-0125-4cb6-98af-24bd4d6360c8 tempest-VolumeDependencyTests-1851628812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:05:23 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7db3b96d-0125-4cb6-98af-24bd4d6360c8 tempest-VolumeDependencyTests-1851628812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:05:23 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0283fe-74c6-4939-af29-611a19a669bb]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:05:23 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7db3b96d-0125-4cb6-98af-24bd4d6360c8 tempest-VolumeDependencyTests-1851628812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3b8d99b5-ab2e-46e1-bab3-1f03aa238713.98531c57-a483-4717-9da8-4c4fdc92ca13 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:23 devstack sudo[106504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3b8d99b5-ab2e-46e1-bab3-1f03aa238713.98531c57-a483-4717-9da8-4c4fdc92ca13 Jul 08 02:05:23 devstack sudo[106504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:23 devstack sudo[106501]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:23 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-cf932f9f-775c-4a98-aeaa-a7b76081d129 tempest-CreateVolumesFromSnapshotTest-778065099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ed792afe-618f-4a3c-8993-912f727893df.457637e6-0f1b-4239-befd-9830c9f4284d" returned: 0 in 0.856s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:23 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-cf932f9f-775c-4a98-aeaa-a7b76081d129 tempest-CreateVolumesFromSnapshotTest-778065099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ed792afe-618f-4a3c-8993-912f727893df.457637e6-0f1b-4239-befd-9830c9f4284d {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:23 devstack sudo[106511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ed792afe-618f-4a3c-8993-912f727893df.457637e6-0f1b-4239-befd-9830c9f4284d Jul 08 02:05:23 devstack sudo[106511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:23 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-79c2887b-d873-49cf-a7c2-f507f32eb8eb tempest-CinderUnicodeTest-1150296208 None] Acquiring lock "cinder-c939f3ca-59a9-40f2-ad50-216aa834646c-delete_snapshot" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:05:23 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-79c2887b-d873-49cf-a7c2-f507f32eb8eb tempest-CinderUnicodeTest-1150296208 None] Lock "cinder-c939f3ca-59a9-40f2-ad50-216aa834646c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:05:23 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-79c2887b-d873-49cf-a7c2-f507f32eb8eb tempest-CinderUnicodeTest-1150296208 None] Acquiring lock "cinder-quobyte-1002d122-87cd-454f-bbab-34047435c8ab" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:05:23 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-79c2887b-d873-49cf-a7c2-f507f32eb8eb tempest-CinderUnicodeTest-1150296208 None] Lock "cinder-quobyte-1002d122-87cd-454f-bbab-34047435c8ab" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:05:23 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-79c2887b-d873-49cf-a7c2-f507f32eb8eb tempest-CinderUnicodeTest-1150296208 None] Acquiring lock "cinder-quobyte-c939f3ca-59a9-40f2-ad50-216aa834646c" by "_delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:05:23 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-79c2887b-d873-49cf-a7c2-f507f32eb8eb tempest-CinderUnicodeTest-1150296208 None] Lock "cinder-quobyte-c939f3ca-59a9-40f2-ad50-216aa834646c" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:05:23 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-79c2887b-d873-49cf-a7c2-f507f32eb8eb tempest-CinderUnicodeTest-1150296208 None] Deleting offline snapshot c939f3ca-59a9-40f2-ad50-216aa834646c of volume 1002d122-87cd-454f-bbab-34047435c8ab {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 02:05:23 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-79c2887b-d873-49cf-a7c2-f507f32eb8eb tempest-CinderUnicodeTest-1150296208 None] snapshot_file for this snap is: volume-1002d122-87cd-454f-bbab-34047435c8ab.c939f3ca-59a9-40f2-ad50-216aa834646c {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 02:05:23 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0ebeb1-114d-4af1-acc8-03258cbfb8cd]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:05:23 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-79c2887b-d873-49cf-a7c2-f507f32eb8eb tempest-CinderUnicodeTest-1150296208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1002d122-87cd-454f-bbab-34047435c8ab.c939f3ca-59a9-40f2-ad50-216aa834646c {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:23 devstack sudo[106513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1002d122-87cd-454f-bbab-34047435c8ab.c939f3ca-59a9-40f2-ad50-216aa834646c Jul 08 02:05:23 devstack sudo[106513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:24 devstack sudo[106504]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7db3b96d-0125-4cb6-98af-24bd4d6360c8 tempest-VolumeDependencyTests-1851628812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3b8d99b5-ab2e-46e1-bab3-1f03aa238713.98531c57-a483-4717-9da8-4c4fdc92ca13" returned: 0 in 0.998s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:24 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-7db3b96d-0125-4cb6-98af-24bd4d6360c8 tempest-VolumeDependencyTests-1851628812 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b8d99b5-ab2e-46e1-bab3-1f03aa238713(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:05:24 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-7db3b96d-0125-4cb6-98af-24bd4d6360c8 tempest-VolumeDependencyTests-1851628812 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3b8d99b5-ab2e-46e1-bab3-1f03aa238713 {{(pid=87134) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 02:05:24 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-7db3b96d-0125-4cb6-98af-24bd4d6360c8 tempest-VolumeDependencyTests-1851628812 None] Creating direct copy from snapshot {{(pid=87134) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 02:05:24 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb29892-3b1a-408b-b917-81aa9162ca93]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:05:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7db3b96d-0125-4cb6-98af-24bd4d6360c8 tempest-VolumeDependencyTests-1851628812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3b8d99b5-ab2e-46e1-bab3-1f03aa238713 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:24 devstack sudo[106518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3b8d99b5-ab2e-46e1-bab3-1f03aa238713 Jul 08 02:05:24 devstack sudo[106518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:24 devstack sudo[106511]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-cf932f9f-775c-4a98-aeaa-a7b76081d129 tempest-CreateVolumesFromSnapshotTest-778065099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ed792afe-618f-4a3c-8993-912f727893df.457637e6-0f1b-4239-befd-9830c9f4284d" returned: 0 in 0.919s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:24 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-cf932f9f-775c-4a98-aeaa-a7b76081d129 tempest-CreateVolumesFromSnapshotTest-778065099 None] Lock "cinder-quobyte-457637e6-0f1b-4239-befd-9830c9f4284d" released by "_delete_snapshot" :: held 3.818s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:05:24 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-cf932f9f-775c-4a98-aeaa-a7b76081d129 tempest-CreateVolumesFromSnapshotTest-778065099 None] Lock "cinder-quobyte-ed792afe-618f-4a3c-8993-912f727893df" released by "delete_snapshot" :: held 3.854s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:05:24 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-cf932f9f-775c-4a98-aeaa-a7b76081d129 tempest-CreateVolumesFromSnapshotTest-778065099 None] Created reservations ['becc263d-834a-47b6-95c2-762c74357145', '1230fd15-0396-4205-96ed-7af4feba1ee1', '6a275f30-cc1b-4a66-9b76-11bb5e1ee888', 'fca2e410-d0ab-468d-b364-630d845afcb4'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:05:24 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-cf932f9f-775c-4a98-aeaa-a7b76081d129 tempest-CreateVolumesFromSnapshotTest-778065099 None] Delete snapshot completed successfully. Jul 08 02:05:24 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-cf932f9f-775c-4a98-aeaa-a7b76081d129 tempest-CreateVolumesFromSnapshotTest-778065099 None] Lock "cinder-457637e6-0f1b-4239-befd-9830c9f4284d-delete_snapshot" released by "delete_snapshot" :: held 4.055s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:05:24 devstack sudo[106513]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-79c2887b-d873-49cf-a7c2-f507f32eb8eb tempest-CinderUnicodeTest-1150296208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1002d122-87cd-454f-bbab-34047435c8ab.c939f3ca-59a9-40f2-ad50-216aa834646c" returned: 0 in 1.044s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:24 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-79c2887b-d873-49cf-a7c2-f507f32eb8eb tempest-CinderUnicodeTest-1150296208 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1002d122-87cd-454f-bbab-34047435c8ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:05:24 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[12eb3464-b6b0-47bb-9299-cc4549aa5f64]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:05:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-79c2887b-d873-49cf-a7c2-f507f32eb8eb tempest-CinderUnicodeTest-1150296208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1002d122-87cd-454f-bbab-34047435c8ab {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:25 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-c4bab6bf-52c6-46e6-8dc7-2cc42211dcfa tempest-CreateVolumesFromSnapshotTest-778065099 None] Acquiring lock "cinder-ed792afe-618f-4a3c-8993-912f727893df-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:05:25 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-c4bab6bf-52c6-46e6-8dc7-2cc42211dcfa tempest-CreateVolumesFromSnapshotTest-778065099 None] Lock "cinder-ed792afe-618f-4a3c-8993-912f727893df-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:05:25 devstack sudo[106527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1002d122-87cd-454f-bbab-34047435c8ab Jul 08 02:05:25 devstack sudo[106527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:25 devstack sudo[106518]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:25 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7db3b96d-0125-4cb6-98af-24bd4d6360c8 tempest-VolumeDependencyTests-1851628812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3b8d99b5-ab2e-46e1-bab3-1f03aa238713" returned: 0 in 1.037s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:25 devstack cinder-volume[87134]: DEBUG cinder.utils [None req-7db3b96d-0125-4cb6-98af-24bd4d6360c8 tempest-VolumeDependencyTests-1851628812 None] Path /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-00c54faa-1757-4ea5-b6aa-d01ca43bbf31 not found in is_blk_device check {{(pid=87134) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 02:05:25 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7db3b96d-0125-4cb6-98af-24bd4d6360c8 tempest-VolumeDependencyTests-1851628812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3b8d99b5-ab2e-46e1-bab3-1f03aa238713 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-00c54faa-1757-4ea5-b6aa-d01ca43bbf31 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:25 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-c4bab6bf-52c6-46e6-8dc7-2cc42211dcfa tempest-CreateVolumesFromSnapshotTest-778065099 None] Acquiring lock "cinder-quobyte-ed792afe-618f-4a3c-8993-912f727893df" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:05:25 devstack sudo[106529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3b8d99b5-ab2e-46e1-bab3-1f03aa238713 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-00c54faa-1757-4ea5-b6aa-d01ca43bbf31 Jul 08 02:05:25 devstack sudo[106529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:25 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-c4bab6bf-52c6-46e6-8dc7-2cc42211dcfa tempest-CreateVolumesFromSnapshotTest-778065099 None] Lock "cinder-quobyte-ed792afe-618f-4a3c-8993-912f727893df" acquired by "delete_volume" :: waited 0.031s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:05:25 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca4bd78-4610-47fb-b655-fb50bfa292ae]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:05:25 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c4bab6bf-52c6-46e6-8dc7-2cc42211dcfa tempest-CreateVolumesFromSnapshotTest-778065099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ed792afe-618f-4a3c-8993-912f727893df {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:25 devstack sudo[106531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ed792afe-618f-4a3c-8993-912f727893df Jul 08 02:05:25 devstack sudo[106531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:26 devstack sudo[106527]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:26 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-79c2887b-d873-49cf-a7c2-f507f32eb8eb tempest-CinderUnicodeTest-1150296208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1002d122-87cd-454f-bbab-34047435c8ab" returned: 0 in 1.123s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:26 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-79c2887b-d873-49cf-a7c2-f507f32eb8eb tempest-CinderUnicodeTest-1150296208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1002d122-87cd-454f-bbab-34047435c8ab.c939f3ca-59a9-40f2-ad50-216aa834646c {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:26 devstack sudo[106540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1002d122-87cd-454f-bbab-34047435c8ab.c939f3ca-59a9-40f2-ad50-216aa834646c Jul 08 02:05:26 devstack sudo[106540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:26 devstack sudo[106531]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:26 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c4bab6bf-52c6-46e6-8dc7-2cc42211dcfa tempest-CreateVolumesFromSnapshotTest-778065099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ed792afe-618f-4a3c-8993-912f727893df" returned: 0 in 1.586s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:26 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c4bab6bf-52c6-46e6-8dc7-2cc42211dcfa tempest-CreateVolumesFromSnapshotTest-778065099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ed792afe-618f-4a3c-8993-912f727893df {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:26 devstack sudo[106552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ed792afe-618f-4a3c-8993-912f727893df Jul 08 02:05:26 devstack sudo[106552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:28 devstack sudo[106540]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:28 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-79c2887b-d873-49cf-a7c2-f507f32eb8eb tempest-CinderUnicodeTest-1150296208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1002d122-87cd-454f-bbab-34047435c8ab.c939f3ca-59a9-40f2-ad50-216aa834646c" returned: 0 in 2.258s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:28 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-79c2887b-d873-49cf-a7c2-f507f32eb8eb tempest-CinderUnicodeTest-1150296208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1002d122-87cd-454f-bbab-34047435c8ab.c939f3ca-59a9-40f2-ad50-216aa834646c {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:28 devstack sudo[106558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1002d122-87cd-454f-bbab-34047435c8ab.c939f3ca-59a9-40f2-ad50-216aa834646c Jul 08 02:05:28 devstack sudo[106558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:28 devstack sudo[106552]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:28 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c4bab6bf-52c6-46e6-8dc7-2cc42211dcfa tempest-CreateVolumesFromSnapshotTest-778065099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ed792afe-618f-4a3c-8993-912f727893df" returned: 0 in 1.674s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:28 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-c4bab6bf-52c6-46e6-8dc7-2cc42211dcfa tempest-CreateVolumesFromSnapshotTest-778065099 None] Lock "cinder-quobyte-ed792afe-618f-4a3c-8993-912f727893df" released by "delete_volume" :: held 3.365s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:05:28 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-c4bab6bf-52c6-46e6-8dc7-2cc42211dcfa tempest-CreateVolumesFromSnapshotTest-778065099 None] Created reservations ['686fa86d-3e18-434c-80d9-3c374e578aa8', '1b5a1540-d610-4012-bc7d-4cec7d8d4325', '9879c087-9e38-43fb-a021-d35df686b6da', '59554bd1-1343-4943-b6d7-95e8915ed6f8'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:05:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c4bab6bf-52c6-46e6-8dc7-2cc42211dcfa tempest-CreateVolumesFromSnapshotTest-778065099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:05:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c4bab6bf-52c6-46e6-8dc7-2cc42211dcfa tempest-CreateVolumesFromSnapshotTest-778065099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:05:29 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-c4bab6bf-52c6-46e6-8dc7-2cc42211dcfa tempest-CreateVolumesFromSnapshotTest-778065099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:05:29 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-c4bab6bf-52c6-46e6-8dc7-2cc42211dcfa tempest-CreateVolumesFromSnapshotTest-778065099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:05:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c4bab6bf-52c6-46e6-8dc7-2cc42211dcfa tempest-CreateVolumesFromSnapshotTest-778065099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:05:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c4bab6bf-52c6-46e6-8dc7-2cc42211dcfa tempest-CreateVolumesFromSnapshotTest-778065099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:29 devstack sudo[106560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 02:05:29 devstack sudo[106560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:30 devstack sudo[106558]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-79c2887b-d873-49cf-a7c2-f507f32eb8eb tempest-CinderUnicodeTest-1150296208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1002d122-87cd-454f-bbab-34047435c8ab.c939f3ca-59a9-40f2-ad50-216aa834646c" returned: 0 in 2.447s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:30 devstack sudo[106560]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c4bab6bf-52c6-46e6-8dc7-2cc42211dcfa tempest-CreateVolumesFromSnapshotTest-778065099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 1.666s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:30 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-c4bab6bf-52c6-46e6-8dc7-2cc42211dcfa tempest-CreateVolumesFromSnapshotTest-778065099 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:05:30 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-c4bab6bf-52c6-46e6-8dc7-2cc42211dcfa tempest-CreateVolumesFromSnapshotTest-778065099 None] Deleted volume successfully. Jul 08 02:05:30 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-79c2887b-d873-49cf-a7c2-f507f32eb8eb tempest-CinderUnicodeTest-1150296208 None] Lock "cinder-quobyte-c939f3ca-59a9-40f2-ad50-216aa834646c" released by "_delete_snapshot" :: held 7.146s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:05:30 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-79c2887b-d873-49cf-a7c2-f507f32eb8eb tempest-CinderUnicodeTest-1150296208 None] Lock "cinder-quobyte-1002d122-87cd-454f-bbab-34047435c8ab" released by "delete_snapshot" :: held 7.189s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:05:30 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-c4bab6bf-52c6-46e6-8dc7-2cc42211dcfa tempest-CreateVolumesFromSnapshotTest-778065099 None] Lock "cinder-ed792afe-618f-4a3c-8993-912f727893df-delete_volume" released by "delete_volume" :: held 5.933s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:05:31 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-79c2887b-d873-49cf-a7c2-f507f32eb8eb tempest-CinderUnicodeTest-1150296208 None] Created reservations ['699bf9ee-8941-4ae9-a0b3-1e0e6032f80e', '433c284a-d5d2-45ec-b22b-e72e67e68c8b', '1628fc67-c3ac-4f58-9b7c-f3e01867c2fb', '11b1be4c-bd60-4d49-b79e-9370607d8b10'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:05:31 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-79c2887b-d873-49cf-a7c2-f507f32eb8eb tempest-CinderUnicodeTest-1150296208 None] Delete snapshot completed successfully. Jul 08 02:05:31 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-79c2887b-d873-49cf-a7c2-f507f32eb8eb tempest-CinderUnicodeTest-1150296208 None] Lock "cinder-c939f3ca-59a9-40f2-ad50-216aa834646c-delete_snapshot" released by "delete_snapshot" :: held 7.998s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:05:31 devstack sudo[106529]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7db3b96d-0125-4cb6-98af-24bd4d6360c8 tempest-VolumeDependencyTests-1851628812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3b8d99b5-ab2e-46e1-bab3-1f03aa238713 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-00c54faa-1757-4ea5-b6aa-d01ca43bbf31" returned: 0 in 6.810s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:31 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[17707df6-e4ac-45a7-87d9-33fb2d75ec80]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:05:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7db3b96d-0125-4cb6-98af-24bd4d6360c8 tempest-VolumeDependencyTests-1851628812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3b8d99b5-ab2e-46e1-bab3-1f03aa238713 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:32 devstack sudo[106570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3b8d99b5-ab2e-46e1-bab3-1f03aa238713 Jul 08 02:05:32 devstack sudo[106570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:32 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-8b5f4eba-77ea-401c-976c-4f5cb4d02059 tempest-CinderUnicodeTest-1150296208 None] Acquiring lock "cinder-1002d122-87cd-454f-bbab-34047435c8ab-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:05:32 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-8b5f4eba-77ea-401c-976c-4f5cb4d02059 tempest-CinderUnicodeTest-1150296208 None] Lock "cinder-1002d122-87cd-454f-bbab-34047435c8ab-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:05:32 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-8b5f4eba-77ea-401c-976c-4f5cb4d02059 tempest-CinderUnicodeTest-1150296208 None] Acquiring lock "cinder-quobyte-1002d122-87cd-454f-bbab-34047435c8ab" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:05:32 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-8b5f4eba-77ea-401c-976c-4f5cb4d02059 tempest-CinderUnicodeTest-1150296208 None] Lock "cinder-quobyte-1002d122-87cd-454f-bbab-34047435c8ab" acquired by "delete_volume" :: waited 0.018s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:05:32 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec967437-00bb-4d6a-80e3-15578aed1a87]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:05:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8b5f4eba-77ea-401c-976c-4f5cb4d02059 tempest-CinderUnicodeTest-1150296208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1002d122-87cd-454f-bbab-34047435c8ab {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:32 devstack sudo[106572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1002d122-87cd-454f-bbab-34047435c8ab Jul 08 02:05:32 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:33 devstack sudo[106570]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7db3b96d-0125-4cb6-98af-24bd4d6360c8 tempest-VolumeDependencyTests-1851628812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3b8d99b5-ab2e-46e1-bab3-1f03aa238713" returned: 0 in 1.384s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:33 devstack cinder-volume[87134]: DEBUG cinder.image.image_utils [None req-7db3b96d-0125-4cb6-98af-24bd4d6360c8 tempest-VolumeDependencyTests-1851628812 None] Image conversion details: src /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3b8d99b5-ab2e-46e1-bab3-1f03aa238713, size 1024.00 MB, duration 6.81 sec, destination /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-00c54faa-1757-4ea5-b6aa-d01ca43bbf31 {{(pid=87134) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 02:05:33 devstack cinder-volume[87134]: INFO cinder.image.image_utils [None req-7db3b96d-0125-4cb6-98af-24bd4d6360c8 tempest-VolumeDependencyTests-1851628812 None] Converted 1024.00 MB image at 150.34 MB/s Jul 08 02:05:33 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-7db3b96d-0125-4cb6-98af-24bd4d6360c8 tempest-VolumeDependencyTests-1851628812 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-00c54faa-1757-4ea5-b6aa-d01ca43bbf31 is being set with open permissions: ugo+rw Jul 08 02:05:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7db3b96d-0125-4cb6-98af-24bd4d6360c8 tempest-VolumeDependencyTests-1851628812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-00c54faa-1757-4ea5-b6aa-d01ca43bbf31 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:33 devstack sudo[106578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-00c54faa-1757-4ea5-b6aa-d01ca43bbf31 Jul 08 02:05:33 devstack sudo[106578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:33 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8b5f4eba-77ea-401c-976c-4f5cb4d02059 tempest-CinderUnicodeTest-1150296208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1002d122-87cd-454f-bbab-34047435c8ab" returned: 0 in 1.035s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8b5f4eba-77ea-401c-976c-4f5cb4d02059 tempest-CinderUnicodeTest-1150296208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1002d122-87cd-454f-bbab-34047435c8ab {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:33 devstack sudo[106593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1002d122-87cd-454f-bbab-34047435c8ab Jul 08 02:05:33 devstack sudo[106593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:34 devstack sudo[106578]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7db3b96d-0125-4cb6-98af-24bd4d6360c8 tempest-VolumeDependencyTests-1851628812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-00c54faa-1757-4ea5-b6aa-d01ca43bbf31" returned: 0 in 1.021s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:34 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7db3b96d-0125-4cb6-98af-24bd4d6360c8 tempest-VolumeDependencyTests-1851628812 None] Lock "cinder-quobyte-00c54faa-1757-4ea5-b6aa-d01ca43bbf31" released by "_copy_volume_from_snapshot" :: held 11.409s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:05:34 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7db3b96d-0125-4cb6-98af-24bd4d6360c8 tempest-VolumeDependencyTests-1851628812 None] Lock "cinder-quobyte-98531c57-a483-4717-9da8-4c4fdc92ca13-00c54faa-1757-4ea5-b6aa-d01ca43bbf31" released by "_create_volume_from_snapshot" :: held 11.462s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:05:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7db3b96d-0125-4cb6-98af-24bd4d6360c8 tempest-VolumeDependencyTests-1851628812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.496s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:05:34 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-7db3b96d-0125-4cb6-98af-24bd4d6360c8 tempest-VolumeDependencyTests-1851628812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60e1c0dc-5019-47f4-b7c0-84516e4c99d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00c54faa-1757-4ea5-b6aa-d01ca43bbf31', 'volume_size': 1, 'snapshot_id': '98531c57-a483-4717-9da8-4c4fdc92ca13'}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:05:34 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-7db3b96d-0125-4cb6-98af-24bd4d6360c8 tempest-VolumeDependencyTests-1851628812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fc6c14a-dc0d-4246-80bf-859cd7eacbbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:05:34 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-7db3b96d-0125-4cb6-98af-24bd4d6360c8 tempest-VolumeDependencyTests-1851628812 None] Volume volume-00c54faa-1757-4ea5-b6aa-d01ca43bbf31 (00c54faa-1757-4ea5-b6aa-d01ca43bbf31): created successfully Jul 08 02:05:34 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-7db3b96d-0125-4cb6-98af-24bd4d6360c8 tempest-VolumeDependencyTests-1851628812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fc6c14a-dc0d-4246-80bf-859cd7eacbbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:05:34 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-7db3b96d-0125-4cb6-98af-24bd4d6360c8 tempest-VolumeDependencyTests-1851628812 None] Flow 'volume_create_manager' (b3737f8e-5a5e-465a-b399-5a689bec0c71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:05:34 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-7db3b96d-0125-4cb6-98af-24bd4d6360c8 tempest-VolumeDependencyTests-1851628812 None] Created volume successfully. Jul 08 02:05:35 devstack sudo[106593]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8b5f4eba-77ea-401c-976c-4f5cb4d02059 tempest-CinderUnicodeTest-1150296208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1002d122-87cd-454f-bbab-34047435c8ab" returned: 0 in 1.202s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:35 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-8b5f4eba-77ea-401c-976c-4f5cb4d02059 tempest-CinderUnicodeTest-1150296208 None] Lock "cinder-quobyte-1002d122-87cd-454f-bbab-34047435c8ab" released by "delete_volume" :: held 2.369s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:05:35 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a6d6d9c6-5525-4cba-84c5-ded40dd8f3f9 tempest-VolumeDependencyTests-1851628812 None] Acquiring lock "cinder-98531c57-a483-4717-9da8-4c4fdc92ca13-delete_snapshot" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:05:35 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-8b5f4eba-77ea-401c-976c-4f5cb4d02059 tempest-CinderUnicodeTest-1150296208 None] Created reservations ['afc1680d-09c0-4746-8a67-dbb3762ba6dd', '0f439c29-e7f6-49d6-a357-e425636352e1', 'e32653af-bd33-448f-be4e-a50cdb89efc9', '03b92d61-eb8f-4bf8-9d86-656b77b78705'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:05:35 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a6d6d9c6-5525-4cba-84c5-ded40dd8f3f9 tempest-VolumeDependencyTests-1851628812 None] Lock "cinder-98531c57-a483-4717-9da8-4c4fdc92ca13-delete_snapshot" acquired by "delete_snapshot" :: waited 0.058s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:05:35 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a6d6d9c6-5525-4cba-84c5-ded40dd8f3f9 tempest-VolumeDependencyTests-1851628812 None] Acquiring lock "cinder-quobyte-3b8d99b5-ab2e-46e1-bab3-1f03aa238713" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:05:35 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a6d6d9c6-5525-4cba-84c5-ded40dd8f3f9 tempest-VolumeDependencyTests-1851628812 None] Lock "cinder-quobyte-3b8d99b5-ab2e-46e1-bab3-1f03aa238713" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:05:35 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a6d6d9c6-5525-4cba-84c5-ded40dd8f3f9 tempest-VolumeDependencyTests-1851628812 None] Acquiring lock "cinder-quobyte-98531c57-a483-4717-9da8-4c4fdc92ca13" by "_delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:05:35 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a6d6d9c6-5525-4cba-84c5-ded40dd8f3f9 tempest-VolumeDependencyTests-1851628812 None] Lock "cinder-quobyte-98531c57-a483-4717-9da8-4c4fdc92ca13" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:05:35 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-a6d6d9c6-5525-4cba-84c5-ded40dd8f3f9 tempest-VolumeDependencyTests-1851628812 None] Deleting offline snapshot 98531c57-a483-4717-9da8-4c4fdc92ca13 of volume 3b8d99b5-ab2e-46e1-bab3-1f03aa238713 {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 02:05:35 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-a6d6d9c6-5525-4cba-84c5-ded40dd8f3f9 tempest-VolumeDependencyTests-1851628812 None] snapshot_file for this snap is: volume-3b8d99b5-ab2e-46e1-bab3-1f03aa238713.98531c57-a483-4717-9da8-4c4fdc92ca13 {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 02:05:35 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebad66c0-d8bd-4320-b3c6-efd23d918102]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:05:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a6d6d9c6-5525-4cba-84c5-ded40dd8f3f9 tempest-VolumeDependencyTests-1851628812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3b8d99b5-ab2e-46e1-bab3-1f03aa238713.98531c57-a483-4717-9da8-4c4fdc92ca13 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-8b5f4eba-77ea-401c-976c-4f5cb4d02059 tempest-CinderUnicodeTest-1150296208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:05:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-8b5f4eba-77ea-401c-976c-4f5cb4d02059 tempest-CinderUnicodeTest-1150296208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:05:35 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-8b5f4eba-77ea-401c-976c-4f5cb4d02059 tempest-CinderUnicodeTest-1150296208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:05:35 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-8b5f4eba-77ea-401c-976c-4f5cb4d02059 tempest-CinderUnicodeTest-1150296208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:05:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-8b5f4eba-77ea-401c-976c-4f5cb4d02059 tempest-CinderUnicodeTest-1150296208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:05:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8b5f4eba-77ea-401c-976c-4f5cb4d02059 tempest-CinderUnicodeTest-1150296208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:35 devstack sudo[106624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 02:05:35 devstack sudo[106624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:35 devstack sudo[106623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3b8d99b5-ab2e-46e1-bab3-1f03aa238713.98531c57-a483-4717-9da8-4c4fdc92ca13 Jul 08 02:05:35 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:36 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-5c408b45-3237-4712-9be7-42cdeec9e890 tempest-CinderUnicodeTest-1150296208 None] Acquiring lock "cinder-c43693a7-1290-4b4b-bb70-b0756bdbc110-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:05:36 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-5c408b45-3237-4712-9be7-42cdeec9e890 tempest-CinderUnicodeTest-1150296208 None] Lock "cinder-c43693a7-1290-4b4b-bb70-b0756bdbc110-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:05:36 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-386371d3-fa06-4473-ad0f-f9cf3dc09ab8 tempest-ProjectAdminTests-2131228643 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6598472595215, 'free_capacity_gb': 1775.6598472595215, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87134) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 08 02:05:36 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-5c408b45-3237-4712-9be7-42cdeec9e890 tempest-CinderUnicodeTest-1150296208 None] Acquiring lock "cinder-quobyte-c43693a7-1290-4b4b-bb70-b0756bdbc110" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:05:36 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-5c408b45-3237-4712-9be7-42cdeec9e890 tempest-CinderUnicodeTest-1150296208 None] Lock "cinder-quobyte-c43693a7-1290-4b4b-bb70-b0756bdbc110" acquired by "delete_volume" :: waited 0.028s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:05:36 devstack sudo[106624]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-8b5f4eba-77ea-401c-976c-4f5cb4d02059 tempest-CinderUnicodeTest-1150296208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 1.011s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:36 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-8b5f4eba-77ea-401c-976c-4f5cb4d02059 tempest-CinderUnicodeTest-1150296208 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:05:36 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-8b5f4eba-77ea-401c-976c-4f5cb4d02059 tempest-CinderUnicodeTest-1150296208 None] Deleted volume successfully. Jul 08 02:05:36 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ff8cd5-0e78-4974-9608-3dbb38753a6e]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:05:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5c408b45-3237-4712-9be7-42cdeec9e890 tempest-CinderUnicodeTest-1150296208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c43693a7-1290-4b4b-bb70-b0756bdbc110 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:36 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-8b5f4eba-77ea-401c-976c-4f5cb4d02059 tempest-CinderUnicodeTest-1150296208 None] Lock "cinder-1002d122-87cd-454f-bbab-34047435c8ab-delete_volume" released by "delete_volume" :: held 3.899s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:05:36 devstack sudo[106628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c43693a7-1290-4b4b-bb70-b0756bdbc110 Jul 08 02:05:36 devstack sudo[106628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:36 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a6d6d9c6-5525-4cba-84c5-ded40dd8f3f9 tempest-VolumeDependencyTests-1851628812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3b8d99b5-ab2e-46e1-bab3-1f03aa238713.98531c57-a483-4717-9da8-4c4fdc92ca13" returned: 0 in 1.330s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:36 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-a6d6d9c6-5525-4cba-84c5-ded40dd8f3f9 tempest-VolumeDependencyTests-1851628812 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b8d99b5-ab2e-46e1-bab3-1f03aa238713(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:05:36 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde2bc19-a8b7-42a8-8e57-59714da8f541]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:05:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a6d6d9c6-5525-4cba-84c5-ded40dd8f3f9 tempest-VolumeDependencyTests-1851628812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3b8d99b5-ab2e-46e1-bab3-1f03aa238713 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:36 devstack sudo[106634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3b8d99b5-ab2e-46e1-bab3-1f03aa238713 Jul 08 02:05:36 devstack sudo[106634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:37 devstack sudo[106628]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5c408b45-3237-4712-9be7-42cdeec9e890 tempest-CinderUnicodeTest-1150296208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c43693a7-1290-4b4b-bb70-b0756bdbc110" returned: 0 in 1.090s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5c408b45-3237-4712-9be7-42cdeec9e890 tempest-CinderUnicodeTest-1150296208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c43693a7-1290-4b4b-bb70-b0756bdbc110 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:37 devstack sudo[106640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c43693a7-1290-4b4b-bb70-b0756bdbc110 Jul 08 02:05:37 devstack sudo[106640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:37 devstack sudo[106634]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a6d6d9c6-5525-4cba-84c5-ded40dd8f3f9 tempest-VolumeDependencyTests-1851628812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3b8d99b5-ab2e-46e1-bab3-1f03aa238713" returned: 0 in 1.055s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a6d6d9c6-5525-4cba-84c5-ded40dd8f3f9 tempest-VolumeDependencyTests-1851628812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3b8d99b5-ab2e-46e1-bab3-1f03aa238713.98531c57-a483-4717-9da8-4c4fdc92ca13 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:37 devstack sudo[106644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3b8d99b5-ab2e-46e1-bab3-1f03aa238713.98531c57-a483-4717-9da8-4c4fdc92ca13 Jul 08 02:05:37 devstack sudo[106644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:38 devstack sudo[106640]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5c408b45-3237-4712-9be7-42cdeec9e890 tempest-CinderUnicodeTest-1150296208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-c43693a7-1290-4b4b-bb70-b0756bdbc110" returned: 0 in 0.968s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:38 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-5c408b45-3237-4712-9be7-42cdeec9e890 tempest-CinderUnicodeTest-1150296208 None] Lock "cinder-quobyte-c43693a7-1290-4b4b-bb70-b0756bdbc110" released by "delete_volume" :: held 2.162s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:05:38 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-5c408b45-3237-4712-9be7-42cdeec9e890 tempest-CinderUnicodeTest-1150296208 None] Created reservations ['fc325f79-17db-451d-8a66-962c1625e265', '04b42c71-c9a1-4c09-a2c6-318f3b2d7c35', 'f4ffb97f-ac29-4759-8407-b1edc149b06a', 'b65fafd0-c89f-4632-aaf1-c736255a7e96'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:05:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5c408b45-3237-4712-9be7-42cdeec9e890 tempest-CinderUnicodeTest-1150296208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:05:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5c408b45-3237-4712-9be7-42cdeec9e890 tempest-CinderUnicodeTest-1150296208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:05:38 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-5c408b45-3237-4712-9be7-42cdeec9e890 tempest-CinderUnicodeTest-1150296208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:05:38 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-5c408b45-3237-4712-9be7-42cdeec9e890 tempest-CinderUnicodeTest-1150296208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:05:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5c408b45-3237-4712-9be7-42cdeec9e890 tempest-CinderUnicodeTest-1150296208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:05:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5c408b45-3237-4712-9be7-42cdeec9e890 tempest-CinderUnicodeTest-1150296208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:38 devstack sudo[106651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 02:05:38 devstack sudo[106651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:38 devstack sudo[106644]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a6d6d9c6-5525-4cba-84c5-ded40dd8f3f9 tempest-VolumeDependencyTests-1851628812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3b8d99b5-ab2e-46e1-bab3-1f03aa238713.98531c57-a483-4717-9da8-4c4fdc92ca13" returned: 0 in 1.104s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a6d6d9c6-5525-4cba-84c5-ded40dd8f3f9 tempest-VolumeDependencyTests-1851628812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3b8d99b5-ab2e-46e1-bab3-1f03aa238713.98531c57-a483-4717-9da8-4c4fdc92ca13 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:38 devstack sudo[106653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3b8d99b5-ab2e-46e1-bab3-1f03aa238713.98531c57-a483-4717-9da8-4c4fdc92ca13 Jul 08 02:05:38 devstack sudo[106653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:39 devstack sudo[106651]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5c408b45-3237-4712-9be7-42cdeec9e890 tempest-CinderUnicodeTest-1150296208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.993s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:39 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-5c408b45-3237-4712-9be7-42cdeec9e890 tempest-CinderUnicodeTest-1150296208 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:05:39 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-5c408b45-3237-4712-9be7-42cdeec9e890 tempest-CinderUnicodeTest-1150296208 None] Deleted volume successfully. Jul 08 02:05:39 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-5c408b45-3237-4712-9be7-42cdeec9e890 tempest-CinderUnicodeTest-1150296208 None] Lock "cinder-c43693a7-1290-4b4b-bb70-b0756bdbc110-delete_volume" released by "delete_volume" :: held 3.572s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:05:39 devstack sudo[106653]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a6d6d9c6-5525-4cba-84c5-ded40dd8f3f9 tempest-VolumeDependencyTests-1851628812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3b8d99b5-ab2e-46e1-bab3-1f03aa238713.98531c57-a483-4717-9da8-4c4fdc92ca13" returned: 0 in 1.089s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:40 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a6d6d9c6-5525-4cba-84c5-ded40dd8f3f9 tempest-VolumeDependencyTests-1851628812 None] Lock "cinder-quobyte-98531c57-a483-4717-9da8-4c4fdc92ca13" released by "_delete_snapshot" :: held 4.731s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:05:40 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a6d6d9c6-5525-4cba-84c5-ded40dd8f3f9 tempest-VolumeDependencyTests-1851628812 None] Lock "cinder-quobyte-3b8d99b5-ab2e-46e1-bab3-1f03aa238713" released by "delete_snapshot" :: held 4.789s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:05:40 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-a6d6d9c6-5525-4cba-84c5-ded40dd8f3f9 tempest-VolumeDependencyTests-1851628812 None] Created reservations ['ee11111e-fbd8-4ae8-b138-66049da83cda', 'cb4f8f14-32da-47a2-a928-98f581ef84c8', '320abac3-1ee6-4f13-a660-b0890c20c6f6', '9241f0f7-5db1-4760-a3fe-4172bc19ead7'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:05:40 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-a6d6d9c6-5525-4cba-84c5-ded40dd8f3f9 tempest-VolumeDependencyTests-1851628812 None] Delete snapshot completed successfully. Jul 08 02:05:40 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a6d6d9c6-5525-4cba-84c5-ded40dd8f3f9 tempest-VolumeDependencyTests-1851628812 None] Lock "cinder-98531c57-a483-4717-9da8-4c4fdc92ca13-delete_snapshot" released by "delete_snapshot" :: held 4.998s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:05:40 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-b4698013-d097-414b-869c-16dde62ff88f tempest-VolumeDependencyTests-1851628812 None] Acquiring lock "cinder-3b8d99b5-ab2e-46e1-bab3-1f03aa238713-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:05:40 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-b4698013-d097-414b-869c-16dde62ff88f tempest-VolumeDependencyTests-1851628812 None] Lock "cinder-3b8d99b5-ab2e-46e1-bab3-1f03aa238713-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:05:40 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-b4698013-d097-414b-869c-16dde62ff88f tempest-VolumeDependencyTests-1851628812 None] Acquiring lock "cinder-quobyte-3b8d99b5-ab2e-46e1-bab3-1f03aa238713" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:05:40 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-b4698013-d097-414b-869c-16dde62ff88f tempest-VolumeDependencyTests-1851628812 None] Lock "cinder-quobyte-3b8d99b5-ab2e-46e1-bab3-1f03aa238713" acquired by "delete_volume" :: waited 0.028s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:05:41 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0786ba1-a8a7-45fb-b172-7a6762907249]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:05:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b4698013-d097-414b-869c-16dde62ff88f tempest-VolumeDependencyTests-1851628812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3b8d99b5-ab2e-46e1-bab3-1f03aa238713 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:41 devstack sudo[106657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3b8d99b5-ab2e-46e1-bab3-1f03aa238713 Jul 08 02:05:41 devstack sudo[106657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:42 devstack sudo[106657]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b4698013-d097-414b-869c-16dde62ff88f tempest-VolumeDependencyTests-1851628812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3b8d99b5-ab2e-46e1-bab3-1f03aa238713" returned: 0 in 1.025s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b4698013-d097-414b-869c-16dde62ff88f tempest-VolumeDependencyTests-1851628812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3b8d99b5-ab2e-46e1-bab3-1f03aa238713 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:42 devstack sudo[106662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3b8d99b5-ab2e-46e1-bab3-1f03aa238713 Jul 08 02:05:42 devstack sudo[106662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:42 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f6d2feb-046d-4811-9459-97f7fd707e4b tempest-ProjectMemberTests-73815212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:05:42 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6f6d2feb-046d-4811-9459-97f7fd707e4b tempest-ProjectMemberTests-73815212 None] Flow 'volume_create_manager' (49fdfc18-d370-415e-b8fa-6e2028506f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:05:42 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6f6d2feb-046d-4811-9459-97f7fd707e4b tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2ac6109-b104-419c-8ba7-1f1487ef7dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:05:43 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6f6d2feb-046d-4811-9459-97f7fd707e4b tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2ac6109-b104-419c-8ba7-1f1487ef7dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:05:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-882664066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dabaa6e-d574-4134-834b-cf56b01819e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f353d90ed9694fe88617e9c4eed37bf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:05:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:05:43Z,use_quota=True,user_id='6137db3fdb294c84a17fd39e57e13785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:05:43 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6f6d2feb-046d-4811-9459-97f7fd707e4b tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31fc81ed-7afb-4226-b347-3c76a4ebd0e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:05:43 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6f6d2feb-046d-4811-9459-97f7fd707e4b tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31fc81ed-7afb-4226-b347-3c76a4ebd0e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:05:43 devstack sudo[106662]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:43 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6f6d2feb-046d-4811-9459-97f7fd707e4b tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9674aef2-8c03-4c80-8e86-50048ad24f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:05:43 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6f6d2feb-046d-4811-9459-97f7fd707e4b tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9674aef2-8c03-4c80-8e86-50048ad24f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dabaa6e-d574-4134-834b-cf56b01819e4', 'volume_name': 'volume-8dabaa6e-d574-4134-834b-cf56b01819e4', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:05:43 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6f6d2feb-046d-4811-9459-97f7fd707e4b tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74601556-0b97-4119-a15a-bbaaecde0c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:05:43 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6f6d2feb-046d-4811-9459-97f7fd707e4b tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74601556-0b97-4119-a15a-bbaaecde0c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:05:43 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6f6d2feb-046d-4811-9459-97f7fd707e4b tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b302655-5e52-40b5-b33d-455a52fb5520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:05:43 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-6f6d2feb-046d-4811-9459-97f7fd707e4b tempest-ProjectMemberTests-73815212 None] Volume 8dabaa6e-d574-4134-834b-cf56b01819e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dabaa6e-d574-4134-834b-cf56b01819e4', 'volume_size': 1} Jul 08 02:05:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6f6d2feb-046d-4811-9459-97f7fd707e4b tempest-ProjectMemberTests-73815212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:05:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6f6d2feb-046d-4811-9459-97f7fd707e4b tempest-ProjectMemberTests-73815212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:05:43 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-6f6d2feb-046d-4811-9459-97f7fd707e4b tempest-ProjectMemberTests-73815212 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:05:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-882664066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dabaa6e-d574-4134-834b-cf56b01819e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f353d90ed9694fe88617e9c4eed37bf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:05:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:05:43Z,use_quota=True,user_id='6137db3fdb294c84a17fd39e57e13785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:05:43 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-6f6d2feb-046d-4811-9459-97f7fd707e4b tempest-ProjectMemberTests-73815212 None] Creating volume 8dabaa6e-d574-4134-834b-cf56b01819e4 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:05:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6f6d2feb-046d-4811-9459-97f7fd707e4b tempest-ProjectMemberTests-73815212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:05:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6f6d2feb-046d-4811-9459-97f7fd707e4b tempest-ProjectMemberTests-73815212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:05:43 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-6f6d2feb-046d-4811-9459-97f7fd707e4b tempest-ProjectMemberTests-73815212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:05:43 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-6f6d2feb-046d-4811-9459-97f7fd707e4b tempest-ProjectMemberTests-73815212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:05:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6f6d2feb-046d-4811-9459-97f7fd707e4b tempest-ProjectMemberTests-73815212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:05:43 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-6f6d2feb-046d-4811-9459-97f7fd707e4b tempest-ProjectMemberTests-73815212 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:05:43 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-6f6d2feb-046d-4811-9459-97f7fd707e4b tempest-ProjectMemberTests-73815212 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 02:05:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6f6d2feb-046d-4811-9459-97f7fd707e4b tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8dabaa6e-d574-4134-834b-cf56b01819e4 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b4698013-d097-414b-869c-16dde62ff88f tempest-VolumeDependencyTests-1851628812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-3b8d99b5-ab2e-46e1-bab3-1f03aa238713" returned: 0 in 1.018s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:43 devstack sudo[106665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8dabaa6e-d574-4134-834b-cf56b01819e4 1073741824 Jul 08 02:05:43 devstack sudo[106665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:43 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-b4698013-d097-414b-869c-16dde62ff88f tempest-VolumeDependencyTests-1851628812 None] Lock "cinder-quobyte-3b8d99b5-ab2e-46e1-bab3-1f03aa238713" released by "delete_volume" :: held 2.151s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:05:43 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-b4698013-d097-414b-869c-16dde62ff88f tempest-VolumeDependencyTests-1851628812 None] Created reservations ['68c48fac-aebb-49cf-9e58-c0ccf0b301ef', '2573240e-eab6-440e-8b1c-80863f34aa22', '7547570c-c433-4bb2-92c5-57602c89b570', 'd4add259-1def-427c-a79b-5f4b6f680ac1'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:05:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b4698013-d097-414b-869c-16dde62ff88f tempest-VolumeDependencyTests-1851628812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:05:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b4698013-d097-414b-869c-16dde62ff88f tempest-VolumeDependencyTests-1851628812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:05:43 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-b4698013-d097-414b-869c-16dde62ff88f tempest-VolumeDependencyTests-1851628812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:05:43 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-b4698013-d097-414b-869c-16dde62ff88f tempest-VolumeDependencyTests-1851628812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:05:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-b4698013-d097-414b-869c-16dde62ff88f tempest-VolumeDependencyTests-1851628812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:05:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b4698013-d097-414b-869c-16dde62ff88f tempest-VolumeDependencyTests-1851628812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:43 devstack sudo[106668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 02:05:43 devstack sudo[106668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:44 devstack sudo[106668]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-b4698013-d097-414b-869c-16dde62ff88f tempest-VolumeDependencyTests-1851628812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.864s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:44 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-b4698013-d097-414b-869c-16dde62ff88f tempest-VolumeDependencyTests-1851628812 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:05:44 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-b4698013-d097-414b-869c-16dde62ff88f tempest-VolumeDependencyTests-1851628812 None] Deleted volume successfully. Jul 08 02:05:44 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-b4698013-d097-414b-869c-16dde62ff88f tempest-VolumeDependencyTests-1851628812 None] Lock "cinder-3b8d99b5-ab2e-46e1-bab3-1f03aa238713-delete_volume" released by "delete_volume" :: held 3.347s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:05:44 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a1dbe434-3525-4b74-9c27-6a76c504b331 tempest-VolumeDependencyTests-1851628812 None] Acquiring lock "cinder-00c54faa-1757-4ea5-b6aa-d01ca43bbf31-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:05:44 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a1dbe434-3525-4b74-9c27-6a76c504b331 tempest-VolumeDependencyTests-1851628812 None] Lock "cinder-00c54faa-1757-4ea5-b6aa-d01ca43bbf31-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:05:44 devstack sudo[106665]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6f6d2feb-046d-4811-9459-97f7fd707e4b tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8dabaa6e-d574-4134-834b-cf56b01819e4 1073741824" returned: 0 in 1.308s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:44 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a1dbe434-3525-4b74-9c27-6a76c504b331 tempest-VolumeDependencyTests-1851628812 None] Acquiring lock "cinder-quobyte-00c54faa-1757-4ea5-b6aa-d01ca43bbf31" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:05:44 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a1dbe434-3525-4b74-9c27-6a76c504b331 tempest-VolumeDependencyTests-1851628812 None] Lock "cinder-quobyte-00c54faa-1757-4ea5-b6aa-d01ca43bbf31" acquired by "delete_volume" :: waited 0.029s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:05:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6f6d2feb-046d-4811-9459-97f7fd707e4b tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8dabaa6e-d574-4134-834b-cf56b01819e4 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:44 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea78355-48dc-40e6-8a29-925e1b3d46d3]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:05:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a1dbe434-3525-4b74-9c27-6a76c504b331 tempest-VolumeDependencyTests-1851628812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-00c54faa-1757-4ea5-b6aa-d01ca43bbf31 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:44 devstack sudo[106676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8dabaa6e-d574-4134-834b-cf56b01819e4 Jul 08 02:05:44 devstack sudo[106676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:44 devstack sudo[106677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-00c54faa-1757-4ea5-b6aa-d01ca43bbf31 Jul 08 02:05:44 devstack sudo[106677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:45 devstack sudo[106676]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6f6d2feb-046d-4811-9459-97f7fd707e4b tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8dabaa6e-d574-4134-834b-cf56b01819e4" returned: 0 in 0.876s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:45 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-6f6d2feb-046d-4811-9459-97f7fd707e4b tempest-ProjectMemberTests-73815212 None] <== create_volume: return (2295ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:05:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6f6d2feb-046d-4811-9459-97f7fd707e4b tempest-ProjectMemberTests-73815212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.300s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:05:45 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6f6d2feb-046d-4811-9459-97f7fd707e4b tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b302655-5e52-40b5-b33d-455a52fb5520) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dabaa6e-d574-4134-834b-cf56b01819e4', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:05:45 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6f6d2feb-046d-4811-9459-97f7fd707e4b tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd90c90b-d6db-45cf-b111-6c82acce3ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:05:45 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-6f6d2feb-046d-4811-9459-97f7fd707e4b tempest-ProjectMemberTests-73815212 None] Volume volume-8dabaa6e-d574-4134-834b-cf56b01819e4 (8dabaa6e-d574-4134-834b-cf56b01819e4): created successfully Jul 08 02:05:45 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6f6d2feb-046d-4811-9459-97f7fd707e4b tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd90c90b-d6db-45cf-b111-6c82acce3ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:05:45 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6f6d2feb-046d-4811-9459-97f7fd707e4b tempest-ProjectMemberTests-73815212 None] Flow 'volume_create_manager' (49fdfc18-d370-415e-b8fa-6e2028506f46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:05:45 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-6f6d2feb-046d-4811-9459-97f7fd707e4b tempest-ProjectMemberTests-73815212 None] Created volume successfully. Jul 08 02:05:45 devstack sudo[106677]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a1dbe434-3525-4b74-9c27-6a76c504b331 tempest-VolumeDependencyTests-1851628812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-00c54faa-1757-4ea5-b6aa-d01ca43bbf31" returned: 0 in 0.995s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a1dbe434-3525-4b74-9c27-6a76c504b331 tempest-VolumeDependencyTests-1851628812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-00c54faa-1757-4ea5-b6aa-d01ca43bbf31 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:45 devstack sudo[106684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-00c54faa-1757-4ea5-b6aa-d01ca43bbf31 Jul 08 02:05:45 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:46 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a1dbe434-3525-4b74-9c27-6a76c504b331 tempest-VolumeDependencyTests-1851628812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-00c54faa-1757-4ea5-b6aa-d01ca43bbf31" returned: 0 in 0.744s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:46 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a1dbe434-3525-4b74-9c27-6a76c504b331 tempest-VolumeDependencyTests-1851628812 None] Lock "cinder-quobyte-00c54faa-1757-4ea5-b6aa-d01ca43bbf31" released by "delete_volume" :: held 1.808s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:05:46 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-a1dbe434-3525-4b74-9c27-6a76c504b331 tempest-VolumeDependencyTests-1851628812 None] Created reservations ['93b79aa9-f26a-457d-8e81-db176273164e', '9637fcaf-585c-4198-abd3-c4a2ab73f975', '3fa8978c-382e-4203-ad8f-e8034579a89f', '28221154-0a87-43b2-9259-ba7231c46993'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:05:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-a1dbe434-3525-4b74-9c27-6a76c504b331 tempest-VolumeDependencyTests-1851628812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:05:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-a1dbe434-3525-4b74-9c27-6a76c504b331 tempest-VolumeDependencyTests-1851628812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:05:46 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-a1dbe434-3525-4b74-9c27-6a76c504b331 tempest-VolumeDependencyTests-1851628812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:05:46 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-a1dbe434-3525-4b74-9c27-6a76c504b331 tempest-VolumeDependencyTests-1851628812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:05:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-a1dbe434-3525-4b74-9c27-6a76c504b331 tempest-VolumeDependencyTests-1851628812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:05:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a1dbe434-3525-4b74-9c27-6a76c504b331 tempest-VolumeDependencyTests-1851628812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:46 devstack sudo[106687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 02:05:46 devstack sudo[106687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-1b9a3ff4-9499-4665-98f5-7c1307d3b302 tempest-ProjectMemberTests-73815212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:05:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-1b9a3ff4-9499-4665-98f5-7c1307d3b302 tempest-ProjectMemberTests-73815212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:05:46 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-1b9a3ff4-9499-4665-98f5-7c1307d3b302 tempest-ProjectMemberTests-73815212 None] Creating offline snapshot f0199dc3-b23f-47c7-9af9-c4a316003e06 of volume 8dabaa6e-d574-4134-834b-cf56b01819e4 {{(pid=87134) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 02:05:46 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1c1c0c-2cd2-4b4d-96b4-c3306a24d318]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:05:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1b9a3ff4-9499-4665-98f5-7c1307d3b302 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8dabaa6e-d574-4134-834b-cf56b01819e4 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:47 devstack sudo[106689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8dabaa6e-d574-4134-834b-cf56b01819e4 Jul 08 02:05:47 devstack sudo[106689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:47 devstack sudo[106687]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a1dbe434-3525-4b74-9c27-6a76c504b331 tempest-VolumeDependencyTests-1851628812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 1.082s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:47 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-a1dbe434-3525-4b74-9c27-6a76c504b331 tempest-VolumeDependencyTests-1851628812 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:05:47 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-a1dbe434-3525-4b74-9c27-6a76c504b331 tempest-VolumeDependencyTests-1851628812 None] Deleted volume successfully. Jul 08 02:05:47 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a1dbe434-3525-4b74-9c27-6a76c504b331 tempest-VolumeDependencyTests-1851628812 None] Lock "cinder-00c54faa-1757-4ea5-b6aa-d01ca43bbf31-delete_volume" released by "delete_volume" :: held 3.223s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:05:48 devstack sudo[106689]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1b9a3ff4-9499-4665-98f5-7c1307d3b302 tempest-ProjectMemberTests-73815212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8dabaa6e-d574-4134-834b-cf56b01819e4" returned: 0 in 1.143s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1b9a3ff4-9499-4665-98f5-7c1307d3b302 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8dabaa6e-d574-4134-834b-cf56b01819e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8dabaa6e-d574-4134-834b-cf56b01819e4.f0199dc3-b23f-47c7-9af9-c4a316003e06 1G {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:48 devstack sudo[106695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8dabaa6e-d574-4134-834b-cf56b01819e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8dabaa6e-d574-4134-834b-cf56b01819e4.f0199dc3-b23f-47c7-9af9-c4a316003e06 1G Jul 08 02:05:48 devstack sudo[106695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:49 devstack sudo[106695]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:49 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1b9a3ff4-9499-4665-98f5-7c1307d3b302 tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8dabaa6e-d574-4134-834b-cf56b01819e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8dabaa6e-d574-4134-834b-cf56b01819e4.f0199dc3-b23f-47c7-9af9-c4a316003e06 1G" returned: 0 in 1.054s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:49 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1b9a3ff4-9499-4665-98f5-7c1307d3b302 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8dabaa6e-d574-4134-834b-cf56b01819e4 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8dabaa6e-d574-4134-834b-cf56b01819e4.f0199dc3-b23f-47c7-9af9-c4a316003e06 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:49 devstack sudo[106704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8dabaa6e-d574-4134-834b-cf56b01819e4 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8dabaa6e-d574-4134-834b-cf56b01819e4.f0199dc3-b23f-47c7-9af9-c4a316003e06 Jul 08 02:05:49 devstack sudo[106704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:50 devstack sudo[106704]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:50 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1b9a3ff4-9499-4665-98f5-7c1307d3b302 tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8dabaa6e-d574-4134-834b-cf56b01819e4 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8dabaa6e-d574-4134-834b-cf56b01819e4.f0199dc3-b23f-47c7-9af9-c4a316003e06" returned: 0 in 1.034s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:50 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-1b9a3ff4-9499-4665-98f5-7c1307d3b302 tempest-ProjectMemberTests-73815212 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8dabaa6e-d574-4134-834b-cf56b01819e4.f0199dc3-b23f-47c7-9af9-c4a316003e06 is being set with open permissions: ugo+rw Jul 08 02:05:50 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1b9a3ff4-9499-4665-98f5-7c1307d3b302 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8dabaa6e-d574-4134-834b-cf56b01819e4.f0199dc3-b23f-47c7-9af9-c4a316003e06 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:50 devstack sudo[106710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8dabaa6e-d574-4134-834b-cf56b01819e4.f0199dc3-b23f-47c7-9af9-c4a316003e06 Jul 08 02:05:50 devstack sudo[106710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:51 devstack sudo[106710]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1b9a3ff4-9499-4665-98f5-7c1307d3b302 tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8dabaa6e-d574-4134-834b-cf56b01819e4.f0199dc3-b23f-47c7-9af9-c4a316003e06" returned: 0 in 1.134s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1b9a3ff4-9499-4665-98f5-7c1307d3b302 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8dabaa6e-d574-4134-834b-cf56b01819e4.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:51 devstack sudo[106713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8dabaa6e-d574-4134-834b-cf56b01819e4.info Jul 08 02:05:51 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:52 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:52 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1b9a3ff4-9499-4665-98f5-7c1307d3b302 tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8dabaa6e-d574-4134-834b-cf56b01819e4.info" returned: 0 in 0.877s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:52 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-1b9a3ff4-9499-4665-98f5-7c1307d3b302 tempest-ProjectMemberTests-73815212 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8dabaa6e-d574-4134-834b-cf56b01819e4.info is being set with open permissions: ugo+rw Jul 08 02:05:52 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1b9a3ff4-9499-4665-98f5-7c1307d3b302 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8dabaa6e-d574-4134-834b-cf56b01819e4.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:52 devstack sudo[106716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8dabaa6e-d574-4134-834b-cf56b01819e4.info Jul 08 02:05:52 devstack sudo[106716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:53 devstack sudo[106716]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1b9a3ff4-9499-4665-98f5-7c1307d3b302 tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8dabaa6e-d574-4134-834b-cf56b01819e4.info" returned: 0 in 1.106s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-1b9a3ff4-9499-4665-98f5-7c1307d3b302 tempest-ProjectMemberTests-73815212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.528s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:05:53 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-1b9a3ff4-9499-4665-98f5-7c1307d3b302 tempest-ProjectMemberTests-73815212 None] Create snapshot completed successfully Jul 08 02:05:53 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-ad944fa5-c240-4881-b6fe-ee0994e21086 tempest-ProjectMemberTests-73815212 None] Acquiring lock "cinder-f0199dc3-b23f-47c7-9af9-c4a316003e06-delete_snapshot" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:05:53 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-ad944fa5-c240-4881-b6fe-ee0994e21086 tempest-ProjectMemberTests-73815212 None] Lock "cinder-f0199dc3-b23f-47c7-9af9-c4a316003e06-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:05:53 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-ad944fa5-c240-4881-b6fe-ee0994e21086 tempest-ProjectMemberTests-73815212 None] Acquiring lock "cinder-quobyte-8dabaa6e-d574-4134-834b-cf56b01819e4" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:05:53 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-ad944fa5-c240-4881-b6fe-ee0994e21086 tempest-ProjectMemberTests-73815212 None] Lock "cinder-quobyte-8dabaa6e-d574-4134-834b-cf56b01819e4" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:05:53 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-ad944fa5-c240-4881-b6fe-ee0994e21086 tempest-ProjectMemberTests-73815212 None] Acquiring lock "cinder-quobyte-f0199dc3-b23f-47c7-9af9-c4a316003e06" by "_delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:05:53 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-ad944fa5-c240-4881-b6fe-ee0994e21086 tempest-ProjectMemberTests-73815212 None] Lock "cinder-quobyte-f0199dc3-b23f-47c7-9af9-c4a316003e06" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:05:53 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-ad944fa5-c240-4881-b6fe-ee0994e21086 tempest-ProjectMemberTests-73815212 None] Deleting offline snapshot f0199dc3-b23f-47c7-9af9-c4a316003e06 of volume 8dabaa6e-d574-4134-834b-cf56b01819e4 {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 02:05:53 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-ad944fa5-c240-4881-b6fe-ee0994e21086 tempest-ProjectMemberTests-73815212 None] snapshot_file for this snap is: volume-8dabaa6e-d574-4134-834b-cf56b01819e4.f0199dc3-b23f-47c7-9af9-c4a316003e06 {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 02:05:53 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[80cbba40-1194-4f5d-9285-e5b5c79d75f0]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:05:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ad944fa5-c240-4881-b6fe-ee0994e21086 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8dabaa6e-d574-4134-834b-cf56b01819e4.f0199dc3-b23f-47c7-9af9-c4a316003e06 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:53 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c63188a-ed17-46c0-837a-30d1cb5b7255 tempest-ProjectReaderTests-312900396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:05:53 devstack sudo[106720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8dabaa6e-d574-4134-834b-cf56b01819e4.f0199dc3-b23f-47c7-9af9-c4a316003e06 Jul 08 02:05:53 devstack sudo[106720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:53 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6c63188a-ed17-46c0-837a-30d1cb5b7255 tempest-ProjectReaderTests-312900396 None] Flow 'volume_create_manager' (72d62989-2f02-4a08-938b-61711e24f35e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:05:53 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6c63188a-ed17-46c0-837a-30d1cb5b7255 tempest-ProjectReaderTests-312900396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfa576d7-28fb-489f-818b-6a190851c3ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:05:53 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6c63188a-ed17-46c0-837a-30d1cb5b7255 tempest-ProjectReaderTests-312900396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfa576d7-28fb-489f-818b-6a190851c3ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:05:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1028346014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38dd5d67-be2a-440a-8976-b6b383ecb09f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5fa36408b734f618878838518b4007d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:05:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:05:54Z,use_quota=True,user_id='bede4eae4006495b81cad29723667ca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:05:53 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6c63188a-ed17-46c0-837a-30d1cb5b7255 tempest-ProjectReaderTests-312900396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77a2e34f-0142-4df7-acbe-92c6e9c46297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:05:53 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6c63188a-ed17-46c0-837a-30d1cb5b7255 tempest-ProjectReaderTests-312900396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77a2e34f-0142-4df7-acbe-92c6e9c46297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:05:54 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6c63188a-ed17-46c0-837a-30d1cb5b7255 tempest-ProjectReaderTests-312900396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6204ee50-6f02-433d-a16d-f8e8bf06edea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:05:54 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6c63188a-ed17-46c0-837a-30d1cb5b7255 tempest-ProjectReaderTests-312900396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6204ee50-6f02-433d-a16d-f8e8bf06edea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38dd5d67-be2a-440a-8976-b6b383ecb09f', 'volume_name': 'volume-38dd5d67-be2a-440a-8976-b6b383ecb09f', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:05:54 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6c63188a-ed17-46c0-837a-30d1cb5b7255 tempest-ProjectReaderTests-312900396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61cd559e-1a8c-4507-9655-b43474f51623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:05:54 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6c63188a-ed17-46c0-837a-30d1cb5b7255 tempest-ProjectReaderTests-312900396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61cd559e-1a8c-4507-9655-b43474f51623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:05:54 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6c63188a-ed17-46c0-837a-30d1cb5b7255 tempest-ProjectReaderTests-312900396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aba91dad-c1b0-4635-9180-7969bb94f5e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:05:54 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-6c63188a-ed17-46c0-837a-30d1cb5b7255 tempest-ProjectReaderTests-312900396 None] Volume 38dd5d67-be2a-440a-8976-b6b383ecb09f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38dd5d67-be2a-440a-8976-b6b383ecb09f', 'volume_size': 1} Jul 08 02:05:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6c63188a-ed17-46c0-837a-30d1cb5b7255 tempest-ProjectReaderTests-312900396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:05:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6c63188a-ed17-46c0-837a-30d1cb5b7255 tempest-ProjectReaderTests-312900396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:05:54 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-6c63188a-ed17-46c0-837a-30d1cb5b7255 tempest-ProjectReaderTests-312900396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:05:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1028346014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38dd5d67-be2a-440a-8976-b6b383ecb09f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5fa36408b734f618878838518b4007d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:05:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:05:54Z,use_quota=True,user_id='bede4eae4006495b81cad29723667ca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:05:54 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-6c63188a-ed17-46c0-837a-30d1cb5b7255 tempest-ProjectReaderTests-312900396 None] Creating volume 38dd5d67-be2a-440a-8976-b6b383ecb09f {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:05:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6c63188a-ed17-46c0-837a-30d1cb5b7255 tempest-ProjectReaderTests-312900396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:05:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6c63188a-ed17-46c0-837a-30d1cb5b7255 tempest-ProjectReaderTests-312900396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:05:54 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-6c63188a-ed17-46c0-837a-30d1cb5b7255 tempest-ProjectReaderTests-312900396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:05:54 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-6c63188a-ed17-46c0-837a-30d1cb5b7255 tempest-ProjectReaderTests-312900396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:05:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6c63188a-ed17-46c0-837a-30d1cb5b7255 tempest-ProjectReaderTests-312900396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:05:54 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-6c63188a-ed17-46c0-837a-30d1cb5b7255 tempest-ProjectReaderTests-312900396 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:05:54 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-6c63188a-ed17-46c0-837a-30d1cb5b7255 tempest-ProjectReaderTests-312900396 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 02:05:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6c63188a-ed17-46c0-837a-30d1cb5b7255 tempest-ProjectReaderTests-312900396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-38dd5d67-be2a-440a-8976-b6b383ecb09f 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:54 devstack sudo[106722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-38dd5d67-be2a-440a-8976-b6b383ecb09f 1073741824 Jul 08 02:05:54 devstack sudo[106722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:54 devstack sudo[106720]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ad944fa5-c240-4881-b6fe-ee0994e21086 tempest-ProjectMemberTests-73815212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8dabaa6e-d574-4134-834b-cf56b01819e4.f0199dc3-b23f-47c7-9af9-c4a316003e06" returned: 0 in 0.927s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:54 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-ad944fa5-c240-4881-b6fe-ee0994e21086 tempest-ProjectMemberTests-73815212 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8dabaa6e-d574-4134-834b-cf56b01819e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:05:54 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[98374d0a-3b2d-406c-8967-130b69f519e4]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:05:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ad944fa5-c240-4881-b6fe-ee0994e21086 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8dabaa6e-d574-4134-834b-cf56b01819e4 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:54 devstack sudo[106729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8dabaa6e-d574-4134-834b-cf56b01819e4 Jul 08 02:05:54 devstack sudo[106729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:55 devstack sudo[106722]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:55 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6c63188a-ed17-46c0-837a-30d1cb5b7255 tempest-ProjectReaderTests-312900396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-38dd5d67-be2a-440a-8976-b6b383ecb09f 1073741824" returned: 0 in 1.170s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:55 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6c63188a-ed17-46c0-837a-30d1cb5b7255 tempest-ProjectReaderTests-312900396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-38dd5d67-be2a-440a-8976-b6b383ecb09f {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:55 devstack sudo[106732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-38dd5d67-be2a-440a-8976-b6b383ecb09f Jul 08 02:05:55 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:55 devstack sudo[106729]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:55 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ad944fa5-c240-4881-b6fe-ee0994e21086 tempest-ProjectMemberTests-73815212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8dabaa6e-d574-4134-834b-cf56b01819e4" returned: 0 in 1.118s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:55 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ad944fa5-c240-4881-b6fe-ee0994e21086 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8dabaa6e-d574-4134-834b-cf56b01819e4.f0199dc3-b23f-47c7-9af9-c4a316003e06 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:55 devstack sudo[106738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8dabaa6e-d574-4134-834b-cf56b01819e4.f0199dc3-b23f-47c7-9af9-c4a316003e06 Jul 08 02:05:55 devstack sudo[106738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:56 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:56 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6c63188a-ed17-46c0-837a-30d1cb5b7255 tempest-ProjectReaderTests-312900396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-38dd5d67-be2a-440a-8976-b6b383ecb09f" returned: 0 in 1.066s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:56 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-6c63188a-ed17-46c0-837a-30d1cb5b7255 tempest-ProjectReaderTests-312900396 None] <== create_volume: return (2306ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:05:56 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6c63188a-ed17-46c0-837a-30d1cb5b7255 tempest-ProjectReaderTests-312900396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.310s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:05:56 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6c63188a-ed17-46c0-837a-30d1cb5b7255 tempest-ProjectReaderTests-312900396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aba91dad-c1b0-4635-9180-7969bb94f5e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38dd5d67-be2a-440a-8976-b6b383ecb09f', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:05:56 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6c63188a-ed17-46c0-837a-30d1cb5b7255 tempest-ProjectReaderTests-312900396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b6cf670-b6a0-43fb-bcb2-ea622a46cdda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:05:56 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-6c63188a-ed17-46c0-837a-30d1cb5b7255 tempest-ProjectReaderTests-312900396 None] Volume volume-38dd5d67-be2a-440a-8976-b6b383ecb09f (38dd5d67-be2a-440a-8976-b6b383ecb09f): created successfully Jul 08 02:05:56 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6c63188a-ed17-46c0-837a-30d1cb5b7255 tempest-ProjectReaderTests-312900396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b6cf670-b6a0-43fb-bcb2-ea622a46cdda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:05:56 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6c63188a-ed17-46c0-837a-30d1cb5b7255 tempest-ProjectReaderTests-312900396 None] Flow 'volume_create_manager' (72d62989-2f02-4a08-938b-61711e24f35e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:05:56 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-6c63188a-ed17-46c0-837a-30d1cb5b7255 tempest-ProjectReaderTests-312900396 None] Created volume successfully. Jul 08 02:05:56 devstack sudo[106738]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:56 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ad944fa5-c240-4881-b6fe-ee0994e21086 tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8dabaa6e-d574-4134-834b-cf56b01819e4.f0199dc3-b23f-47c7-9af9-c4a316003e06" returned: 0 in 1.028s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:56 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ad944fa5-c240-4881-b6fe-ee0994e21086 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8dabaa6e-d574-4134-834b-cf56b01819e4.f0199dc3-b23f-47c7-9af9-c4a316003e06 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:56 devstack sudo[106745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8dabaa6e-d574-4134-834b-cf56b01819e4.f0199dc3-b23f-47c7-9af9-c4a316003e06 Jul 08 02:05:56 devstack sudo[106745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:57 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-fecb43f8-1453-4cf9-99bc-708148e0ba8c tempest-ProjectReaderTests-312900396 None] Acquiring lock "cinder-38dd5d67-be2a-440a-8976-b6b383ecb09f-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:05:57 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-fecb43f8-1453-4cf9-99bc-708148e0ba8c tempest-ProjectReaderTests-312900396 None] Lock "cinder-38dd5d67-be2a-440a-8976-b6b383ecb09f-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:05:57 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-fecb43f8-1453-4cf9-99bc-708148e0ba8c tempest-ProjectReaderTests-312900396 None] Acquiring lock "cinder-quobyte-38dd5d67-be2a-440a-8976-b6b383ecb09f" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:05:57 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-fecb43f8-1453-4cf9-99bc-708148e0ba8c tempest-ProjectReaderTests-312900396 None] Lock "cinder-quobyte-38dd5d67-be2a-440a-8976-b6b383ecb09f" acquired by "delete_volume" :: waited 0.027s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:05:57 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d1fb5e-c752-4a42-b87b-e176e9cc786d]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:05:57 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-fecb43f8-1453-4cf9-99bc-708148e0ba8c tempest-ProjectReaderTests-312900396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-38dd5d67-be2a-440a-8976-b6b383ecb09f {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:57 devstack sudo[106747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-38dd5d67-be2a-440a-8976-b6b383ecb09f Jul 08 02:05:57 devstack sudo[106747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:57 devstack sudo[106745]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:57 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-ad944fa5-c240-4881-b6fe-ee0994e21086 tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8dabaa6e-d574-4134-834b-cf56b01819e4.f0199dc3-b23f-47c7-9af9-c4a316003e06" returned: 0 in 0.816s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:57 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-ad944fa5-c240-4881-b6fe-ee0994e21086 tempest-ProjectMemberTests-73815212 None] Lock "cinder-quobyte-f0199dc3-b23f-47c7-9af9-c4a316003e06" released by "_delete_snapshot" :: held 4.052s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:05:57 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-ad944fa5-c240-4881-b6fe-ee0994e21086 tempest-ProjectMemberTests-73815212 None] Lock "cinder-quobyte-8dabaa6e-d574-4134-834b-cf56b01819e4" released by "delete_snapshot" :: held 4.083s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:05:57 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-ad944fa5-c240-4881-b6fe-ee0994e21086 tempest-ProjectMemberTests-73815212 None] Created reservations ['bc6816d5-cc31-4905-b2b6-915a9aba4b08', '4e72ea35-fc54-4393-8ea7-0ddaaff59318', '5833514a-3280-4e29-b91d-dfe12664d79b', 'e2a2bacb-84e3-4bd7-be15-d31978b4cd7c'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:05:57 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-ad944fa5-c240-4881-b6fe-ee0994e21086 tempest-ProjectMemberTests-73815212 None] Delete snapshot completed successfully. Jul 08 02:05:58 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-ad944fa5-c240-4881-b6fe-ee0994e21086 tempest-ProjectMemberTests-73815212 None] Lock "cinder-f0199dc3-b23f-47c7-9af9-c4a316003e06-delete_snapshot" released by "delete_snapshot" :: held 4.313s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:05:58 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-d4166056-e6ea-41a4-b5c0-c08cec7921bd tempest-ProjectMemberTests-73815212 None] Acquiring lock "cinder-8dabaa6e-d574-4134-834b-cf56b01819e4-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:05:58 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-d4166056-e6ea-41a4-b5c0-c08cec7921bd tempest-ProjectMemberTests-73815212 None] Lock "cinder-8dabaa6e-d574-4134-834b-cf56b01819e4-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:05:58 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-d4166056-e6ea-41a4-b5c0-c08cec7921bd tempest-ProjectMemberTests-73815212 None] Acquiring lock "cinder-quobyte-8dabaa6e-d574-4134-834b-cf56b01819e4" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:05:58 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-d4166056-e6ea-41a4-b5c0-c08cec7921bd tempest-ProjectMemberTests-73815212 None] Lock "cinder-quobyte-8dabaa6e-d574-4134-834b-cf56b01819e4" acquired by "delete_volume" :: waited 0.022s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:05:58 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[1623655a-2ee6-4c09-bb0d-4ae5c3606615]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:05:58 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d4166056-e6ea-41a4-b5c0-c08cec7921bd tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8dabaa6e-d574-4134-834b-cf56b01819e4 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:58 devstack sudo[106750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8dabaa6e-d574-4134-834b-cf56b01819e4 Jul 08 02:05:58 devstack sudo[106750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:58 devstack sudo[106747]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:58 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-fecb43f8-1453-4cf9-99bc-708148e0ba8c tempest-ProjectReaderTests-312900396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-38dd5d67-be2a-440a-8976-b6b383ecb09f" returned: 0 in 1.200s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:58 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-fecb43f8-1453-4cf9-99bc-708148e0ba8c tempest-ProjectReaderTests-312900396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-38dd5d67-be2a-440a-8976-b6b383ecb09f {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:58 devstack sudo[106755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-38dd5d67-be2a-440a-8976-b6b383ecb09f Jul 08 02:05:58 devstack sudo[106755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:59 devstack sudo[106750]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d4166056-e6ea-41a4-b5c0-c08cec7921bd tempest-ProjectMemberTests-73815212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8dabaa6e-d574-4134-834b-cf56b01819e4" returned: 0 in 0.982s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d4166056-e6ea-41a4-b5c0-c08cec7921bd tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8dabaa6e-d574-4134-834b-cf56b01819e4 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:59 devstack sudo[106761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8dabaa6e-d574-4134-834b-cf56b01819e4 Jul 08 02:05:59 devstack sudo[106761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:05:59 devstack sudo[106755]: pam_unix(sudo:session): session closed for user root Jul 08 02:05:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-fecb43f8-1453-4cf9-99bc-708148e0ba8c tempest-ProjectReaderTests-312900396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-38dd5d67-be2a-440a-8976-b6b383ecb09f" returned: 0 in 0.749s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:05:59 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-fecb43f8-1453-4cf9-99bc-708148e0ba8c tempest-ProjectReaderTests-312900396 None] Lock "cinder-quobyte-38dd5d67-be2a-440a-8976-b6b383ecb09f" released by "delete_volume" :: held 2.025s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:05:59 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-fecb43f8-1453-4cf9-99bc-708148e0ba8c tempest-ProjectReaderTests-312900396 None] Created reservations ['b77152be-3e39-404d-b56d-f9e8a44116ef', 'c930bcaf-febd-4315-8d66-75ce050c2788', 'b226b92b-3c28-4b67-b124-a843564dd44b', 'e1534dbf-020e-4cf8-a6d3-11304c2dd1e8'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:05:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-fecb43f8-1453-4cf9-99bc-708148e0ba8c tempest-ProjectReaderTests-312900396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:05:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-fecb43f8-1453-4cf9-99bc-708148e0ba8c tempest-ProjectReaderTests-312900396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:05:59 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-fecb43f8-1453-4cf9-99bc-708148e0ba8c tempest-ProjectReaderTests-312900396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:05:59 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-fecb43f8-1453-4cf9-99bc-708148e0ba8c tempest-ProjectReaderTests-312900396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:05:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-fecb43f8-1453-4cf9-99bc-708148e0ba8c tempest-ProjectReaderTests-312900396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:05:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-fecb43f8-1453-4cf9-99bc-708148e0ba8c tempest-ProjectReaderTests-312900396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:05:59 devstack sudo[106763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 02:05:59 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:00 devstack sudo[106761]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d4166056-e6ea-41a4-b5c0-c08cec7921bd tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8dabaa6e-d574-4134-834b-cf56b01819e4" returned: 0 in 0.904s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:00 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-d4166056-e6ea-41a4-b5c0-c08cec7921bd tempest-ProjectMemberTests-73815212 None] Lock "cinder-quobyte-8dabaa6e-d574-4134-834b-cf56b01819e4" released by "delete_volume" :: held 1.989s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:06:00 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-d4166056-e6ea-41a4-b5c0-c08cec7921bd tempest-ProjectMemberTests-73815212 None] Created reservations ['48559fe6-1bec-4d74-b3fb-1f5d486346ba', '97763166-163a-47ef-b065-7966d3bb1974', '9fd81632-050c-4a4e-999f-5da1c6add4df', 'de12ae17-e767-4e1a-a56a-4bb6ba1d5eb3'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:06:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-d4166056-e6ea-41a4-b5c0-c08cec7921bd tempest-ProjectMemberTests-73815212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:06:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-d4166056-e6ea-41a4-b5c0-c08cec7921bd tempest-ProjectMemberTests-73815212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:06:00 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-d4166056-e6ea-41a4-b5c0-c08cec7921bd tempest-ProjectMemberTests-73815212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:06:00 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-d4166056-e6ea-41a4-b5c0-c08cec7921bd tempest-ProjectMemberTests-73815212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:06:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-d4166056-e6ea-41a4-b5c0-c08cec7921bd tempest-ProjectMemberTests-73815212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:06:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d4166056-e6ea-41a4-b5c0-c08cec7921bd tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:00 devstack sudo[106766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 02:06:00 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:00 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a328645-a7a7-4427-9265-9158a250839f tempest-ProjectReaderTests-312900396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:06:00 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6a328645-a7a7-4427-9265-9158a250839f tempest-ProjectReaderTests-312900396 None] Flow 'volume_create_manager' (34568631-de5b-4295-8a46-bb8c44d462b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:06:00 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6a328645-a7a7-4427-9265-9158a250839f tempest-ProjectReaderTests-312900396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (161e4123-5860-44cd-9910-c9cd59147d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:06:00 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6a328645-a7a7-4427-9265-9158a250839f tempest-ProjectReaderTests-312900396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (161e4123-5860-44cd-9910-c9cd59147d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:06:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-464046210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62a6e996-33f8-448a-af69-6495b84eaa70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5fa36408b734f618878838518b4007d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:06:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:06:01Z,use_quota=True,user_id='bede4eae4006495b81cad29723667ca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:06:00 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6a328645-a7a7-4427-9265-9158a250839f tempest-ProjectReaderTests-312900396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7eb24681-2b9f-4e90-9ebc-94e389aa0415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:06:00 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6a328645-a7a7-4427-9265-9158a250839f tempest-ProjectReaderTests-312900396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7eb24681-2b9f-4e90-9ebc-94e389aa0415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:06:00 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6a328645-a7a7-4427-9265-9158a250839f tempest-ProjectReaderTests-312900396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7639331e-a635-476e-8563-3315ba012257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:06:01 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6a328645-a7a7-4427-9265-9158a250839f tempest-ProjectReaderTests-312900396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7639331e-a635-476e-8563-3315ba012257) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62a6e996-33f8-448a-af69-6495b84eaa70', 'volume_name': 'volume-62a6e996-33f8-448a-af69-6495b84eaa70', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:06:01 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6a328645-a7a7-4427-9265-9158a250839f tempest-ProjectReaderTests-312900396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0ca2d2d-d8aa-4124-9010-c1997dd2be63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:06:01 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6a328645-a7a7-4427-9265-9158a250839f tempest-ProjectReaderTests-312900396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0ca2d2d-d8aa-4124-9010-c1997dd2be63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:06:01 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6a328645-a7a7-4427-9265-9158a250839f tempest-ProjectReaderTests-312900396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13a3d703-61c2-4ec4-a639-3e80ae0972d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:06:01 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-6a328645-a7a7-4427-9265-9158a250839f tempest-ProjectReaderTests-312900396 None] Volume 62a6e996-33f8-448a-af69-6495b84eaa70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62a6e996-33f8-448a-af69-6495b84eaa70', 'volume_size': 1} Jul 08 02:06:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6a328645-a7a7-4427-9265-9158a250839f tempest-ProjectReaderTests-312900396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:06:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6a328645-a7a7-4427-9265-9158a250839f tempest-ProjectReaderTests-312900396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:06:01 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-6a328645-a7a7-4427-9265-9158a250839f tempest-ProjectReaderTests-312900396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:06:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-464046210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62a6e996-33f8-448a-af69-6495b84eaa70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5fa36408b734f618878838518b4007d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:06:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:06:01Z,use_quota=True,user_id='bede4eae4006495b81cad29723667ca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:06:01 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-6a328645-a7a7-4427-9265-9158a250839f tempest-ProjectReaderTests-312900396 None] Creating volume 62a6e996-33f8-448a-af69-6495b84eaa70 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:06:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6a328645-a7a7-4427-9265-9158a250839f tempest-ProjectReaderTests-312900396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:06:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6a328645-a7a7-4427-9265-9158a250839f tempest-ProjectReaderTests-312900396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:06:01 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-6a328645-a7a7-4427-9265-9158a250839f tempest-ProjectReaderTests-312900396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:06:01 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-6a328645-a7a7-4427-9265-9158a250839f tempest-ProjectReaderTests-312900396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:06:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6a328645-a7a7-4427-9265-9158a250839f tempest-ProjectReaderTests-312900396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:06:01 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-6a328645-a7a7-4427-9265-9158a250839f tempest-ProjectReaderTests-312900396 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:06:01 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-6a328645-a7a7-4427-9265-9158a250839f tempest-ProjectReaderTests-312900396 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 02:06:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6a328645-a7a7-4427-9265-9158a250839f tempest-ProjectReaderTests-312900396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-62a6e996-33f8-448a-af69-6495b84eaa70 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:01 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:01 devstack sudo[106769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-62a6e996-33f8-448a-af69-6495b84eaa70 1073741824 Jul 08 02:06:01 devstack sudo[106769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-fecb43f8-1453-4cf9-99bc-708148e0ba8c tempest-ProjectReaderTests-312900396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 1.468s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:01 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-fecb43f8-1453-4cf9-99bc-708148e0ba8c tempest-ProjectReaderTests-312900396 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:06:01 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-fecb43f8-1453-4cf9-99bc-708148e0ba8c tempest-ProjectReaderTests-312900396 None] Deleted volume successfully. Jul 08 02:06:01 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-fecb43f8-1453-4cf9-99bc-708148e0ba8c tempest-ProjectReaderTests-312900396 None] Lock "cinder-38dd5d67-be2a-440a-8976-b6b383ecb09f-delete_volume" released by "delete_volume" :: held 3.865s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:06:01 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d4166056-e6ea-41a4-b5c0-c08cec7921bd tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 1.208s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:01 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-d4166056-e6ea-41a4-b5c0-c08cec7921bd tempest-ProjectMemberTests-73815212 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:06:01 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-d4166056-e6ea-41a4-b5c0-c08cec7921bd tempest-ProjectMemberTests-73815212 None] Deleted volume successfully. Jul 08 02:06:01 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-d4166056-e6ea-41a4-b5c0-c08cec7921bd tempest-ProjectMemberTests-73815212 None] Lock "cinder-8dabaa6e-d574-4134-834b-cf56b01819e4-delete_volume" released by "delete_volume" :: held 3.658s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:06:02 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-c99f6f2d-7431-4df6-88ca-7e80e677e098 tempest-ProjectMemberTests-73815212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:06:02 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c99f6f2d-7431-4df6-88ca-7e80e677e098 tempest-ProjectMemberTests-73815212 None] Flow 'volume_create_manager' (dd400eff-35ee-4b1b-9f53-32eb6da74a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:06:02 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c99f6f2d-7431-4df6-88ca-7e80e677e098 tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (820f3b03-0895-4501-95ff-d784ceada758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:06:02 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c99f6f2d-7431-4df6-88ca-7e80e677e098 tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (820f3b03-0895-4501-95ff-d784ceada758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:06:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1464717706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad7d561f-50c0-4596-9d21-52079c14484e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f353d90ed9694fe88617e9c4eed37bf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:06:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:06:02Z,use_quota=True,user_id='6137db3fdb294c84a17fd39e57e13785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:06:02 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c99f6f2d-7431-4df6-88ca-7e80e677e098 tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0add107b-6d2b-4f9e-913b-1ccc14d3e2f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:06:02 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c99f6f2d-7431-4df6-88ca-7e80e677e098 tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0add107b-6d2b-4f9e-913b-1ccc14d3e2f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:06:02 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c99f6f2d-7431-4df6-88ca-7e80e677e098 tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f661dcd8-568d-400b-85be-808b20e28263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:06:02 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c99f6f2d-7431-4df6-88ca-7e80e677e098 tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f661dcd8-568d-400b-85be-808b20e28263) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad7d561f-50c0-4596-9d21-52079c14484e', 'volume_name': 'volume-ad7d561f-50c0-4596-9d21-52079c14484e', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:06:02 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c99f6f2d-7431-4df6-88ca-7e80e677e098 tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4be5d1a4-175a-483e-9d70-bd0bfbe75dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:06:02 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c99f6f2d-7431-4df6-88ca-7e80e677e098 tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4be5d1a4-175a-483e-9d70-bd0bfbe75dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:06:02 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c99f6f2d-7431-4df6-88ca-7e80e677e098 tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (634a1b3f-f6cb-461d-a3c7-f28c55f44d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:06:02 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-c99f6f2d-7431-4df6-88ca-7e80e677e098 tempest-ProjectMemberTests-73815212 None] Volume ad7d561f-50c0-4596-9d21-52079c14484e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad7d561f-50c0-4596-9d21-52079c14484e', 'volume_size': 1} Jul 08 02:06:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c99f6f2d-7431-4df6-88ca-7e80e677e098 tempest-ProjectMemberTests-73815212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:06:02 devstack sudo[106769]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6a328645-a7a7-4427-9265-9158a250839f tempest-ProjectReaderTests-312900396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-62a6e996-33f8-448a-af69-6495b84eaa70 1073741824" returned: 0 in 1.399s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6a328645-a7a7-4427-9265-9158a250839f tempest-ProjectReaderTests-312900396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-62a6e996-33f8-448a-af69-6495b84eaa70 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:02 devstack sudo[106776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-62a6e996-33f8-448a-af69-6495b84eaa70 Jul 08 02:06:02 devstack sudo[106776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:02 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-e89868e3-2f49-443a-b287-f37e291b78b5 tempest-SnapshotDependencyTests-1378288582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:06:02 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e89868e3-2f49-443a-b287-f37e291b78b5 tempest-SnapshotDependencyTests-1378288582 None] Flow 'volume_create_manager' (46ec98db-ef24-44c3-9bed-8b06ead0bdea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:06:02 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e89868e3-2f49-443a-b287-f37e291b78b5 tempest-SnapshotDependencyTests-1378288582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (693a2b3c-58fe-405f-9d62-636c57efa338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:06:02 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e89868e3-2f49-443a-b287-f37e291b78b5 tempest-SnapshotDependencyTests-1378288582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (693a2b3c-58fe-405f-9d62-636c57efa338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:06:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-755537566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6dfe99b-30e0-4f49-81a3-9349e808381f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='363a65ad3341466cba054bb14e906c15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:06:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:06:03Z,use_quota=True,user_id='2e44a06a9d1b49089ce7fad57c06c8fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:06:02 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e89868e3-2f49-443a-b287-f37e291b78b5 tempest-SnapshotDependencyTests-1378288582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f454f45-9f3f-46fa-a468-d56817628620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:06:02 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e89868e3-2f49-443a-b287-f37e291b78b5 tempest-SnapshotDependencyTests-1378288582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f454f45-9f3f-46fa-a468-d56817628620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:06:02 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e89868e3-2f49-443a-b287-f37e291b78b5 tempest-SnapshotDependencyTests-1378288582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efbcb8be-9c2a-44e0-b126-da007917883b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:06:02 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e89868e3-2f49-443a-b287-f37e291b78b5 tempest-SnapshotDependencyTests-1378288582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efbcb8be-9c2a-44e0-b126-da007917883b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6dfe99b-30e0-4f49-81a3-9349e808381f', 'volume_name': 'volume-e6dfe99b-30e0-4f49-81a3-9349e808381f', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:06:02 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e89868e3-2f49-443a-b287-f37e291b78b5 tempest-SnapshotDependencyTests-1378288582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70ec139f-558a-44e6-bc04-8a296f39fb89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:06:02 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e89868e3-2f49-443a-b287-f37e291b78b5 tempest-SnapshotDependencyTests-1378288582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70ec139f-558a-44e6-bc04-8a296f39fb89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:06:02 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e89868e3-2f49-443a-b287-f37e291b78b5 tempest-SnapshotDependencyTests-1378288582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dd6702b-8f7a-4a2f-8fbe-06acf133c158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:06:02 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-e89868e3-2f49-443a-b287-f37e291b78b5 tempest-SnapshotDependencyTests-1378288582 None] Volume e6dfe99b-30e0-4f49-81a3-9349e808381f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6dfe99b-30e0-4f49-81a3-9349e808381f', 'volume_size': 1} Jul 08 02:06:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e89868e3-2f49-443a-b287-f37e291b78b5 tempest-SnapshotDependencyTests-1378288582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:06:03 devstack sudo[106776]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:03 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6a328645-a7a7-4427-9265-9158a250839f tempest-ProjectReaderTests-312900396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-62a6e996-33f8-448a-af69-6495b84eaa70" returned: 0 in 0.769s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:03 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-6a328645-a7a7-4427-9265-9158a250839f tempest-ProjectReaderTests-312900396 None] <== create_volume: return (2216ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:06:03 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6a328645-a7a7-4427-9265-9158a250839f tempest-ProjectReaderTests-312900396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.219s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:06:03 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c99f6f2d-7431-4df6-88ca-7e80e677e098 tempest-ProjectMemberTests-73815212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.874s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:06:03 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-c99f6f2d-7431-4df6-88ca-7e80e677e098 tempest-ProjectMemberTests-73815212 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:06:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1464717706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad7d561f-50c0-4596-9d21-52079c14484e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f353d90ed9694fe88617e9c4eed37bf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:06:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:06:02Z,use_quota=True,user_id='6137db3fdb294c84a17fd39e57e13785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:06:03 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-c99f6f2d-7431-4df6-88ca-7e80e677e098 tempest-ProjectMemberTests-73815212 None] Creating volume ad7d561f-50c0-4596-9d21-52079c14484e {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:06:03 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c99f6f2d-7431-4df6-88ca-7e80e677e098 tempest-ProjectMemberTests-73815212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:06:03 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c99f6f2d-7431-4df6-88ca-7e80e677e098 tempest-ProjectMemberTests-73815212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:06:03 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-c99f6f2d-7431-4df6-88ca-7e80e677e098 tempest-ProjectMemberTests-73815212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:06:03 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-c99f6f2d-7431-4df6-88ca-7e80e677e098 tempest-ProjectMemberTests-73815212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:06:03 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c99f6f2d-7431-4df6-88ca-7e80e677e098 tempest-ProjectMemberTests-73815212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:06:03 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-c99f6f2d-7431-4df6-88ca-7e80e677e098 tempest-ProjectMemberTests-73815212 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:06:03 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-c99f6f2d-7431-4df6-88ca-7e80e677e098 tempest-ProjectMemberTests-73815212 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 02:06:03 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c99f6f2d-7431-4df6-88ca-7e80e677e098 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ad7d561f-50c0-4596-9d21-52079c14484e 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:03 devstack sudo[106780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ad7d561f-50c0-4596-9d21-52079c14484e 1073741824 Jul 08 02:06:03 devstack sudo[106780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:03 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6a328645-a7a7-4427-9265-9158a250839f tempest-ProjectReaderTests-312900396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13a3d703-61c2-4ec4-a639-3e80ae0972d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62a6e996-33f8-448a-af69-6495b84eaa70', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:06:03 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6a328645-a7a7-4427-9265-9158a250839f tempest-ProjectReaderTests-312900396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4d23c3a-0045-4123-ae3a-3a5938fb662a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:06:03 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-6a328645-a7a7-4427-9265-9158a250839f tempest-ProjectReaderTests-312900396 None] Volume volume-62a6e996-33f8-448a-af69-6495b84eaa70 (62a6e996-33f8-448a-af69-6495b84eaa70): created successfully Jul 08 02:06:03 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6a328645-a7a7-4427-9265-9158a250839f tempest-ProjectReaderTests-312900396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4d23c3a-0045-4123-ae3a-3a5938fb662a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:06:03 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6a328645-a7a7-4427-9265-9158a250839f tempest-ProjectReaderTests-312900396 None] Flow 'volume_create_manager' (34568631-de5b-4295-8a46-bb8c44d462b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:06:03 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-6a328645-a7a7-4427-9265-9158a250839f tempest-ProjectReaderTests-312900396 None] Created volume successfully. Jul 08 02:06:03 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7953561d-93e4-4a8a-b798-176efa2205a7 tempest-ProjectReaderTests-312900396 None] Acquiring lock "cinder-62a6e996-33f8-448a-af69-6495b84eaa70-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:06:03 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7953561d-93e4-4a8a-b798-176efa2205a7 tempest-ProjectReaderTests-312900396 None] Lock "cinder-62a6e996-33f8-448a-af69-6495b84eaa70-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:06:03 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7953561d-93e4-4a8a-b798-176efa2205a7 tempest-ProjectReaderTests-312900396 None] Acquiring lock "cinder-quobyte-62a6e996-33f8-448a-af69-6495b84eaa70" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:06:03 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7953561d-93e4-4a8a-b798-176efa2205a7 tempest-ProjectReaderTests-312900396 None] Lock "cinder-quobyte-62a6e996-33f8-448a-af69-6495b84eaa70" acquired by "delete_volume" :: waited 0.020s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:06:04 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2362d55-04ec-48b7-b0f2-fe47fce9c7a0]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:06:04 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7953561d-93e4-4a8a-b798-176efa2205a7 tempest-ProjectReaderTests-312900396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-62a6e996-33f8-448a-af69-6495b84eaa70 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:04 devstack sudo[106785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-62a6e996-33f8-448a-af69-6495b84eaa70 Jul 08 02:06:04 devstack sudo[106785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:04 devstack sudo[106780]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:04 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c99f6f2d-7431-4df6-88ca-7e80e677e098 tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ad7d561f-50c0-4596-9d21-52079c14484e 1073741824" returned: 0 in 1.072s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:04 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c99f6f2d-7431-4df6-88ca-7e80e677e098 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ad7d561f-50c0-4596-9d21-52079c14484e {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:04 devstack sudo[106790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ad7d561f-50c0-4596-9d21-52079c14484e Jul 08 02:06:04 devstack sudo[106790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:04 devstack sudo[106785]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:04 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7953561d-93e4-4a8a-b798-176efa2205a7 tempest-ProjectReaderTests-312900396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-62a6e996-33f8-448a-af69-6495b84eaa70" returned: 0 in 0.933s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:04 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7953561d-93e4-4a8a-b798-176efa2205a7 tempest-ProjectReaderTests-312900396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-62a6e996-33f8-448a-af69-6495b84eaa70 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:04 devstack sudo[106795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-62a6e996-33f8-448a-af69-6495b84eaa70 Jul 08 02:06:04 devstack sudo[106795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:05 devstack sudo[106790]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:05 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c99f6f2d-7431-4df6-88ca-7e80e677e098 tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ad7d561f-50c0-4596-9d21-52079c14484e" returned: 0 in 0.743s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:05 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-c99f6f2d-7431-4df6-88ca-7e80e677e098 tempest-ProjectMemberTests-73815212 None] <== create_volume: return (1869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:06:05 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c99f6f2d-7431-4df6-88ca-7e80e677e098 tempest-ProjectMemberTests-73815212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.872s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:06:05 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e89868e3-2f49-443a-b287-f37e291b78b5 tempest-SnapshotDependencyTests-1378288582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.237s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:06:05 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-e89868e3-2f49-443a-b287-f37e291b78b5 tempest-SnapshotDependencyTests-1378288582 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:06:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-755537566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6dfe99b-30e0-4f49-81a3-9349e808381f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='363a65ad3341466cba054bb14e906c15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:06:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:06:03Z,use_quota=True,user_id='2e44a06a9d1b49089ce7fad57c06c8fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:06:05 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-e89868e3-2f49-443a-b287-f37e291b78b5 tempest-SnapshotDependencyTests-1378288582 None] Creating volume e6dfe99b-30e0-4f49-81a3-9349e808381f {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:06:05 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e89868e3-2f49-443a-b287-f37e291b78b5 tempest-SnapshotDependencyTests-1378288582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:06:05 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e89868e3-2f49-443a-b287-f37e291b78b5 tempest-SnapshotDependencyTests-1378288582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:06:05 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-e89868e3-2f49-443a-b287-f37e291b78b5 tempest-SnapshotDependencyTests-1378288582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:06:05 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-e89868e3-2f49-443a-b287-f37e291b78b5 tempest-SnapshotDependencyTests-1378288582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:06:05 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e89868e3-2f49-443a-b287-f37e291b78b5 tempest-SnapshotDependencyTests-1378288582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:06:05 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-e89868e3-2f49-443a-b287-f37e291b78b5 tempest-SnapshotDependencyTests-1378288582 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:06:05 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-e89868e3-2f49-443a-b287-f37e291b78b5 tempest-SnapshotDependencyTests-1378288582 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 02:06:05 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e89868e3-2f49-443a-b287-f37e291b78b5 tempest-SnapshotDependencyTests-1378288582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e6dfe99b-30e0-4f49-81a3-9349e808381f 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:05 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c99f6f2d-7431-4df6-88ca-7e80e677e098 tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (634a1b3f-f6cb-461d-a3c7-f28c55f44d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad7d561f-50c0-4596-9d21-52079c14484e', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:06:05 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c99f6f2d-7431-4df6-88ca-7e80e677e098 tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (779c5a48-6ef6-4b88-8665-789218031819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:06:05 devstack sudo[106798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e6dfe99b-30e0-4f49-81a3-9349e808381f 1073741824 Jul 08 02:06:05 devstack sudo[106798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:05 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-c99f6f2d-7431-4df6-88ca-7e80e677e098 tempest-ProjectMemberTests-73815212 None] Volume volume-ad7d561f-50c0-4596-9d21-52079c14484e (ad7d561f-50c0-4596-9d21-52079c14484e): created successfully Jul 08 02:06:05 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c99f6f2d-7431-4df6-88ca-7e80e677e098 tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (779c5a48-6ef6-4b88-8665-789218031819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:06:05 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c99f6f2d-7431-4df6-88ca-7e80e677e098 tempest-ProjectMemberTests-73815212 None] Flow 'volume_create_manager' (dd400eff-35ee-4b1b-9f53-32eb6da74a72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:06:05 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-c99f6f2d-7431-4df6-88ca-7e80e677e098 tempest-ProjectMemberTests-73815212 None] Created volume successfully. Jul 08 02:06:05 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-a627cb7b-e06d-49c0-801a-428aac904b74 tempest-ProjectMemberTests-73815212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:06:05 devstack sudo[106795]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:05 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7953561d-93e4-4a8a-b798-176efa2205a7 tempest-ProjectReaderTests-312900396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-62a6e996-33f8-448a-af69-6495b84eaa70" returned: 0 in 0.808s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:05 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7953561d-93e4-4a8a-b798-176efa2205a7 tempest-ProjectReaderTests-312900396 None] Lock "cinder-quobyte-62a6e996-33f8-448a-af69-6495b84eaa70" released by "delete_volume" :: held 1.795s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:06:05 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-7953561d-93e4-4a8a-b798-176efa2205a7 tempest-ProjectReaderTests-312900396 None] Created reservations ['c6e62580-bdce-443f-adec-48791f2b9fd9', 'd50778b9-f8fd-430f-9f58-27a100baa0ee', '1303dfed-754b-4e33-adca-4735e96ad591', '6751714e-c1cc-40bc-94cb-42afa69f72a0'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:06:05 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7953561d-93e4-4a8a-b798-176efa2205a7 tempest-ProjectReaderTests-312900396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:06:05 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7953561d-93e4-4a8a-b798-176efa2205a7 tempest-ProjectReaderTests-312900396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:06:05 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-7953561d-93e4-4a8a-b798-176efa2205a7 tempest-ProjectReaderTests-312900396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:06:05 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-7953561d-93e4-4a8a-b798-176efa2205a7 tempest-ProjectReaderTests-312900396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:06:05 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7953561d-93e4-4a8a-b798-176efa2205a7 tempest-ProjectReaderTests-312900396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:06:05 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7953561d-93e4-4a8a-b798-176efa2205a7 tempest-ProjectReaderTests-312900396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:05 devstack sudo[106804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 02:06:05 devstack sudo[106804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:06 devstack sudo[106798]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:06 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e89868e3-2f49-443a-b287-f37e291b78b5 tempest-SnapshotDependencyTests-1378288582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e6dfe99b-30e0-4f49-81a3-9349e808381f 1073741824" returned: 0 in 1.175s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:06 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e89868e3-2f49-443a-b287-f37e291b78b5 tempest-SnapshotDependencyTests-1378288582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e6dfe99b-30e0-4f49-81a3-9349e808381f {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:06 devstack sudo[106807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e6dfe99b-30e0-4f49-81a3-9349e808381f Jul 08 02:06:06 devstack sudo[106807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:06 devstack sudo[106804]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:06 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7953561d-93e4-4a8a-b798-176efa2205a7 tempest-ProjectReaderTests-312900396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.876s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:06 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-7953561d-93e4-4a8a-b798-176efa2205a7 tempest-ProjectReaderTests-312900396 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:06:06 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-7953561d-93e4-4a8a-b798-176efa2205a7 tempest-ProjectReaderTests-312900396 None] Deleted volume successfully. Jul 08 02:06:06 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7953561d-93e4-4a8a-b798-176efa2205a7 tempest-ProjectReaderTests-312900396 None] Lock "cinder-62a6e996-33f8-448a-af69-6495b84eaa70-delete_volume" released by "delete_volume" :: held 2.963s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:06:07 devstack sudo[106807]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:07 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e89868e3-2f49-443a-b287-f37e291b78b5 tempest-SnapshotDependencyTests-1378288582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e6dfe99b-30e0-4f49-81a3-9349e808381f" returned: 0 in 0.809s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:07 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-e89868e3-2f49-443a-b287-f37e291b78b5 tempest-SnapshotDependencyTests-1378288582 None] <== create_volume: return (2041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:06:07 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e89868e3-2f49-443a-b287-f37e291b78b5 tempest-SnapshotDependencyTests-1378288582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.045s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:06:07 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-a627cb7b-e06d-49c0-801a-428aac904b74 tempest-ProjectMemberTests-73815212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.522s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:06:07 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-a627cb7b-e06d-49c0-801a-428aac904b74 tempest-ProjectMemberTests-73815212 None] Creating offline snapshot cac1208d-717f-4be5-afb2-1a91e6fea87f of volume ad7d561f-50c0-4596-9d21-52079c14484e {{(pid=87134) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 02:06:07 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e89868e3-2f49-443a-b287-f37e291b78b5 tempest-SnapshotDependencyTests-1378288582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dd6702b-8f7a-4a2f-8fbe-06acf133c158) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6dfe99b-30e0-4f49-81a3-9349e808381f', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:06:07 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e89868e3-2f49-443a-b287-f37e291b78b5 tempest-SnapshotDependencyTests-1378288582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a045c272-3722-419f-a2f2-387cc6141dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:06:07 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ee64b4-1352-461f-992b-4f9d487b84fd]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:06:07 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a627cb7b-e06d-49c0-801a-428aac904b74 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ad7d561f-50c0-4596-9d21-52079c14484e {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:07 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-e89868e3-2f49-443a-b287-f37e291b78b5 tempest-SnapshotDependencyTests-1378288582 None] Volume volume-e6dfe99b-30e0-4f49-81a3-9349e808381f (e6dfe99b-30e0-4f49-81a3-9349e808381f): created successfully Jul 08 02:06:07 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e89868e3-2f49-443a-b287-f37e291b78b5 tempest-SnapshotDependencyTests-1378288582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a045c272-3722-419f-a2f2-387cc6141dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:06:07 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-e89868e3-2f49-443a-b287-f37e291b78b5 tempest-SnapshotDependencyTests-1378288582 None] Flow 'volume_create_manager' (46ec98db-ef24-44c3-9bed-8b06ead0bdea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:06:07 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-e89868e3-2f49-443a-b287-f37e291b78b5 tempest-SnapshotDependencyTests-1378288582 None] Created volume successfully. Jul 08 02:06:07 devstack sudo[106811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ad7d561f-50c0-4596-9d21-52079c14484e Jul 08 02:06:07 devstack sudo[106811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:08 devstack sudo[106811]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:08 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a627cb7b-e06d-49c0-801a-428aac904b74 tempest-ProjectMemberTests-73815212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ad7d561f-50c0-4596-9d21-52079c14484e" returned: 0 in 1.063s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:08 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a627cb7b-e06d-49c0-801a-428aac904b74 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ad7d561f-50c0-4596-9d21-52079c14484e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ad7d561f-50c0-4596-9d21-52079c14484e.cac1208d-717f-4be5-afb2-1a91e6fea87f 1G {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:08 devstack sudo[106816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ad7d561f-50c0-4596-9d21-52079c14484e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ad7d561f-50c0-4596-9d21-52079c14484e.cac1208d-717f-4be5-afb2-1a91e6fea87f 1G Jul 08 02:06:08 devstack sudo[106816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:08 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6c4f6312-e697-48bf-8e63-8ae9eeb38ad5 tempest-SnapshotDependencyTests-1378288582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:06:09 devstack sudo[106816]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:09 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a627cb7b-e06d-49c0-801a-428aac904b74 tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ad7d561f-50c0-4596-9d21-52079c14484e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ad7d561f-50c0-4596-9d21-52079c14484e.cac1208d-717f-4be5-afb2-1a91e6fea87f 1G" returned: 0 in 0.874s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:09 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a627cb7b-e06d-49c0-801a-428aac904b74 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad7d561f-50c0-4596-9d21-52079c14484e -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ad7d561f-50c0-4596-9d21-52079c14484e.cac1208d-717f-4be5-afb2-1a91e6fea87f {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:09 devstack sudo[106822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad7d561f-50c0-4596-9d21-52079c14484e -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ad7d561f-50c0-4596-9d21-52079c14484e.cac1208d-717f-4be5-afb2-1a91e6fea87f Jul 08 02:06:09 devstack sudo[106822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:10 devstack sudo[106822]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:10 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a627cb7b-e06d-49c0-801a-428aac904b74 tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad7d561f-50c0-4596-9d21-52079c14484e -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ad7d561f-50c0-4596-9d21-52079c14484e.cac1208d-717f-4be5-afb2-1a91e6fea87f" returned: 0 in 0.840s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:10 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-a627cb7b-e06d-49c0-801a-428aac904b74 tempest-ProjectMemberTests-73815212 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ad7d561f-50c0-4596-9d21-52079c14484e.cac1208d-717f-4be5-afb2-1a91e6fea87f is being set with open permissions: ugo+rw Jul 08 02:06:10 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a627cb7b-e06d-49c0-801a-428aac904b74 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ad7d561f-50c0-4596-9d21-52079c14484e.cac1208d-717f-4be5-afb2-1a91e6fea87f {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:10 devstack sudo[106827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ad7d561f-50c0-4596-9d21-52079c14484e.cac1208d-717f-4be5-afb2-1a91e6fea87f Jul 08 02:06:10 devstack sudo[106827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:10 devstack sudo[106827]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:10 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a627cb7b-e06d-49c0-801a-428aac904b74 tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ad7d561f-50c0-4596-9d21-52079c14484e.cac1208d-717f-4be5-afb2-1a91e6fea87f" returned: 0 in 0.743s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:10 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a627cb7b-e06d-49c0-801a-428aac904b74 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ad7d561f-50c0-4596-9d21-52079c14484e.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:10 devstack sudo[106830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ad7d561f-50c0-4596-9d21-52079c14484e.info Jul 08 02:06:10 devstack sudo[106830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:11 devstack sudo[106830]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:11 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a627cb7b-e06d-49c0-801a-428aac904b74 tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ad7d561f-50c0-4596-9d21-52079c14484e.info" returned: 0 in 0.775s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:11 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-a627cb7b-e06d-49c0-801a-428aac904b74 tempest-ProjectMemberTests-73815212 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ad7d561f-50c0-4596-9d21-52079c14484e.info is being set with open permissions: ugo+rw Jul 08 02:06:11 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a627cb7b-e06d-49c0-801a-428aac904b74 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ad7d561f-50c0-4596-9d21-52079c14484e.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:11 devstack sudo[106835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ad7d561f-50c0-4596-9d21-52079c14484e.info Jul 08 02:06:11 devstack sudo[106835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:12 devstack sudo[106835]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:12 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a627cb7b-e06d-49c0-801a-428aac904b74 tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ad7d561f-50c0-4596-9d21-52079c14484e.info" returned: 0 in 0.727s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:12 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-a627cb7b-e06d-49c0-801a-428aac904b74 tempest-ProjectMemberTests-73815212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.136s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:06:12 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6c4f6312-e697-48bf-8e63-8ae9eeb38ad5 tempest-SnapshotDependencyTests-1378288582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.698s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:06:12 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-6c4f6312-e697-48bf-8e63-8ae9eeb38ad5 tempest-SnapshotDependencyTests-1378288582 None] Creating offline snapshot c7dec992-fa0a-4918-bc99-9989ebbb59fd of volume e6dfe99b-30e0-4f49-81a3-9349e808381f {{(pid=87134) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 02:06:12 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-a627cb7b-e06d-49c0-801a-428aac904b74 tempest-ProjectMemberTests-73815212 None] Create snapshot completed successfully Jul 08 02:06:12 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9128d29-fa01-49d5-917f-f0bb7f6c7d7e]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:06:12 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6c4f6312-e697-48bf-8e63-8ae9eeb38ad5 tempest-SnapshotDependencyTests-1378288582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e6dfe99b-30e0-4f49-81a3-9349e808381f {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:12 devstack sudo[106838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e6dfe99b-30e0-4f49-81a3-9349e808381f Jul 08 02:06:12 devstack sudo[106838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:13 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-72516456-0d2c-4df4-819f-a6f4d2a2166f tempest-ProjectMemberTests-73815212 None] Acquiring lock "cinder-cac1208d-717f-4be5-afb2-1a91e6fea87f-delete_snapshot" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:06:13 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-72516456-0d2c-4df4-819f-a6f4d2a2166f tempest-ProjectMemberTests-73815212 None] Lock "cinder-cac1208d-717f-4be5-afb2-1a91e6fea87f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:06:13 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-72516456-0d2c-4df4-819f-a6f4d2a2166f tempest-ProjectMemberTests-73815212 None] Acquiring lock "cinder-quobyte-ad7d561f-50c0-4596-9d21-52079c14484e" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:06:13 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-72516456-0d2c-4df4-819f-a6f4d2a2166f tempest-ProjectMemberTests-73815212 None] Lock "cinder-quobyte-ad7d561f-50c0-4596-9d21-52079c14484e" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:06:13 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-72516456-0d2c-4df4-819f-a6f4d2a2166f tempest-ProjectMemberTests-73815212 None] Acquiring lock "cinder-quobyte-cac1208d-717f-4be5-afb2-1a91e6fea87f" by "_delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:06:13 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-72516456-0d2c-4df4-819f-a6f4d2a2166f tempest-ProjectMemberTests-73815212 None] Lock "cinder-quobyte-cac1208d-717f-4be5-afb2-1a91e6fea87f" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:06:13 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-72516456-0d2c-4df4-819f-a6f4d2a2166f tempest-ProjectMemberTests-73815212 None] Deleting offline snapshot cac1208d-717f-4be5-afb2-1a91e6fea87f of volume ad7d561f-50c0-4596-9d21-52079c14484e {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 02:06:13 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-72516456-0d2c-4df4-819f-a6f4d2a2166f tempest-ProjectMemberTests-73815212 None] snapshot_file for this snap is: volume-ad7d561f-50c0-4596-9d21-52079c14484e.cac1208d-717f-4be5-afb2-1a91e6fea87f {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 02:06:13 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e423a5-a320-4aab-9f81-1c13174983c4]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:06:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-72516456-0d2c-4df4-819f-a6f4d2a2166f tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ad7d561f-50c0-4596-9d21-52079c14484e.cac1208d-717f-4be5-afb2-1a91e6fea87f {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:13 devstack sudo[106841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ad7d561f-50c0-4596-9d21-52079c14484e.cac1208d-717f-4be5-afb2-1a91e6fea87f Jul 08 02:06:13 devstack sudo[106841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:13 devstack sudo[106838]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6c4f6312-e697-48bf-8e63-8ae9eeb38ad5 tempest-SnapshotDependencyTests-1378288582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e6dfe99b-30e0-4f49-81a3-9349e808381f" returned: 0 in 1.037s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6c4f6312-e697-48bf-8e63-8ae9eeb38ad5 tempest-SnapshotDependencyTests-1378288582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e6dfe99b-30e0-4f49-81a3-9349e808381f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e6dfe99b-30e0-4f49-81a3-9349e808381f.c7dec992-fa0a-4918-bc99-9989ebbb59fd 1G {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:13 devstack sudo[106846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e6dfe99b-30e0-4f49-81a3-9349e808381f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e6dfe99b-30e0-4f49-81a3-9349e808381f.c7dec992-fa0a-4918-bc99-9989ebbb59fd 1G Jul 08 02:06:13 devstack sudo[106846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:14 devstack sudo[106841]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:14 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-72516456-0d2c-4df4-819f-a6f4d2a2166f tempest-ProjectMemberTests-73815212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ad7d561f-50c0-4596-9d21-52079c14484e.cac1208d-717f-4be5-afb2-1a91e6fea87f" returned: 0 in 1.095s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:14 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-72516456-0d2c-4df4-819f-a6f4d2a2166f tempest-ProjectMemberTests-73815212 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad7d561f-50c0-4596-9d21-52079c14484e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:06:14 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa973808-208a-48a2-a8ce-75679d9adc72 tempest-ProjectReaderTests-1433171142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:06:14 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-fa973808-208a-48a2-a8ce-75679d9adc72 tempest-ProjectReaderTests-1433171142 None] Flow 'volume_create_manager' (b25b0b51-fc6b-4dae-a2d3-ab692727a64c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:06:14 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-fa973808-208a-48a2-a8ce-75679d9adc72 tempest-ProjectReaderTests-1433171142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a16204aa-ab22-4035-a98f-a90bd03d4333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:06:14 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b7c5150-bbba-48b7-9b6f-6040ffb2ce5e]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:06:14 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-72516456-0d2c-4df4-819f-a6f4d2a2166f tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ad7d561f-50c0-4596-9d21-52079c14484e {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:14 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-fa973808-208a-48a2-a8ce-75679d9adc72 tempest-ProjectReaderTests-1433171142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a16204aa-ab22-4035-a98f-a90bd03d4333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1332273210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0a14e59-934b-4e85-90c7-abc3817c3131,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fc2f26950e54299bf8795cacc9d2942',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:06:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:06:14Z,use_quota=True,user_id='1cb60482c75048c4acbb493dacb58905',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:06:14 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-fa973808-208a-48a2-a8ce-75679d9adc72 tempest-ProjectReaderTests-1433171142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36d3a339-e7b3-4d63-b2aa-944dcfafcfa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:06:14 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-fa973808-208a-48a2-a8ce-75679d9adc72 tempest-ProjectReaderTests-1433171142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36d3a339-e7b3-4d63-b2aa-944dcfafcfa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:06:14 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-fa973808-208a-48a2-a8ce-75679d9adc72 tempest-ProjectReaderTests-1433171142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0332e3d-2a17-4841-b207-5477b023f23d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:06:14 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-fa973808-208a-48a2-a8ce-75679d9adc72 tempest-ProjectReaderTests-1433171142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0332e3d-2a17-4841-b207-5477b023f23d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0a14e59-934b-4e85-90c7-abc3817c3131', 'volume_name': 'volume-e0a14e59-934b-4e85-90c7-abc3817c3131', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:06:14 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-fa973808-208a-48a2-a8ce-75679d9adc72 tempest-ProjectReaderTests-1433171142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e92685eb-d658-43b5-b0bf-b3f4308654d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:06:14 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-fa973808-208a-48a2-a8ce-75679d9adc72 tempest-ProjectReaderTests-1433171142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e92685eb-d658-43b5-b0bf-b3f4308654d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:06:14 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-fa973808-208a-48a2-a8ce-75679d9adc72 tempest-ProjectReaderTests-1433171142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75071718-7bdf-4bae-b92a-40d15f06c5f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:06:14 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-fa973808-208a-48a2-a8ce-75679d9adc72 tempest-ProjectReaderTests-1433171142 None] Volume e0a14e59-934b-4e85-90c7-abc3817c3131: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0a14e59-934b-4e85-90c7-abc3817c3131', 'volume_size': 1} Jul 08 02:06:14 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-fa973808-208a-48a2-a8ce-75679d9adc72 tempest-ProjectReaderTests-1433171142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:06:14 devstack sudo[106855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ad7d561f-50c0-4596-9d21-52079c14484e Jul 08 02:06:14 devstack sudo[106855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:14 devstack sudo[106846]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:14 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6c4f6312-e697-48bf-8e63-8ae9eeb38ad5 tempest-SnapshotDependencyTests-1378288582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e6dfe99b-30e0-4f49-81a3-9349e808381f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e6dfe99b-30e0-4f49-81a3-9349e808381f.c7dec992-fa0a-4918-bc99-9989ebbb59fd 1G" returned: 0 in 1.078s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:14 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6c4f6312-e697-48bf-8e63-8ae9eeb38ad5 tempest-SnapshotDependencyTests-1378288582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6dfe99b-30e0-4f49-81a3-9349e808381f -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e6dfe99b-30e0-4f49-81a3-9349e808381f.c7dec992-fa0a-4918-bc99-9989ebbb59fd {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:14 devstack sudo[106857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6dfe99b-30e0-4f49-81a3-9349e808381f -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e6dfe99b-30e0-4f49-81a3-9349e808381f.c7dec992-fa0a-4918-bc99-9989ebbb59fd Jul 08 02:06:14 devstack sudo[106857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:15 devstack sudo[106855]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-72516456-0d2c-4df4-819f-a6f4d2a2166f tempest-ProjectMemberTests-73815212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ad7d561f-50c0-4596-9d21-52079c14484e" returned: 0 in 0.871s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-72516456-0d2c-4df4-819f-a6f4d2a2166f tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ad7d561f-50c0-4596-9d21-52079c14484e.cac1208d-717f-4be5-afb2-1a91e6fea87f {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:15 devstack sudo[106865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ad7d561f-50c0-4596-9d21-52079c14484e.cac1208d-717f-4be5-afb2-1a91e6fea87f Jul 08 02:06:15 devstack sudo[106865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:15 devstack sudo[106857]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6c4f6312-e697-48bf-8e63-8ae9eeb38ad5 tempest-SnapshotDependencyTests-1378288582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6dfe99b-30e0-4f49-81a3-9349e808381f -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e6dfe99b-30e0-4f49-81a3-9349e808381f.c7dec992-fa0a-4918-bc99-9989ebbb59fd" returned: 0 in 0.787s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:15 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-6c4f6312-e697-48bf-8e63-8ae9eeb38ad5 tempest-SnapshotDependencyTests-1378288582 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e6dfe99b-30e0-4f49-81a3-9349e808381f.c7dec992-fa0a-4918-bc99-9989ebbb59fd is being set with open permissions: ugo+rw Jul 08 02:06:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6c4f6312-e697-48bf-8e63-8ae9eeb38ad5 tempest-SnapshotDependencyTests-1378288582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e6dfe99b-30e0-4f49-81a3-9349e808381f.c7dec992-fa0a-4918-bc99-9989ebbb59fd {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:15 devstack sudo[106867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e6dfe99b-30e0-4f49-81a3-9349e808381f.c7dec992-fa0a-4918-bc99-9989ebbb59fd Jul 08 02:06:15 devstack sudo[106867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:16 devstack sudo[106865]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-72516456-0d2c-4df4-819f-a6f4d2a2166f tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ad7d561f-50c0-4596-9d21-52079c14484e.cac1208d-717f-4be5-afb2-1a91e6fea87f" returned: 0 in 0.841s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-72516456-0d2c-4df4-819f-a6f4d2a2166f tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ad7d561f-50c0-4596-9d21-52079c14484e.cac1208d-717f-4be5-afb2-1a91e6fea87f {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:16 devstack sudo[106874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ad7d561f-50c0-4596-9d21-52079c14484e.cac1208d-717f-4be5-afb2-1a91e6fea87f Jul 08 02:06:16 devstack sudo[106874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:16 devstack sudo[106867]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6c4f6312-e697-48bf-8e63-8ae9eeb38ad5 tempest-SnapshotDependencyTests-1378288582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e6dfe99b-30e0-4f49-81a3-9349e808381f.c7dec992-fa0a-4918-bc99-9989ebbb59fd" returned: 0 in 0.842s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:16 devstack cinder-volume[87134]: DEBUG dbcounter [-] [87134] Writing DB stats cinder:SELECT=112,cinder:INSERT=36,cinder:UPDATE=136,cinder:DELETE=10 {{(pid=87134) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:06:16 devstack cinder-volume[87134]: DEBUG dbcounter [-] [87134] Writing DB stats cinder:UPDATE=130,cinder:SELECT=93,cinder:INSERT=33,cinder:DELETE=11 {{(pid=87134) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:06:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6c4f6312-e697-48bf-8e63-8ae9eeb38ad5 tempest-SnapshotDependencyTests-1378288582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e6dfe99b-30e0-4f49-81a3-9349e808381f.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:16 devstack sudo[106876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e6dfe99b-30e0-4f49-81a3-9349e808381f.info Jul 08 02:06:16 devstack sudo[106876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:16 devstack sudo[106874]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-72516456-0d2c-4df4-819f-a6f4d2a2166f tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ad7d561f-50c0-4596-9d21-52079c14484e.cac1208d-717f-4be5-afb2-1a91e6fea87f" returned: 0 in 0.689s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:16 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-72516456-0d2c-4df4-819f-a6f4d2a2166f tempest-ProjectMemberTests-73815212 None] Lock "cinder-quobyte-cac1208d-717f-4be5-afb2-1a91e6fea87f" released by "_delete_snapshot" :: held 3.656s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:06:16 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-72516456-0d2c-4df4-819f-a6f4d2a2166f tempest-ProjectMemberTests-73815212 None] Lock "cinder-quobyte-ad7d561f-50c0-4596-9d21-52079c14484e" released by "delete_snapshot" :: held 3.685s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:06:16 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-72516456-0d2c-4df4-819f-a6f4d2a2166f tempest-ProjectMemberTests-73815212 None] Created reservations ['b9d34766-8aef-4551-8d26-73c26893090e', '79215015-6c5e-4867-8d06-31ff7fb77c92', '0aeed2f6-8c98-4ceb-88ac-42442f13b127', '35b7578e-b8dd-495d-9da0-320803fb87e3'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:06:16 devstack sudo[106876]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6c4f6312-e697-48bf-8e63-8ae9eeb38ad5 tempest-SnapshotDependencyTests-1378288582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e6dfe99b-30e0-4f49-81a3-9349e808381f.info" returned: 0 in 0.783s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:16 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-6c4f6312-e697-48bf-8e63-8ae9eeb38ad5 tempest-SnapshotDependencyTests-1378288582 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e6dfe99b-30e0-4f49-81a3-9349e808381f.info is being set with open permissions: ugo+rw Jul 08 02:06:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6c4f6312-e697-48bf-8e63-8ae9eeb38ad5 tempest-SnapshotDependencyTests-1378288582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e6dfe99b-30e0-4f49-81a3-9349e808381f.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:16 devstack sudo[106880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e6dfe99b-30e0-4f49-81a3-9349e808381f.info Jul 08 02:06:16 devstack sudo[106880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:17 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-72516456-0d2c-4df4-819f-a6f4d2a2166f tempest-ProjectMemberTests-73815212 None] Delete snapshot completed successfully. Jul 08 02:06:17 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-72516456-0d2c-4df4-819f-a6f4d2a2166f tempest-ProjectMemberTests-73815212 None] Lock "cinder-cac1208d-717f-4be5-afb2-1a91e6fea87f-delete_snapshot" released by "delete_snapshot" :: held 4.053s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:06:17 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-4f3f2a29-60c4-4d66-84a0-923e887ecf38 tempest-ProjectMemberTests-73815212 None] Acquiring lock "cinder-ad7d561f-50c0-4596-9d21-52079c14484e-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:06:17 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-4f3f2a29-60c4-4d66-84a0-923e887ecf38 tempest-ProjectMemberTests-73815212 None] Lock "cinder-ad7d561f-50c0-4596-9d21-52079c14484e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:06:17 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-4f3f2a29-60c4-4d66-84a0-923e887ecf38 tempest-ProjectMemberTests-73815212 None] Acquiring lock "cinder-quobyte-ad7d561f-50c0-4596-9d21-52079c14484e" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:06:17 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-4f3f2a29-60c4-4d66-84a0-923e887ecf38 tempest-ProjectMemberTests-73815212 None] Lock "cinder-quobyte-ad7d561f-50c0-4596-9d21-52079c14484e" acquired by "delete_volume" :: waited 0.029s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:06:17 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aaefd3a-00f5-4dba-a986-a945cbaf8ab9]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:06:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4f3f2a29-60c4-4d66-84a0-923e887ecf38 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ad7d561f-50c0-4596-9d21-52079c14484e {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:17 devstack sudo[106880]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6c4f6312-e697-48bf-8e63-8ae9eeb38ad5 tempest-SnapshotDependencyTests-1378288582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e6dfe99b-30e0-4f49-81a3-9349e808381f.info" returned: 0 in 0.793s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6c4f6312-e697-48bf-8e63-8ae9eeb38ad5 tempest-SnapshotDependencyTests-1378288582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.470s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:06:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-fa973808-208a-48a2-a8ce-75679d9adc72 tempest-ProjectReaderTests-1433171142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.405s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:06:17 devstack sudo[106884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ad7d561f-50c0-4596-9d21-52079c14484e Jul 08 02:06:17 devstack sudo[106884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:17 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-fa973808-208a-48a2-a8ce-75679d9adc72 tempest-ProjectReaderTests-1433171142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1332273210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0a14e59-934b-4e85-90c7-abc3817c3131,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fc2f26950e54299bf8795cacc9d2942',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:06:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:06:14Z,use_quota=True,user_id='1cb60482c75048c4acbb493dacb58905',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:06:17 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-fa973808-208a-48a2-a8ce-75679d9adc72 tempest-ProjectReaderTests-1433171142 None] Creating volume e0a14e59-934b-4e85-90c7-abc3817c3131 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:06:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-fa973808-208a-48a2-a8ce-75679d9adc72 tempest-ProjectReaderTests-1433171142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:06:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-fa973808-208a-48a2-a8ce-75679d9adc72 tempest-ProjectReaderTests-1433171142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:06:17 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-fa973808-208a-48a2-a8ce-75679d9adc72 tempest-ProjectReaderTests-1433171142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:06:17 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-fa973808-208a-48a2-a8ce-75679d9adc72 tempest-ProjectReaderTests-1433171142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:06:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-fa973808-208a-48a2-a8ce-75679d9adc72 tempest-ProjectReaderTests-1433171142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:06:17 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-fa973808-208a-48a2-a8ce-75679d9adc72 tempest-ProjectReaderTests-1433171142 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:06:17 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-fa973808-208a-48a2-a8ce-75679d9adc72 tempest-ProjectReaderTests-1433171142 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 02:06:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-fa973808-208a-48a2-a8ce-75679d9adc72 tempest-ProjectReaderTests-1433171142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e0a14e59-934b-4e85-90c7-abc3817c3131 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:17 devstack sudo[106886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e0a14e59-934b-4e85-90c7-abc3817c3131 1073741824 Jul 08 02:06:17 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:17 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-6c4f6312-e697-48bf-8e63-8ae9eeb38ad5 tempest-SnapshotDependencyTests-1378288582 None] Create snapshot completed successfully Jul 08 02:06:18 devstack sudo[106884]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4f3f2a29-60c4-4d66-84a0-923e887ecf38 tempest-ProjectMemberTests-73815212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ad7d561f-50c0-4596-9d21-52079c14484e" returned: 0 in 0.963s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4f3f2a29-60c4-4d66-84a0-923e887ecf38 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ad7d561f-50c0-4596-9d21-52079c14484e {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:18 devstack sudo[106895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ad7d561f-50c0-4596-9d21-52079c14484e Jul 08 02:06:18 devstack sudo[106895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:18 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-137c0677-9d94-487e-8ce7-24c1a8d5c823 tempest-SnapshotDependencyTests-1378288582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:06:18 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:18 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-137c0677-9d94-487e-8ce7-24c1a8d5c823 tempest-SnapshotDependencyTests-1378288582 None] Flow 'volume_create_manager' (1ab68411-2c93-4833-9f49-2303217716fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:06:18 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-137c0677-9d94-487e-8ce7-24c1a8d5c823 tempest-SnapshotDependencyTests-1378288582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ee77fba-4e9a-4a9b-aee0-82d6d470bf32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:06:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-fa973808-208a-48a2-a8ce-75679d9adc72 tempest-ProjectReaderTests-1433171142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e0a14e59-934b-4e85-90c7-abc3817c3131 1073741824" returned: 0 in 1.164s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:18 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-137c0677-9d94-487e-8ce7-24c1a8d5c823 tempest-SnapshotDependencyTests-1378288582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ee77fba-4e9a-4a9b-aee0-82d6d470bf32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:06:18Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d908a316-9136-4609-8f67-46848eae9b2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='363a65ad3341466cba054bb14e906c15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:06:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c7dec992-fa0a-4918-bc99-9989ebbb59fd,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:06:19Z,use_quota=True,user_id='2e44a06a9d1b49089ce7fad57c06c8fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:06:18 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-137c0677-9d94-487e-8ce7-24c1a8d5c823 tempest-SnapshotDependencyTests-1378288582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19a37ed8-4d16-4b87-be15-81adc56e8a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:06:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-137c0677-9d94-487e-8ce7-24c1a8d5c823 tempest-SnapshotDependencyTests-1378288582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19a37ed8-4d16-4b87-be15-81adc56e8a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:06:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-137c0677-9d94-487e-8ce7-24c1a8d5c823 tempest-SnapshotDependencyTests-1378288582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28c35663-2340-49fe-a974-b923fe71255d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:06:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-137c0677-9d94-487e-8ce7-24c1a8d5c823 tempest-SnapshotDependencyTests-1378288582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28c35663-2340-49fe-a974-b923fe71255d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd908a316-9136-4609-8f67-46848eae9b2c', 'volume_name': 'volume-d908a316-9136-4609-8f67-46848eae9b2c', 'volume_size': 1, 'snapshot_id': 'c7dec992-fa0a-4918-bc99-9989ebbb59fd'}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:06:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-137c0677-9d94-487e-8ce7-24c1a8d5c823 tempest-SnapshotDependencyTests-1378288582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d96b89e8-e674-4ccf-bd98-9d87ca04c37e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:06:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-137c0677-9d94-487e-8ce7-24c1a8d5c823 tempest-SnapshotDependencyTests-1378288582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d96b89e8-e674-4ccf-bd98-9d87ca04c37e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:06:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-137c0677-9d94-487e-8ce7-24c1a8d5c823 tempest-SnapshotDependencyTests-1378288582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd480a9c-9956-49e7-a91c-429db511d60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:06:19 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-137c0677-9d94-487e-8ce7-24c1a8d5c823 tempest-SnapshotDependencyTests-1378288582 None] Volume d908a316-9136-4609-8f67-46848eae9b2c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d908a316-9136-4609-8f67-46848eae9b2c', 'volume_size': 1, 'snapshot_id': 'c7dec992-fa0a-4918-bc99-9989ebbb59fd'} Jul 08 02:06:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-137c0677-9d94-487e-8ce7-24c1a8d5c823 tempest-SnapshotDependencyTests-1378288582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:06:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-fa973808-208a-48a2-a8ce-75679d9adc72 tempest-ProjectReaderTests-1433171142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e0a14e59-934b-4e85-90c7-abc3817c3131 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:19 devstack sudo[106897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e0a14e59-934b-4e85-90c7-abc3817c3131 Jul 08 02:06:19 devstack sudo[106897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:19 devstack sudo[106895]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4f3f2a29-60c4-4d66-84a0-923e887ecf38 tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-ad7d561f-50c0-4596-9d21-52079c14484e" returned: 0 in 0.754s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:19 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-4f3f2a29-60c4-4d66-84a0-923e887ecf38 tempest-ProjectMemberTests-73815212 None] Lock "cinder-quobyte-ad7d561f-50c0-4596-9d21-52079c14484e" released by "delete_volume" :: held 1.788s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:06:19 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-4f3f2a29-60c4-4d66-84a0-923e887ecf38 tempest-ProjectMemberTests-73815212 None] Created reservations ['1b38fd75-90d2-42ab-a499-46a751403baa', '1de7810f-9785-41f3-b6c6-c949b4a63771', '6947fb4e-3fb1-4555-8a8a-9e883c71212b', 'c935a70f-2f9a-4377-b69c-1b1cb31c6df6'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:06:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-4f3f2a29-60c4-4d66-84a0-923e887ecf38 tempest-ProjectMemberTests-73815212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:06:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-4f3f2a29-60c4-4d66-84a0-923e887ecf38 tempest-ProjectMemberTests-73815212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:06:19 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-4f3f2a29-60c4-4d66-84a0-923e887ecf38 tempest-ProjectMemberTests-73815212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:06:19 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-4f3f2a29-60c4-4d66-84a0-923e887ecf38 tempest-ProjectMemberTests-73815212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:06:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-4f3f2a29-60c4-4d66-84a0-923e887ecf38 tempest-ProjectMemberTests-73815212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:06:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4f3f2a29-60c4-4d66-84a0-923e887ecf38 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:19 devstack sudo[106900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 02:06:19 devstack sudo[106900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:19 devstack sudo[106897]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-fa973808-208a-48a2-a8ce-75679d9adc72 tempest-ProjectReaderTests-1433171142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e0a14e59-934b-4e85-90c7-abc3817c3131" returned: 0 in 0.750s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:19 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-fa973808-208a-48a2-a8ce-75679d9adc72 tempest-ProjectReaderTests-1433171142 None] <== create_volume: return (2014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:06:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-fa973808-208a-48a2-a8ce-75679d9adc72 tempest-ProjectReaderTests-1433171142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.021s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:06:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-137c0677-9d94-487e-8ce7-24c1a8d5c823 tempest-SnapshotDependencyTests-1378288582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.779s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:06:19 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-137c0677-9d94-487e-8ce7-24c1a8d5c823 tempest-SnapshotDependencyTests-1378288582 None] Acquiring lock "cinder-quobyte-c7dec992-fa0a-4918-bc99-9989ebbb59fd-d908a316-9136-4609-8f67-46848eae9b2c" by "_create_volume_from_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:06:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-fa973808-208a-48a2-a8ce-75679d9adc72 tempest-ProjectReaderTests-1433171142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75071718-7bdf-4bae-b92a-40d15f06c5f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0a14e59-934b-4e85-90c7-abc3817c3131', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:06:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-fa973808-208a-48a2-a8ce-75679d9adc72 tempest-ProjectReaderTests-1433171142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6980a29d-4fe8-4802-b70a-a1a96ced2d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:06:19 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-137c0677-9d94-487e-8ce7-24c1a8d5c823 tempest-SnapshotDependencyTests-1378288582 None] Lock "cinder-quobyte-c7dec992-fa0a-4918-bc99-9989ebbb59fd-d908a316-9136-4609-8f67-46848eae9b2c" acquired by "_create_volume_from_snapshot" :: waited 0.054s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:06:19 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-137c0677-9d94-487e-8ce7-24c1a8d5c823 tempest-SnapshotDependencyTests-1378288582 None] Creating volume d908a316-9136-4609-8f67-46848eae9b2c from snapshot c7dec992-fa0a-4918-bc99-9989ebbb59fd {{(pid=87134) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 02:06:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-137c0677-9d94-487e-8ce7-24c1a8d5c823 tempest-SnapshotDependencyTests-1378288582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:06:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-137c0677-9d94-487e-8ce7-24c1a8d5c823 tempest-SnapshotDependencyTests-1378288582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:06:19 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-137c0677-9d94-487e-8ce7-24c1a8d5c823 tempest-SnapshotDependencyTests-1378288582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:06:19 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-137c0677-9d94-487e-8ce7-24c1a8d5c823 tempest-SnapshotDependencyTests-1378288582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:06:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-137c0677-9d94-487e-8ce7-24c1a8d5c823 tempest-SnapshotDependencyTests-1378288582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:06:19 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-137c0677-9d94-487e-8ce7-24c1a8d5c823 tempest-SnapshotDependencyTests-1378288582 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:06:19 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-137c0677-9d94-487e-8ce7-24c1a8d5c823 tempest-SnapshotDependencyTests-1378288582 None] Acquiring lock "cinder-quobyte-d908a316-9136-4609-8f67-46848eae9b2c" by "_copy_volume_from_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:06:19 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-fa973808-208a-48a2-a8ce-75679d9adc72 tempest-ProjectReaderTests-1433171142 None] Volume volume-e0a14e59-934b-4e85-90c7-abc3817c3131 (e0a14e59-934b-4e85-90c7-abc3817c3131): created successfully Jul 08 02:06:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-fa973808-208a-48a2-a8ce-75679d9adc72 tempest-ProjectReaderTests-1433171142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6980a29d-4fe8-4802-b70a-a1a96ced2d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:06:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-fa973808-208a-48a2-a8ce-75679d9adc72 tempest-ProjectReaderTests-1433171142 None] Flow 'volume_create_manager' (b25b0b51-fc6b-4dae-a2d3-ab692727a64c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:06:19 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-137c0677-9d94-487e-8ce7-24c1a8d5c823 tempest-SnapshotDependencyTests-1378288582 None] Lock "cinder-quobyte-d908a316-9136-4609-8f67-46848eae9b2c" acquired by "_copy_volume_from_snapshot" :: waited 0.047s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:06:19 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-137c0677-9d94-487e-8ce7-24c1a8d5c823 tempest-SnapshotDependencyTests-1378288582 None] snapshot: c7dec992-fa0a-4918-bc99-9989ebbb59fd, volume: d908a316-9136-4609-8f67-46848eae9b2c, {{(pid=87134) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 02:06:19 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-fa973808-208a-48a2-a8ce-75679d9adc72 tempest-ProjectReaderTests-1433171142 None] Created volume successfully. Jul 08 02:06:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-137c0677-9d94-487e-8ce7-24c1a8d5c823 tempest-SnapshotDependencyTests-1378288582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:06:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-137c0677-9d94-487e-8ce7-24c1a8d5c823 tempest-SnapshotDependencyTests-1378288582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:06:19 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-137c0677-9d94-487e-8ce7-24c1a8d5c823 tempest-SnapshotDependencyTests-1378288582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:06:20 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-137c0677-9d94-487e-8ce7-24c1a8d5c823 tempest-SnapshotDependencyTests-1378288582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:06:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-137c0677-9d94-487e-8ce7-24c1a8d5c823 tempest-SnapshotDependencyTests-1378288582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:06:20 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c1537b-3f06-4e3f-a79d-222f255dd37d]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:06:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-137c0677-9d94-487e-8ce7-24c1a8d5c823 tempest-SnapshotDependencyTests-1378288582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e6dfe99b-30e0-4f49-81a3-9349e808381f.c7dec992-fa0a-4918-bc99-9989ebbb59fd {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:20 devstack sudo[106903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e6dfe99b-30e0-4f49-81a3-9349e808381f.c7dec992-fa0a-4918-bc99-9989ebbb59fd Jul 08 02:06:20 devstack sudo[106903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:20 devstack sudo[106900]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4f3f2a29-60c4-4d66-84a0-923e887ecf38 tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.771s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:20 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-4f3f2a29-60c4-4d66-84a0-923e887ecf38 tempest-ProjectMemberTests-73815212 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:06:20 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-4f3f2a29-60c4-4d66-84a0-923e887ecf38 tempest-ProjectMemberTests-73815212 None] Deleted volume successfully. Jul 08 02:06:20 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-4f3f2a29-60c4-4d66-84a0-923e887ecf38 tempest-ProjectMemberTests-73815212 None] Lock "cinder-ad7d561f-50c0-4596-9d21-52079c14484e-delete_volume" released by "delete_volume" :: held 2.837s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:06:20 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb3cfb07-0b07-4a50-86d0-0c74e4a8e4fd tempest-ProjectMemberTests-73815212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:06:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-fb3cfb07-0b07-4a50-86d0-0c74e4a8e4fd tempest-ProjectMemberTests-73815212 None] Flow 'volume_create_manager' (1f67b422-6830-40dd-8a2f-48a3bfe24f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:06:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-fb3cfb07-0b07-4a50-86d0-0c74e4a8e4fd tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47064078-71b4-421d-8829-eaf9a7d2cdc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:06:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-fb3cfb07-0b07-4a50-86d0-0c74e4a8e4fd tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47064078-71b4-421d-8829-eaf9a7d2cdc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:06:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1608222321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b617c3eb-e109-478e-b500-2b49be5ded56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f353d90ed9694fe88617e9c4eed37bf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:06:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:06:20Z,use_quota=True,user_id='6137db3fdb294c84a17fd39e57e13785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:06:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-fb3cfb07-0b07-4a50-86d0-0c74e4a8e4fd tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b449c7b6-ca17-4b5d-bd85-8ce5bc4f2bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:06:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-fb3cfb07-0b07-4a50-86d0-0c74e4a8e4fd tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b449c7b6-ca17-4b5d-bd85-8ce5bc4f2bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:06:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-fb3cfb07-0b07-4a50-86d0-0c74e4a8e4fd tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89e25d36-2d47-493e-b91e-8f80a3798e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:06:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-fb3cfb07-0b07-4a50-86d0-0c74e4a8e4fd tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89e25d36-2d47-493e-b91e-8f80a3798e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b617c3eb-e109-478e-b500-2b49be5ded56', 'volume_name': 'volume-b617c3eb-e109-478e-b500-2b49be5ded56', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:06:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-fb3cfb07-0b07-4a50-86d0-0c74e4a8e4fd tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff4ec3a0-b903-4b38-ad26-0446ff6bd3e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:06:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-fb3cfb07-0b07-4a50-86d0-0c74e4a8e4fd tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff4ec3a0-b903-4b38-ad26-0446ff6bd3e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:06:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-fb3cfb07-0b07-4a50-86d0-0c74e4a8e4fd tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c18299b0-fadb-4259-92de-068370a83734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:06:20 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-fb3cfb07-0b07-4a50-86d0-0c74e4a8e4fd tempest-ProjectMemberTests-73815212 None] Volume b617c3eb-e109-478e-b500-2b49be5ded56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b617c3eb-e109-478e-b500-2b49be5ded56', 'volume_size': 1} Jul 08 02:06:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-fb3cfb07-0b07-4a50-86d0-0c74e4a8e4fd tempest-ProjectMemberTests-73815212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:06:20 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-9fe1c1dc-208e-41e1-877c-44df292fa895 tempest-ProjectReaderTests-1433171142 None] Acquiring lock "cinder-e0a14e59-934b-4e85-90c7-abc3817c3131-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:06:20 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-9fe1c1dc-208e-41e1-877c-44df292fa895 tempest-ProjectReaderTests-1433171142 None] Lock "cinder-e0a14e59-934b-4e85-90c7-abc3817c3131-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:06:20 devstack cinder-volume[87134]: DEBUG oslo_service.periodic_task [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87134) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 02:06:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:06:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:06:20 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:06:20 devstack sudo[106903]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:20 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:06:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:06:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-137c0677-9d94-487e-8ce7-24c1a8d5c823 tempest-SnapshotDependencyTests-1378288582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e6dfe99b-30e0-4f49-81a3-9349e808381f.c7dec992-fa0a-4918-bc99-9989ebbb59fd" returned: 0 in 0.935s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:20 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-137c0677-9d94-487e-8ce7-24c1a8d5c823 tempest-SnapshotDependencyTests-1378288582 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6dfe99b-30e0-4f49-81a3-9349e808381f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:06:20 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-137c0677-9d94-487e-8ce7-24c1a8d5c823 tempest-SnapshotDependencyTests-1378288582 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e6dfe99b-30e0-4f49-81a3-9349e808381f {{(pid=87134) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 02:06:20 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-137c0677-9d94-487e-8ce7-24c1a8d5c823 tempest-SnapshotDependencyTests-1378288582 None] Creating direct copy from snapshot {{(pid=87134) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 02:06:20 devstack sudo[106909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 02:06:20 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-9fe1c1dc-208e-41e1-877c-44df292fa895 tempest-ProjectReaderTests-1433171142 None] Acquiring lock "cinder-quobyte-e0a14e59-934b-4e85-90c7-abc3817c3131" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:06:20 devstack sudo[106909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:20 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cbdc5d3-efb1-48b9-bf49-23b667a4665e]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:06:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-137c0677-9d94-487e-8ce7-24c1a8d5c823 tempest-SnapshotDependencyTests-1378288582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e6dfe99b-30e0-4f49-81a3-9349e808381f {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:20 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-9fe1c1dc-208e-41e1-877c-44df292fa895 tempest-ProjectReaderTests-1433171142 None] Lock "cinder-quobyte-e0a14e59-934b-4e85-90c7-abc3817c3131" acquired by "delete_volume" :: waited 0.024s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:06:21 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[752520c3-33b6-400d-88e9-23a97619c9a7]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:06:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9fe1c1dc-208e-41e1-877c-44df292fa895 tempest-ProjectReaderTests-1433171142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e0a14e59-934b-4e85-90c7-abc3817c3131 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:21 devstack sudo[106911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e6dfe99b-30e0-4f49-81a3-9349e808381f Jul 08 02:06:21 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:21 devstack sudo[106912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e0a14e59-934b-4e85-90c7-abc3817c3131 Jul 08 02:06:21 devstack sudo[106912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:21 devstack sudo[106909]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.713s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:21 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:06:21 devstack cinder-volume[87134]: DEBUG oslo_service.periodic_task [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running periodic task VolumeManager._thread_info {{(pid=87134) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 02:06:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] thread count: 28 {{(pid=87134) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 02:06:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] thread info: [<_MainThread(MainThread, started 129378964615296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87134) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 02:06:21 devstack sudo[106912]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9fe1c1dc-208e-41e1-877c-44df292fa895 tempest-ProjectReaderTests-1433171142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e0a14e59-934b-4e85-90c7-abc3817c3131" returned: 0 in 0.889s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9fe1c1dc-208e-41e1-877c-44df292fa895 tempest-ProjectReaderTests-1433171142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e0a14e59-934b-4e85-90c7-abc3817c3131 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:21 devstack sudo[106922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e0a14e59-934b-4e85-90c7-abc3817c3131 Jul 08 02:06:21 devstack sudo[106922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:21 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-137c0677-9d94-487e-8ce7-24c1a8d5c823 tempest-SnapshotDependencyTests-1378288582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e6dfe99b-30e0-4f49-81a3-9349e808381f" returned: 0 in 1.006s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:21 devstack cinder-volume[87134]: DEBUG cinder.utils [None req-137c0677-9d94-487e-8ce7-24c1a8d5c823 tempest-SnapshotDependencyTests-1378288582 None] Path /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d908a316-9136-4609-8f67-46848eae9b2c not found in is_blk_device check {{(pid=87134) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 02:06:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-137c0677-9d94-487e-8ce7-24c1a8d5c823 tempest-SnapshotDependencyTests-1378288582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e6dfe99b-30e0-4f49-81a3-9349e808381f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d908a316-9136-4609-8f67-46848eae9b2c {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:22 devstack sudo[106924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e6dfe99b-30e0-4f49-81a3-9349e808381f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d908a316-9136-4609-8f67-46848eae9b2c Jul 08 02:06:22 devstack sudo[106924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:22 devstack sudo[106922]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9fe1c1dc-208e-41e1-877c-44df292fa895 tempest-ProjectReaderTests-1433171142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e0a14e59-934b-4e85-90c7-abc3817c3131" returned: 0 in 0.709s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:22 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-9fe1c1dc-208e-41e1-877c-44df292fa895 tempest-ProjectReaderTests-1433171142 None] Lock "cinder-quobyte-e0a14e59-934b-4e85-90c7-abc3817c3131" released by "delete_volume" :: held 1.646s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:06:22 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-9fe1c1dc-208e-41e1-877c-44df292fa895 tempest-ProjectReaderTests-1433171142 None] Created reservations ['950cf954-564b-4c9e-9a05-6f43c0a6f40c', '4670142e-97d1-48d0-b874-036402c0b399', 'bd324207-dbce-4ebb-b372-a7c2e6fa9898', '7d7b4da0-0e99-4fdf-b272-ec7ec4328a0f'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:06:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-9fe1c1dc-208e-41e1-877c-44df292fa895 tempest-ProjectReaderTests-1433171142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:06:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-9fe1c1dc-208e-41e1-877c-44df292fa895 tempest-ProjectReaderTests-1433171142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:06:22 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-9fe1c1dc-208e-41e1-877c-44df292fa895 tempest-ProjectReaderTests-1433171142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:06:22 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-9fe1c1dc-208e-41e1-877c-44df292fa895 tempest-ProjectReaderTests-1433171142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:06:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-9fe1c1dc-208e-41e1-877c-44df292fa895 tempest-ProjectReaderTests-1433171142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:06:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9fe1c1dc-208e-41e1-877c-44df292fa895 tempest-ProjectReaderTests-1433171142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:22 devstack sudo[106931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 02:06:22 devstack sudo[106931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:24 devstack sudo[106931]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9fe1c1dc-208e-41e1-877c-44df292fa895 tempest-ProjectReaderTests-1433171142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 1.816s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:24 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-9fe1c1dc-208e-41e1-877c-44df292fa895 tempest-ProjectReaderTests-1433171142 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:06:24 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-9fe1c1dc-208e-41e1-877c-44df292fa895 tempest-ProjectReaderTests-1433171142 None] Deleted volume successfully. Jul 08 02:06:24 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-78d777f9-efeb-4ef9-9033-3c0002ac8014 tempest-ProjectReaderTests-1433171142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:06:24 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-78d777f9-efeb-4ef9-9033-3c0002ac8014 tempest-ProjectReaderTests-1433171142 None] Flow 'volume_create_manager' (ae5fdbab-d626-41dd-b755-56e046d47e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:06:24 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-78d777f9-efeb-4ef9-9033-3c0002ac8014 tempest-ProjectReaderTests-1433171142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11b5909c-b373-4ce4-a502-6079180c8088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:06:24 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-9fe1c1dc-208e-41e1-877c-44df292fa895 tempest-ProjectReaderTests-1433171142 None] Lock "cinder-e0a14e59-934b-4e85-90c7-abc3817c3131-delete_volume" released by "delete_volume" :: held 3.944s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:06:24 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-78d777f9-efeb-4ef9-9033-3c0002ac8014 tempest-ProjectReaderTests-1433171142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11b5909c-b373-4ce4-a502-6079180c8088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:06:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-141314013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0582af3b-01e5-4205-a1a6-115fc141181e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fc2f26950e54299bf8795cacc9d2942',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:06:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:06:25Z,use_quota=True,user_id='1cb60482c75048c4acbb493dacb58905',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:06:24 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-78d777f9-efeb-4ef9-9033-3c0002ac8014 tempest-ProjectReaderTests-1433171142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abd1ec14-f020-423e-8a6a-eaafe7021ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:06:24 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-78d777f9-efeb-4ef9-9033-3c0002ac8014 tempest-ProjectReaderTests-1433171142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abd1ec14-f020-423e-8a6a-eaafe7021ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:06:24 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-78d777f9-efeb-4ef9-9033-3c0002ac8014 tempest-ProjectReaderTests-1433171142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22761dfd-f4cd-4ccd-8987-e6d571a36d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:06:24 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-78d777f9-efeb-4ef9-9033-3c0002ac8014 tempest-ProjectReaderTests-1433171142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22761dfd-f4cd-4ccd-8987-e6d571a36d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0582af3b-01e5-4205-a1a6-115fc141181e', 'volume_name': 'volume-0582af3b-01e5-4205-a1a6-115fc141181e', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:06:24 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-78d777f9-efeb-4ef9-9033-3c0002ac8014 tempest-ProjectReaderTests-1433171142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b67b401-87b6-43de-948d-c53def39adcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:06:24 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-78d777f9-efeb-4ef9-9033-3c0002ac8014 tempest-ProjectReaderTests-1433171142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b67b401-87b6-43de-948d-c53def39adcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:06:24 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-78d777f9-efeb-4ef9-9033-3c0002ac8014 tempest-ProjectReaderTests-1433171142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (612b2424-3d06-47c4-b939-6641b463c9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:06:24 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-78d777f9-efeb-4ef9-9033-3c0002ac8014 tempest-ProjectReaderTests-1433171142 None] Volume 0582af3b-01e5-4205-a1a6-115fc141181e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0582af3b-01e5-4205-a1a6-115fc141181e', 'volume_size': 1} Jul 08 02:06:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-78d777f9-efeb-4ef9-9033-3c0002ac8014 tempest-ProjectReaderTests-1433171142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:06:27 devstack sudo[106924]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:27 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-137c0677-9d94-487e-8ce7-24c1a8d5c823 tempest-SnapshotDependencyTests-1378288582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e6dfe99b-30e0-4f49-81a3-9349e808381f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d908a316-9136-4609-8f67-46848eae9b2c" returned: 0 in 5.349s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:27 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b6bc5e0-c355-4aa0-bb56-982c51bd899e]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:06:27 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-137c0677-9d94-487e-8ce7-24c1a8d5c823 tempest-SnapshotDependencyTests-1378288582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e6dfe99b-30e0-4f49-81a3-9349e808381f {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:27 devstack sudo[106941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e6dfe99b-30e0-4f49-81a3-9349e808381f Jul 08 02:06:27 devstack sudo[106941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:28 devstack sudo[106941]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:28 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-137c0677-9d94-487e-8ce7-24c1a8d5c823 tempest-SnapshotDependencyTests-1378288582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e6dfe99b-30e0-4f49-81a3-9349e808381f" returned: 0 in 0.970s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:28 devstack cinder-volume[87134]: DEBUG cinder.image.image_utils [None req-137c0677-9d94-487e-8ce7-24c1a8d5c823 tempest-SnapshotDependencyTests-1378288582 None] Image conversion details: src /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e6dfe99b-30e0-4f49-81a3-9349e808381f, size 1024.00 MB, duration 5.35 sec, destination /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d908a316-9136-4609-8f67-46848eae9b2c {{(pid=87134) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 02:06:28 devstack cinder-volume[87134]: INFO cinder.image.image_utils [None req-137c0677-9d94-487e-8ce7-24c1a8d5c823 tempest-SnapshotDependencyTests-1378288582 None] Converted 1024.00 MB image at 191.41 MB/s Jul 08 02:06:28 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-137c0677-9d94-487e-8ce7-24c1a8d5c823 tempest-SnapshotDependencyTests-1378288582 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d908a316-9136-4609-8f67-46848eae9b2c is being set with open permissions: ugo+rw Jul 08 02:06:28 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-137c0677-9d94-487e-8ce7-24c1a8d5c823 tempest-SnapshotDependencyTests-1378288582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d908a316-9136-4609-8f67-46848eae9b2c {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:28 devstack sudo[106946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d908a316-9136-4609-8f67-46848eae9b2c Jul 08 02:06:28 devstack sudo[106946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:29 devstack sudo[106946]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-137c0677-9d94-487e-8ce7-24c1a8d5c823 tempest-SnapshotDependencyTests-1378288582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d908a316-9136-4609-8f67-46848eae9b2c" returned: 0 in 0.722s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:29 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-137c0677-9d94-487e-8ce7-24c1a8d5c823 tempest-SnapshotDependencyTests-1378288582 None] Lock "cinder-quobyte-d908a316-9136-4609-8f67-46848eae9b2c" released by "_copy_volume_from_snapshot" :: held 9.126s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:06:29 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-137c0677-9d94-487e-8ce7-24c1a8d5c823 tempest-SnapshotDependencyTests-1378288582 None] Lock "cinder-quobyte-c7dec992-fa0a-4918-bc99-9989ebbb59fd-d908a316-9136-4609-8f67-46848eae9b2c" released by "_create_volume_from_snapshot" :: held 9.194s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:06:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-137c0677-9d94-487e-8ce7-24c1a8d5c823 tempest-SnapshotDependencyTests-1378288582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.250s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:06:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-fb3cfb07-0b07-4a50-86d0-0c74e4a8e4fd tempest-ProjectMemberTests-73815212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.549s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:06:29 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-fb3cfb07-0b07-4a50-86d0-0c74e4a8e4fd tempest-ProjectMemberTests-73815212 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:06:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1608222321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b617c3eb-e109-478e-b500-2b49be5ded56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f353d90ed9694fe88617e9c4eed37bf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:06:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:06:20Z,use_quota=True,user_id='6137db3fdb294c84a17fd39e57e13785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:06:29 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-fb3cfb07-0b07-4a50-86d0-0c74e4a8e4fd tempest-ProjectMemberTests-73815212 None] Creating volume b617c3eb-e109-478e-b500-2b49be5ded56 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:06:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-fb3cfb07-0b07-4a50-86d0-0c74e4a8e4fd tempest-ProjectMemberTests-73815212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:06:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-fb3cfb07-0b07-4a50-86d0-0c74e4a8e4fd tempest-ProjectMemberTests-73815212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:06:29 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-fb3cfb07-0b07-4a50-86d0-0c74e4a8e4fd tempest-ProjectMemberTests-73815212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:06:29 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-fb3cfb07-0b07-4a50-86d0-0c74e4a8e4fd tempest-ProjectMemberTests-73815212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:06:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-fb3cfb07-0b07-4a50-86d0-0c74e4a8e4fd tempest-ProjectMemberTests-73815212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:06:29 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-fb3cfb07-0b07-4a50-86d0-0c74e4a8e4fd tempest-ProjectMemberTests-73815212 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:06:29 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-fb3cfb07-0b07-4a50-86d0-0c74e4a8e4fd tempest-ProjectMemberTests-73815212 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 02:06:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-fb3cfb07-0b07-4a50-86d0-0c74e4a8e4fd tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b617c3eb-e109-478e-b500-2b49be5ded56 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:29 devstack sudo[106949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b617c3eb-e109-478e-b500-2b49be5ded56 1073741824 Jul 08 02:06:29 devstack sudo[106949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:29 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-137c0677-9d94-487e-8ce7-24c1a8d5c823 tempest-SnapshotDependencyTests-1378288582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd480a9c-9956-49e7-a91c-429db511d60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d908a316-9136-4609-8f67-46848eae9b2c', 'volume_size': 1, 'snapshot_id': 'c7dec992-fa0a-4918-bc99-9989ebbb59fd'}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:06:29 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-137c0677-9d94-487e-8ce7-24c1a8d5c823 tempest-SnapshotDependencyTests-1378288582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac5d69ca-de77-424a-8092-2477c5811bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:06:29 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-137c0677-9d94-487e-8ce7-24c1a8d5c823 tempest-SnapshotDependencyTests-1378288582 None] Volume volume-d908a316-9136-4609-8f67-46848eae9b2c (d908a316-9136-4609-8f67-46848eae9b2c): created successfully Jul 08 02:06:29 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-137c0677-9d94-487e-8ce7-24c1a8d5c823 tempest-SnapshotDependencyTests-1378288582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac5d69ca-de77-424a-8092-2477c5811bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:06:29 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-137c0677-9d94-487e-8ce7-24c1a8d5c823 tempest-SnapshotDependencyTests-1378288582 None] Flow 'volume_create_manager' (1ab68411-2c93-4833-9f49-2303217716fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:06:29 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-137c0677-9d94-487e-8ce7-24c1a8d5c823 tempest-SnapshotDependencyTests-1378288582 None] Created volume successfully. Jul 08 02:06:30 devstack sudo[106949]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-fb3cfb07-0b07-4a50-86d0-0c74e4a8e4fd tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b617c3eb-e109-478e-b500-2b49be5ded56 1073741824" returned: 0 in 0.978s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:30 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-d66d650e-c7bf-4554-85c0-5cf8f345c7d4 tempest-SnapshotDependencyTests-1378288582 None] Acquiring lock "cinder-c7dec992-fa0a-4918-bc99-9989ebbb59fd-delete_snapshot" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:06:30 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-d66d650e-c7bf-4554-85c0-5cf8f345c7d4 tempest-SnapshotDependencyTests-1378288582 None] Lock "cinder-c7dec992-fa0a-4918-bc99-9989ebbb59fd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:06:30 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-d66d650e-c7bf-4554-85c0-5cf8f345c7d4 tempest-SnapshotDependencyTests-1378288582 None] Acquiring lock "cinder-quobyte-e6dfe99b-30e0-4f49-81a3-9349e808381f" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:06:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-fb3cfb07-0b07-4a50-86d0-0c74e4a8e4fd tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b617c3eb-e109-478e-b500-2b49be5ded56 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:30 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-d66d650e-c7bf-4554-85c0-5cf8f345c7d4 tempest-SnapshotDependencyTests-1378288582 None] Lock "cinder-quobyte-e6dfe99b-30e0-4f49-81a3-9349e808381f" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:06:30 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-d66d650e-c7bf-4554-85c0-5cf8f345c7d4 tempest-SnapshotDependencyTests-1378288582 None] Acquiring lock "cinder-quobyte-c7dec992-fa0a-4918-bc99-9989ebbb59fd" by "_delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:06:30 devstack sudo[106955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b617c3eb-e109-478e-b500-2b49be5ded56 Jul 08 02:06:30 devstack sudo[106955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:30 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-d66d650e-c7bf-4554-85c0-5cf8f345c7d4 tempest-SnapshotDependencyTests-1378288582 None] Lock "cinder-quobyte-c7dec992-fa0a-4918-bc99-9989ebbb59fd" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:06:30 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-d66d650e-c7bf-4554-85c0-5cf8f345c7d4 tempest-SnapshotDependencyTests-1378288582 None] Deleting offline snapshot c7dec992-fa0a-4918-bc99-9989ebbb59fd of volume e6dfe99b-30e0-4f49-81a3-9349e808381f {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 02:06:30 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-d66d650e-c7bf-4554-85c0-5cf8f345c7d4 tempest-SnapshotDependencyTests-1378288582 None] snapshot_file for this snap is: volume-e6dfe99b-30e0-4f49-81a3-9349e808381f.c7dec992-fa0a-4918-bc99-9989ebbb59fd {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 02:06:30 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ad1737-9ab3-410d-b683-c88fa4d851ac]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:06:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d66d650e-c7bf-4554-85c0-5cf8f345c7d4 tempest-SnapshotDependencyTests-1378288582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e6dfe99b-30e0-4f49-81a3-9349e808381f.c7dec992-fa0a-4918-bc99-9989ebbb59fd {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:30 devstack sudo[106957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e6dfe99b-30e0-4f49-81a3-9349e808381f.c7dec992-fa0a-4918-bc99-9989ebbb59fd Jul 08 02:06:30 devstack sudo[106957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:30 devstack sudo[106955]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-fb3cfb07-0b07-4a50-86d0-0c74e4a8e4fd tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b617c3eb-e109-478e-b500-2b49be5ded56" returned: 0 in 0.742s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:30 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-fb3cfb07-0b07-4a50-86d0-0c74e4a8e4fd tempest-ProjectMemberTests-73815212 None] <== create_volume: return (1796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:06:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-fb3cfb07-0b07-4a50-86d0-0c74e4a8e4fd tempest-ProjectMemberTests-73815212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.799s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:06:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-78d777f9-efeb-4ef9-9033-3c0002ac8014 tempest-ProjectReaderTests-1433171142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.934s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:06:30 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-78d777f9-efeb-4ef9-9033-3c0002ac8014 tempest-ProjectReaderTests-1433171142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:06:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-141314013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0582af3b-01e5-4205-a1a6-115fc141181e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fc2f26950e54299bf8795cacc9d2942',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:06:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:06:25Z,use_quota=True,user_id='1cb60482c75048c4acbb493dacb58905',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:06:30 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-78d777f9-efeb-4ef9-9033-3c0002ac8014 tempest-ProjectReaderTests-1433171142 None] Creating volume 0582af3b-01e5-4205-a1a6-115fc141181e {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:06:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-78d777f9-efeb-4ef9-9033-3c0002ac8014 tempest-ProjectReaderTests-1433171142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:06:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-78d777f9-efeb-4ef9-9033-3c0002ac8014 tempest-ProjectReaderTests-1433171142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:06:30 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-78d777f9-efeb-4ef9-9033-3c0002ac8014 tempest-ProjectReaderTests-1433171142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:06:30 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-78d777f9-efeb-4ef9-9033-3c0002ac8014 tempest-ProjectReaderTests-1433171142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:06:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-78d777f9-efeb-4ef9-9033-3c0002ac8014 tempest-ProjectReaderTests-1433171142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:06:30 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-78d777f9-efeb-4ef9-9033-3c0002ac8014 tempest-ProjectReaderTests-1433171142 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:06:30 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-78d777f9-efeb-4ef9-9033-3c0002ac8014 tempest-ProjectReaderTests-1433171142 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 02:06:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-78d777f9-efeb-4ef9-9033-3c0002ac8014 tempest-ProjectReaderTests-1433171142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0582af3b-01e5-4205-a1a6-115fc141181e 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:30 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-fb3cfb07-0b07-4a50-86d0-0c74e4a8e4fd tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c18299b0-fadb-4259-92de-068370a83734) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b617c3eb-e109-478e-b500-2b49be5ded56', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:06:30 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-fb3cfb07-0b07-4a50-86d0-0c74e4a8e4fd tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (760e5493-deea-465d-b529-b0863f7228d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:06:30 devstack sudo[106961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0582af3b-01e5-4205-a1a6-115fc141181e 1073741824 Jul 08 02:06:30 devstack sudo[106961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:30 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-fb3cfb07-0b07-4a50-86d0-0c74e4a8e4fd tempest-ProjectMemberTests-73815212 None] Volume volume-b617c3eb-e109-478e-b500-2b49be5ded56 (b617c3eb-e109-478e-b500-2b49be5ded56): created successfully Jul 08 02:06:30 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-fb3cfb07-0b07-4a50-86d0-0c74e4a8e4fd tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (760e5493-deea-465d-b529-b0863f7228d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:06:30 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-fb3cfb07-0b07-4a50-86d0-0c74e4a8e4fd tempest-ProjectMemberTests-73815212 None] Flow 'volume_create_manager' (1f67b422-6830-40dd-8a2f-48a3bfe24f13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:06:30 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-fb3cfb07-0b07-4a50-86d0-0c74e4a8e4fd tempest-ProjectMemberTests-73815212 None] Created volume successfully. Jul 08 02:06:31 devstack sudo[106957]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d66d650e-c7bf-4554-85c0-5cf8f345c7d4 tempest-SnapshotDependencyTests-1378288582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e6dfe99b-30e0-4f49-81a3-9349e808381f.c7dec992-fa0a-4918-bc99-9989ebbb59fd" returned: 0 in 0.910s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:31 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-d66d650e-c7bf-4554-85c0-5cf8f345c7d4 tempest-SnapshotDependencyTests-1378288582 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6dfe99b-30e0-4f49-81a3-9349e808381f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:06:31 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[4256b0e2-c4b7-4d67-986b-007cc8963d54]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:06:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d66d650e-c7bf-4554-85c0-5cf8f345c7d4 tempest-SnapshotDependencyTests-1378288582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e6dfe99b-30e0-4f49-81a3-9349e808381f {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:31 devstack sudo[106965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e6dfe99b-30e0-4f49-81a3-9349e808381f Jul 08 02:06:31 devstack sudo[106965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e9306c43-ffca-48b0-b7d7-91b51c0b8bd7 tempest-ProjectMemberTests-73815212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:06:31 devstack sudo[106961]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-78d777f9-efeb-4ef9-9033-3c0002ac8014 tempest-ProjectReaderTests-1433171142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0582af3b-01e5-4205-a1a6-115fc141181e 1073741824" returned: 0 in 1.044s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-78d777f9-efeb-4ef9-9033-3c0002ac8014 tempest-ProjectReaderTests-1433171142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0582af3b-01e5-4205-a1a6-115fc141181e {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:32 devstack sudo[106974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0582af3b-01e5-4205-a1a6-115fc141181e Jul 08 02:06:32 devstack sudo[106974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:32 devstack sudo[106965]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d66d650e-c7bf-4554-85c0-5cf8f345c7d4 tempest-SnapshotDependencyTests-1378288582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e6dfe99b-30e0-4f49-81a3-9349e808381f" returned: 0 in 1.013s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d66d650e-c7bf-4554-85c0-5cf8f345c7d4 tempest-SnapshotDependencyTests-1378288582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e6dfe99b-30e0-4f49-81a3-9349e808381f.c7dec992-fa0a-4918-bc99-9989ebbb59fd {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:32 devstack sudo[106982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e6dfe99b-30e0-4f49-81a3-9349e808381f.c7dec992-fa0a-4918-bc99-9989ebbb59fd Jul 08 02:06:32 devstack sudo[106982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:32 devstack sudo[106974]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-78d777f9-efeb-4ef9-9033-3c0002ac8014 tempest-ProjectReaderTests-1433171142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0582af3b-01e5-4205-a1a6-115fc141181e" returned: 0 in 0.745s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:32 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-78d777f9-efeb-4ef9-9033-3c0002ac8014 tempest-ProjectReaderTests-1433171142 None] <== create_volume: return (1838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:06:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-78d777f9-efeb-4ef9-9033-3c0002ac8014 tempest-ProjectReaderTests-1433171142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.845s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:06:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e9306c43-ffca-48b0-b7d7-91b51c0b8bd7 tempest-ProjectMemberTests-73815212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.927s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:06:32 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-78d777f9-efeb-4ef9-9033-3c0002ac8014 tempest-ProjectReaderTests-1433171142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (612b2424-3d06-47c4-b939-6641b463c9d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0582af3b-01e5-4205-a1a6-115fc141181e', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:06:32 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-78d777f9-efeb-4ef9-9033-3c0002ac8014 tempest-ProjectReaderTests-1433171142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8be273e6-b3f9-4e63-9da4-81cf3095c740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:06:32 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-e9306c43-ffca-48b0-b7d7-91b51c0b8bd7 tempest-ProjectMemberTests-73815212 None] Creating offline snapshot 6aa846d8-5cda-4e16-bb71-772b11881925 of volume b617c3eb-e109-478e-b500-2b49be5ded56 {{(pid=87134) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 02:06:32 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-78d777f9-efeb-4ef9-9033-3c0002ac8014 tempest-ProjectReaderTests-1433171142 None] Volume volume-0582af3b-01e5-4205-a1a6-115fc141181e (0582af3b-01e5-4205-a1a6-115fc141181e): created successfully Jul 08 02:06:32 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-78d777f9-efeb-4ef9-9033-3c0002ac8014 tempest-ProjectReaderTests-1433171142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8be273e6-b3f9-4e63-9da4-81cf3095c740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:06:32 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-78d777f9-efeb-4ef9-9033-3c0002ac8014 tempest-ProjectReaderTests-1433171142 None] Flow 'volume_create_manager' (ae5fdbab-d626-41dd-b755-56e046d47e08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:06:32 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed226cc-c4b5-4b94-8cdf-c8f7bd297afc]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:06:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e9306c43-ffca-48b0-b7d7-91b51c0b8bd7 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b617c3eb-e109-478e-b500-2b49be5ded56 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:32 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-78d777f9-efeb-4ef9-9033-3c0002ac8014 tempest-ProjectReaderTests-1433171142 None] Created volume successfully. Jul 08 02:06:32 devstack sudo[106988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b617c3eb-e109-478e-b500-2b49be5ded56 Jul 08 02:06:32 devstack sudo[106988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:32 devstack sudo[106982]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d66d650e-c7bf-4554-85c0-5cf8f345c7d4 tempest-SnapshotDependencyTests-1378288582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e6dfe99b-30e0-4f49-81a3-9349e808381f.c7dec992-fa0a-4918-bc99-9989ebbb59fd" returned: 0 in 0.822s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d66d650e-c7bf-4554-85c0-5cf8f345c7d4 tempest-SnapshotDependencyTests-1378288582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e6dfe99b-30e0-4f49-81a3-9349e808381f.c7dec992-fa0a-4918-bc99-9989ebbb59fd {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:33 devstack sudo[106991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e6dfe99b-30e0-4f49-81a3-9349e808381f.c7dec992-fa0a-4918-bc99-9989ebbb59fd Jul 08 02:06:33 devstack sudo[106991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:33 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-bbc58500-e5b9-4017-b589-732497d51c24 tempest-ProjectReaderTests-1433171142 None] Acquiring lock "cinder-0582af3b-01e5-4205-a1a6-115fc141181e-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:06:33 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-bbc58500-e5b9-4017-b589-732497d51c24 tempest-ProjectReaderTests-1433171142 None] Lock "cinder-0582af3b-01e5-4205-a1a6-115fc141181e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:06:33 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-bbc58500-e5b9-4017-b589-732497d51c24 tempest-ProjectReaderTests-1433171142 None] Acquiring lock "cinder-quobyte-0582af3b-01e5-4205-a1a6-115fc141181e" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:06:33 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-bbc58500-e5b9-4017-b589-732497d51c24 tempest-ProjectReaderTests-1433171142 None] Lock "cinder-quobyte-0582af3b-01e5-4205-a1a6-115fc141181e" acquired by "delete_volume" :: waited 0.021s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:06:33 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd9bd1e-1138-4217-8179-c935a6b2d140]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:06:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-bbc58500-e5b9-4017-b589-732497d51c24 tempest-ProjectReaderTests-1433171142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0582af3b-01e5-4205-a1a6-115fc141181e {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:33 devstack sudo[106994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0582af3b-01e5-4205-a1a6-115fc141181e Jul 08 02:06:33 devstack sudo[106994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:33 devstack sudo[106988]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e9306c43-ffca-48b0-b7d7-91b51c0b8bd7 tempest-ProjectMemberTests-73815212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b617c3eb-e109-478e-b500-2b49be5ded56" returned: 0 in 0.978s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e9306c43-ffca-48b0-b7d7-91b51c0b8bd7 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b617c3eb-e109-478e-b500-2b49be5ded56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b617c3eb-e109-478e-b500-2b49be5ded56.6aa846d8-5cda-4e16-bb71-772b11881925 1G {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:33 devstack sudo[107000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b617c3eb-e109-478e-b500-2b49be5ded56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b617c3eb-e109-478e-b500-2b49be5ded56.6aa846d8-5cda-4e16-bb71-772b11881925 1G Jul 08 02:06:33 devstack sudo[107000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:33 devstack sudo[106991]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d66d650e-c7bf-4554-85c0-5cf8f345c7d4 tempest-SnapshotDependencyTests-1378288582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e6dfe99b-30e0-4f49-81a3-9349e808381f.c7dec992-fa0a-4918-bc99-9989ebbb59fd" returned: 0 in 0.862s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:33 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-d66d650e-c7bf-4554-85c0-5cf8f345c7d4 tempest-SnapshotDependencyTests-1378288582 None] Lock "cinder-quobyte-c7dec992-fa0a-4918-bc99-9989ebbb59fd" released by "_delete_snapshot" :: held 3.719s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:06:33 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-d66d650e-c7bf-4554-85c0-5cf8f345c7d4 tempest-SnapshotDependencyTests-1378288582 None] Lock "cinder-quobyte-e6dfe99b-30e0-4f49-81a3-9349e808381f" released by "delete_snapshot" :: held 3.746s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:06:33 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-d66d650e-c7bf-4554-85c0-5cf8f345c7d4 tempest-SnapshotDependencyTests-1378288582 None] Created reservations ['8e9d4f8c-2534-4c7f-8f6e-833284ae33f2', '14bfcec3-ec79-4686-9ca2-09542c680e34', '5506bec2-86c2-4ae8-a0df-c4210379ddf7', '58d2fc84-a72c-40f3-9cbf-cb6e43a7df51'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:06:34 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-d66d650e-c7bf-4554-85c0-5cf8f345c7d4 tempest-SnapshotDependencyTests-1378288582 None] Delete snapshot completed successfully. Jul 08 02:06:34 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-d66d650e-c7bf-4554-85c0-5cf8f345c7d4 tempest-SnapshotDependencyTests-1378288582 None] Lock "cinder-c7dec992-fa0a-4918-bc99-9989ebbb59fd-delete_snapshot" released by "delete_snapshot" :: held 3.910s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:06:34 devstack sudo[106994]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-bbc58500-e5b9-4017-b589-732497d51c24 tempest-ProjectReaderTests-1433171142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0582af3b-01e5-4205-a1a6-115fc141181e" returned: 0 in 0.860s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-bbc58500-e5b9-4017-b589-732497d51c24 tempest-ProjectReaderTests-1433171142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0582af3b-01e5-4205-a1a6-115fc141181e {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:34 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-38a5d34d-3edd-4c5e-a85a-a437a836f2b8 tempest-SnapshotDependencyTests-1378288582 None] Acquiring lock "cinder-e6dfe99b-30e0-4f49-81a3-9349e808381f-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:06:34 devstack sudo[107007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0582af3b-01e5-4205-a1a6-115fc141181e Jul 08 02:06:34 devstack sudo[107007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:34 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-38a5d34d-3edd-4c5e-a85a-a437a836f2b8 tempest-SnapshotDependencyTests-1378288582 None] Lock "cinder-e6dfe99b-30e0-4f49-81a3-9349e808381f-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:06:34 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-38a5d34d-3edd-4c5e-a85a-a437a836f2b8 tempest-SnapshotDependencyTests-1378288582 None] Acquiring lock "cinder-quobyte-e6dfe99b-30e0-4f49-81a3-9349e808381f" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:06:34 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-38a5d34d-3edd-4c5e-a85a-a437a836f2b8 tempest-SnapshotDependencyTests-1378288582 None] Lock "cinder-quobyte-e6dfe99b-30e0-4f49-81a3-9349e808381f" acquired by "delete_volume" :: waited 0.026s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:06:34 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d20374-1d11-4436-b06f-bbaa97e2b54a]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:06:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-38a5d34d-3edd-4c5e-a85a-a437a836f2b8 tempest-SnapshotDependencyTests-1378288582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e6dfe99b-30e0-4f49-81a3-9349e808381f {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:34 devstack sudo[107010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e6dfe99b-30e0-4f49-81a3-9349e808381f Jul 08 02:06:34 devstack sudo[107010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:34 devstack sudo[107000]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e9306c43-ffca-48b0-b7d7-91b51c0b8bd7 tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b617c3eb-e109-478e-b500-2b49be5ded56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b617c3eb-e109-478e-b500-2b49be5ded56.6aa846d8-5cda-4e16-bb71-772b11881925 1G" returned: 0 in 1.008s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e9306c43-ffca-48b0-b7d7-91b51c0b8bd7 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b617c3eb-e109-478e-b500-2b49be5ded56 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b617c3eb-e109-478e-b500-2b49be5ded56.6aa846d8-5cda-4e16-bb71-772b11881925 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:34 devstack sudo[107013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b617c3eb-e109-478e-b500-2b49be5ded56 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b617c3eb-e109-478e-b500-2b49be5ded56.6aa846d8-5cda-4e16-bb71-772b11881925 Jul 08 02:06:34 devstack sudo[107013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:35 devstack sudo[107007]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-bbc58500-e5b9-4017-b589-732497d51c24 tempest-ProjectReaderTests-1433171142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-0582af3b-01e5-4205-a1a6-115fc141181e" returned: 0 in 0.872s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:35 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-bbc58500-e5b9-4017-b589-732497d51c24 tempest-ProjectReaderTests-1433171142 None] Lock "cinder-quobyte-0582af3b-01e5-4205-a1a6-115fc141181e" released by "delete_volume" :: held 1.796s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:06:35 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-bbc58500-e5b9-4017-b589-732497d51c24 tempest-ProjectReaderTests-1433171142 None] Created reservations ['8cae5b72-00ce-4056-b325-9297335e6105', 'ee463281-af8b-441c-a315-14377f8e1766', 'b4bf3c49-a86d-4c2c-bb24-6729371bdd78', 'ad4842e1-ea7e-4d18-a029-ce1d3eaba6ef'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:06:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-bbc58500-e5b9-4017-b589-732497d51c24 tempest-ProjectReaderTests-1433171142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:06:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-bbc58500-e5b9-4017-b589-732497d51c24 tempest-ProjectReaderTests-1433171142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:06:35 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-bbc58500-e5b9-4017-b589-732497d51c24 tempest-ProjectReaderTests-1433171142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:06:35 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-bbc58500-e5b9-4017-b589-732497d51c24 tempest-ProjectReaderTests-1433171142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:06:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-bbc58500-e5b9-4017-b589-732497d51c24 tempest-ProjectReaderTests-1433171142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:06:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-bbc58500-e5b9-4017-b589-732497d51c24 tempest-ProjectReaderTests-1433171142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:35 devstack sudo[107057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 02:06:35 devstack sudo[107057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:35 devstack sudo[107010]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-38a5d34d-3edd-4c5e-a85a-a437a836f2b8 tempest-SnapshotDependencyTests-1378288582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e6dfe99b-30e0-4f49-81a3-9349e808381f" returned: 0 in 1.015s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-38a5d34d-3edd-4c5e-a85a-a437a836f2b8 tempest-SnapshotDependencyTests-1378288582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e6dfe99b-30e0-4f49-81a3-9349e808381f {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:35 devstack sudo[107060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e6dfe99b-30e0-4f49-81a3-9349e808381f Jul 08 02:06:35 devstack sudo[107060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:35 devstack sudo[107013]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e9306c43-ffca-48b0-b7d7-91b51c0b8bd7 tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b617c3eb-e109-478e-b500-2b49be5ded56 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b617c3eb-e109-478e-b500-2b49be5ded56.6aa846d8-5cda-4e16-bb71-772b11881925" returned: 0 in 0.967s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:35 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-e9306c43-ffca-48b0-b7d7-91b51c0b8bd7 tempest-ProjectMemberTests-73815212 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b617c3eb-e109-478e-b500-2b49be5ded56.6aa846d8-5cda-4e16-bb71-772b11881925 is being set with open permissions: ugo+rw Jul 08 02:06:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e9306c43-ffca-48b0-b7d7-91b51c0b8bd7 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b617c3eb-e109-478e-b500-2b49be5ded56.6aa846d8-5cda-4e16-bb71-772b11881925 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:35 devstack sudo[107062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b617c3eb-e109-478e-b500-2b49be5ded56.6aa846d8-5cda-4e16-bb71-772b11881925 Jul 08 02:06:35 devstack sudo[107062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:36 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-50891d6f-8c45-4173-b717-2611f72d5689 tempest-ProjectReaderTests-1433171142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:06:36 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-50891d6f-8c45-4173-b717-2611f72d5689 tempest-ProjectReaderTests-1433171142 None] Flow 'volume_create_manager' (8d0a8937-49d5-4098-a145-a60d605d8668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:06:36 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-50891d6f-8c45-4173-b717-2611f72d5689 tempest-ProjectReaderTests-1433171142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e20e719b-2540-43da-9115-5552eca45630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:06:36 devstack sudo[107057]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:36 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-50891d6f-8c45-4173-b717-2611f72d5689 tempest-ProjectReaderTests-1433171142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e20e719b-2540-43da-9115-5552eca45630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:06:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-920345706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd702801-a40d-4bb0-be1f-9a66a7e12319,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fc2f26950e54299bf8795cacc9d2942',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:06:36Z,use_quota=True,user_id='1cb60482c75048c4acbb493dacb58905',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:06:36 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-50891d6f-8c45-4173-b717-2611f72d5689 tempest-ProjectReaderTests-1433171142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e58f38af-6206-4f10-a10a-e3749d886674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:06:36 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-50891d6f-8c45-4173-b717-2611f72d5689 tempest-ProjectReaderTests-1433171142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e58f38af-6206-4f10-a10a-e3749d886674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:06:36 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-50891d6f-8c45-4173-b717-2611f72d5689 tempest-ProjectReaderTests-1433171142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39c9596f-fcf8-4fc4-9957-816cc9bc0775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:06:36 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-50891d6f-8c45-4173-b717-2611f72d5689 tempest-ProjectReaderTests-1433171142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39c9596f-fcf8-4fc4-9957-816cc9bc0775) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd702801-a40d-4bb0-be1f-9a66a7e12319', 'volume_name': 'volume-dd702801-a40d-4bb0-be1f-9a66a7e12319', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:06:36 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-50891d6f-8c45-4173-b717-2611f72d5689 tempest-ProjectReaderTests-1433171142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c019959-7bf6-420a-9e70-eb283b395e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:06:36 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-50891d6f-8c45-4173-b717-2611f72d5689 tempest-ProjectReaderTests-1433171142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c019959-7bf6-420a-9e70-eb283b395e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:06:36 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-50891d6f-8c45-4173-b717-2611f72d5689 tempest-ProjectReaderTests-1433171142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb53a3e4-f887-43b9-a86c-d7a4096c2c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:06:36 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-50891d6f-8c45-4173-b717-2611f72d5689 tempest-ProjectReaderTests-1433171142 None] Volume dd702801-a40d-4bb0-be1f-9a66a7e12319: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd702801-a40d-4bb0-be1f-9a66a7e12319', 'volume_size': 1} Jul 08 02:06:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-50891d6f-8c45-4173-b717-2611f72d5689 tempest-ProjectReaderTests-1433171142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:06:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-bbc58500-e5b9-4017-b589-732497d51c24 tempest-ProjectReaderTests-1433171142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.887s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:36 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-bbc58500-e5b9-4017-b589-732497d51c24 tempest-ProjectReaderTests-1433171142 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:06:36 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-bbc58500-e5b9-4017-b589-732497d51c24 tempest-ProjectReaderTests-1433171142 None] Deleted volume successfully. Jul 08 02:06:36 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-bbc58500-e5b9-4017-b589-732497d51c24 tempest-ProjectReaderTests-1433171142 None] Lock "cinder-0582af3b-01e5-4205-a1a6-115fc141181e-delete_volume" released by "delete_volume" :: held 3.002s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:06:36 devstack sudo[107060]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-38a5d34d-3edd-4c5e-a85a-a437a836f2b8 tempest-SnapshotDependencyTests-1378288582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-e6dfe99b-30e0-4f49-81a3-9349e808381f" returned: 0 in 0.843s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:36 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-38a5d34d-3edd-4c5e-a85a-a437a836f2b8 tempest-SnapshotDependencyTests-1378288582 None] Lock "cinder-quobyte-e6dfe99b-30e0-4f49-81a3-9349e808381f" released by "delete_volume" :: held 1.923s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:06:36 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-38a5d34d-3edd-4c5e-a85a-a437a836f2b8 tempest-SnapshotDependencyTests-1378288582 None] Created reservations ['8c950cfc-e469-4485-9c9c-e92c9ce9965e', '2a3a59d7-dccc-4d00-bf0f-09f14286149f', '5a258ede-fd7c-4d60-9c3c-f71e742c1a46', 'f1284ba1-ad5d-4745-a71a-5aa379c7e2f3'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:06:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-38a5d34d-3edd-4c5e-a85a-a437a836f2b8 tempest-SnapshotDependencyTests-1378288582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:06:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-38a5d34d-3edd-4c5e-a85a-a437a836f2b8 tempest-SnapshotDependencyTests-1378288582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:06:36 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-38a5d34d-3edd-4c5e-a85a-a437a836f2b8 tempest-SnapshotDependencyTests-1378288582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:06:36 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-38a5d34d-3edd-4c5e-a85a-a437a836f2b8 tempest-SnapshotDependencyTests-1378288582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:06:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-38a5d34d-3edd-4c5e-a85a-a437a836f2b8 tempest-SnapshotDependencyTests-1378288582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:06:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-38a5d34d-3edd-4c5e-a85a-a437a836f2b8 tempest-SnapshotDependencyTests-1378288582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:36 devstack sudo[107067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 02:06:36 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:36 devstack sudo[107062]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e9306c43-ffca-48b0-b7d7-91b51c0b8bd7 tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b617c3eb-e109-478e-b500-2b49be5ded56.6aa846d8-5cda-4e16-bb71-772b11881925" returned: 0 in 0.950s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e9306c43-ffca-48b0-b7d7-91b51c0b8bd7 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b617c3eb-e109-478e-b500-2b49be5ded56.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:36 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-e3e8d58f-079d-441c-b4f0-ecdf3855ab3b tempest-SnapshotDependencyTests-1378288582 None] Acquiring lock "cinder-d908a316-9136-4609-8f67-46848eae9b2c-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:06:36 devstack sudo[107069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b617c3eb-e109-478e-b500-2b49be5ded56.info Jul 08 02:06:36 devstack sudo[107069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:36 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-e3e8d58f-079d-441c-b4f0-ecdf3855ab3b tempest-SnapshotDependencyTests-1378288582 None] Lock "cinder-d908a316-9136-4609-8f67-46848eae9b2c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:06:36 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-e3e8d58f-079d-441c-b4f0-ecdf3855ab3b tempest-SnapshotDependencyTests-1378288582 None] Acquiring lock "cinder-quobyte-d908a316-9136-4609-8f67-46848eae9b2c" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:06:36 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-e3e8d58f-079d-441c-b4f0-ecdf3855ab3b tempest-SnapshotDependencyTests-1378288582 None] Lock "cinder-quobyte-d908a316-9136-4609-8f67-46848eae9b2c" acquired by "delete_volume" :: waited 0.018s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:06:36 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[51cd189d-ca94-4ffd-a54c-0561ab24f9ea]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:06:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e3e8d58f-079d-441c-b4f0-ecdf3855ab3b tempest-SnapshotDependencyTests-1378288582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d908a316-9136-4609-8f67-46848eae9b2c {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:37 devstack sudo[107071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d908a316-9136-4609-8f67-46848eae9b2c Jul 08 02:06:37 devstack sudo[107071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:37 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-38a5d34d-3edd-4c5e-a85a-a437a836f2b8 tempest-SnapshotDependencyTests-1378288582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.783s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:37 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-38a5d34d-3edd-4c5e-a85a-a437a836f2b8 tempest-SnapshotDependencyTests-1378288582 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:06:37 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-38a5d34d-3edd-4c5e-a85a-a437a836f2b8 tempest-SnapshotDependencyTests-1378288582 None] Deleted volume successfully. Jul 08 02:06:37 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-38a5d34d-3edd-4c5e-a85a-a437a836f2b8 tempest-SnapshotDependencyTests-1378288582 None] Lock "cinder-e6dfe99b-30e0-4f49-81a3-9349e808381f-delete_volume" released by "delete_volume" :: held 2.986s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:06:37 devstack sudo[107069]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e9306c43-ffca-48b0-b7d7-91b51c0b8bd7 tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b617c3eb-e109-478e-b500-2b49be5ded56.info" returned: 0 in 0.728s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:37 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-e9306c43-ffca-48b0-b7d7-91b51c0b8bd7 tempest-ProjectMemberTests-73815212 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b617c3eb-e109-478e-b500-2b49be5ded56.info is being set with open permissions: ugo+rw Jul 08 02:06:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e9306c43-ffca-48b0-b7d7-91b51c0b8bd7 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b617c3eb-e109-478e-b500-2b49be5ded56.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:37 devstack sudo[107075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b617c3eb-e109-478e-b500-2b49be5ded56.info Jul 08 02:06:37 devstack sudo[107075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:37 devstack sudo[107071]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e3e8d58f-079d-441c-b4f0-ecdf3855ab3b tempest-SnapshotDependencyTests-1378288582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d908a316-9136-4609-8f67-46848eae9b2c" returned: 0 in 0.878s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e3e8d58f-079d-441c-b4f0-ecdf3855ab3b tempest-SnapshotDependencyTests-1378288582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d908a316-9136-4609-8f67-46848eae9b2c {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:37 devstack sudo[107080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d908a316-9136-4609-8f67-46848eae9b2c Jul 08 02:06:37 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:38 devstack sudo[107075]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e9306c43-ffca-48b0-b7d7-91b51c0b8bd7 tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b617c3eb-e109-478e-b500-2b49be5ded56.info" returned: 0 in 0.662s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e9306c43-ffca-48b0-b7d7-91b51c0b8bd7 tempest-ProjectMemberTests-73815212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.428s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:06:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-50891d6f-8c45-4173-b717-2611f72d5689 tempest-ProjectReaderTests-1433171142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.815s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:06:38 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-50891d6f-8c45-4173-b717-2611f72d5689 tempest-ProjectReaderTests-1433171142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:06:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-920345706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd702801-a40d-4bb0-be1f-9a66a7e12319,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fc2f26950e54299bf8795cacc9d2942',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:06:36Z,use_quota=True,user_id='1cb60482c75048c4acbb493dacb58905',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:06:38 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-50891d6f-8c45-4173-b717-2611f72d5689 tempest-ProjectReaderTests-1433171142 None] Creating volume dd702801-a40d-4bb0-be1f-9a66a7e12319 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:06:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-50891d6f-8c45-4173-b717-2611f72d5689 tempest-ProjectReaderTests-1433171142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:06:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-50891d6f-8c45-4173-b717-2611f72d5689 tempest-ProjectReaderTests-1433171142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:06:38 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-50891d6f-8c45-4173-b717-2611f72d5689 tempest-ProjectReaderTests-1433171142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:06:38 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-50891d6f-8c45-4173-b717-2611f72d5689 tempest-ProjectReaderTests-1433171142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:06:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-50891d6f-8c45-4173-b717-2611f72d5689 tempest-ProjectReaderTests-1433171142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:06:38 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-50891d6f-8c45-4173-b717-2611f72d5689 tempest-ProjectReaderTests-1433171142 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:06:38 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-50891d6f-8c45-4173-b717-2611f72d5689 tempest-ProjectReaderTests-1433171142 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 02:06:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-50891d6f-8c45-4173-b717-2611f72d5689 tempest-ProjectReaderTests-1433171142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-dd702801-a40d-4bb0-be1f-9a66a7e12319 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:38 devstack sudo[107083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-dd702801-a40d-4bb0-be1f-9a66a7e12319 1073741824 Jul 08 02:06:38 devstack sudo[107083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:38 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-e9306c43-ffca-48b0-b7d7-91b51c0b8bd7 tempest-ProjectMemberTests-73815212 None] Create snapshot completed successfully Jul 08 02:06:38 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e3e8d58f-079d-441c-b4f0-ecdf3855ab3b tempest-SnapshotDependencyTests-1378288582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-d908a316-9136-4609-8f67-46848eae9b2c" returned: 0 in 0.707s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:38 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-e3e8d58f-079d-441c-b4f0-ecdf3855ab3b tempest-SnapshotDependencyTests-1378288582 None] Lock "cinder-quobyte-d908a316-9136-4609-8f67-46848eae9b2c" released by "delete_volume" :: held 1.661s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:06:38 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-e3e8d58f-079d-441c-b4f0-ecdf3855ab3b tempest-SnapshotDependencyTests-1378288582 None] Created reservations ['4598d068-2adf-42c6-ad4c-e4688b35f08f', '4a1f47f4-1845-467f-90f0-5a4cd9568ba9', 'eeebaaba-e56a-4fcc-b95f-e3a1e377b7f7', 'b2db1fbb-ca8d-4ee4-b236-918e1732b96a'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:06:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e3e8d58f-079d-441c-b4f0-ecdf3855ab3b tempest-SnapshotDependencyTests-1378288582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:06:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e3e8d58f-079d-441c-b4f0-ecdf3855ab3b tempest-SnapshotDependencyTests-1378288582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:06:38 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-e3e8d58f-079d-441c-b4f0-ecdf3855ab3b tempest-SnapshotDependencyTests-1378288582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:06:38 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-e3e8d58f-079d-441c-b4f0-ecdf3855ab3b tempest-SnapshotDependencyTests-1378288582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:06:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e3e8d58f-079d-441c-b4f0-ecdf3855ab3b tempest-SnapshotDependencyTests-1378288582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:06:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e3e8d58f-079d-441c-b4f0-ecdf3855ab3b tempest-SnapshotDependencyTests-1378288582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:38 devstack sudo[107086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 02:06:38 devstack sudo[107086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:39 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-594e31e0-318c-4d60-a736-7885aec796e6 tempest-ProjectMemberTests-73815212 None] Acquiring lock "cinder-6aa846d8-5cda-4e16-bb71-772b11881925-delete_snapshot" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:06:39 devstack sudo[107083]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-50891d6f-8c45-4173-b717-2611f72d5689 tempest-ProjectReaderTests-1433171142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-dd702801-a40d-4bb0-be1f-9a66a7e12319 1073741824" returned: 0 in 1.030s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:39 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-594e31e0-318c-4d60-a736-7885aec796e6 tempest-ProjectMemberTests-73815212 None] Lock "cinder-6aa846d8-5cda-4e16-bb71-772b11881925-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:06:39 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-594e31e0-318c-4d60-a736-7885aec796e6 tempest-ProjectMemberTests-73815212 None] Acquiring lock "cinder-quobyte-b617c3eb-e109-478e-b500-2b49be5ded56" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:06:39 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-594e31e0-318c-4d60-a736-7885aec796e6 tempest-ProjectMemberTests-73815212 None] Lock "cinder-quobyte-b617c3eb-e109-478e-b500-2b49be5ded56" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:06:39 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-594e31e0-318c-4d60-a736-7885aec796e6 tempest-ProjectMemberTests-73815212 None] Acquiring lock "cinder-quobyte-6aa846d8-5cda-4e16-bb71-772b11881925" by "_delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:06:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-50891d6f-8c45-4173-b717-2611f72d5689 tempest-ProjectReaderTests-1433171142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-dd702801-a40d-4bb0-be1f-9a66a7e12319 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:39 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-594e31e0-318c-4d60-a736-7885aec796e6 tempest-ProjectMemberTests-73815212 None] Lock "cinder-quobyte-6aa846d8-5cda-4e16-bb71-772b11881925" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:06:39 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-594e31e0-318c-4d60-a736-7885aec796e6 tempest-ProjectMemberTests-73815212 None] Deleting offline snapshot 6aa846d8-5cda-4e16-bb71-772b11881925 of volume b617c3eb-e109-478e-b500-2b49be5ded56 {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 02:06:39 devstack sudo[107092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-dd702801-a40d-4bb0-be1f-9a66a7e12319 Jul 08 02:06:39 devstack sudo[107092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:39 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-594e31e0-318c-4d60-a736-7885aec796e6 tempest-ProjectMemberTests-73815212 None] snapshot_file for this snap is: volume-b617c3eb-e109-478e-b500-2b49be5ded56.6aa846d8-5cda-4e16-bb71-772b11881925 {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 02:06:39 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e5795b-e44f-48e5-aafc-41cbc13e89aa]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:06:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-594e31e0-318c-4d60-a736-7885aec796e6 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b617c3eb-e109-478e-b500-2b49be5ded56.6aa846d8-5cda-4e16-bb71-772b11881925 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:39 devstack sudo[107086]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e3e8d58f-079d-441c-b4f0-ecdf3855ab3b tempest-SnapshotDependencyTests-1378288582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.753s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:39 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-e3e8d58f-079d-441c-b4f0-ecdf3855ab3b tempest-SnapshotDependencyTests-1378288582 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:06:39 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-e3e8d58f-079d-441c-b4f0-ecdf3855ab3b tempest-SnapshotDependencyTests-1378288582 None] Deleted volume successfully. Jul 08 02:06:39 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-e3e8d58f-079d-441c-b4f0-ecdf3855ab3b tempest-SnapshotDependencyTests-1378288582 None] Lock "cinder-d908a316-9136-4609-8f67-46848eae9b2c-delete_volume" released by "delete_volume" :: held 2.682s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:06:39 devstack sudo[107095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b617c3eb-e109-478e-b500-2b49be5ded56.6aa846d8-5cda-4e16-bb71-772b11881925 Jul 08 02:06:39 devstack sudo[107095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:40 devstack sudo[107092]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-50891d6f-8c45-4173-b717-2611f72d5689 tempest-ProjectReaderTests-1433171142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-dd702801-a40d-4bb0-be1f-9a66a7e12319" returned: 0 in 0.769s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:40 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-50891d6f-8c45-4173-b717-2611f72d5689 tempest-ProjectReaderTests-1433171142 None] <== create_volume: return (1870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:06:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-50891d6f-8c45-4173-b717-2611f72d5689 tempest-ProjectReaderTests-1433171142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.874s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:06:40 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-50891d6f-8c45-4173-b717-2611f72d5689 tempest-ProjectReaderTests-1433171142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb53a3e4-f887-43b9-a86c-d7a4096c2c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd702801-a40d-4bb0-be1f-9a66a7e12319', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:06:40 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-50891d6f-8c45-4173-b717-2611f72d5689 tempest-ProjectReaderTests-1433171142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fedec3b-7c28-4742-8463-7fa35828c1b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:06:40 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-50891d6f-8c45-4173-b717-2611f72d5689 tempest-ProjectReaderTests-1433171142 None] Volume volume-dd702801-a40d-4bb0-be1f-9a66a7e12319 (dd702801-a40d-4bb0-be1f-9a66a7e12319): created successfully Jul 08 02:06:40 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-50891d6f-8c45-4173-b717-2611f72d5689 tempest-ProjectReaderTests-1433171142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fedec3b-7c28-4742-8463-7fa35828c1b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:06:40 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-50891d6f-8c45-4173-b717-2611f72d5689 tempest-ProjectReaderTests-1433171142 None] Flow 'volume_create_manager' (8d0a8937-49d5-4098-a145-a60d605d8668) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:06:40 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-50891d6f-8c45-4173-b717-2611f72d5689 tempest-ProjectReaderTests-1433171142 None] Created volume successfully. Jul 08 02:06:40 devstack sudo[107095]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-594e31e0-318c-4d60-a736-7885aec796e6 tempest-ProjectMemberTests-73815212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b617c3eb-e109-478e-b500-2b49be5ded56.6aa846d8-5cda-4e16-bb71-772b11881925" returned: 0 in 0.955s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:40 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-594e31e0-318c-4d60-a736-7885aec796e6 tempest-ProjectMemberTests-73815212 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b617c3eb-e109-478e-b500-2b49be5ded56(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:06:40 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[c817110d-d8c3-4f73-86b3-90a2c1a529bc]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:06:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-594e31e0-318c-4d60-a736-7885aec796e6 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b617c3eb-e109-478e-b500-2b49be5ded56 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:40 devstack sudo[107101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b617c3eb-e109-478e-b500-2b49be5ded56 Jul 08 02:06:40 devstack sudo[107101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:40 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-e6a85958-5214-4486-9842-8fc0bb2c9777 tempest-ProjectReaderTests-1433171142 None] Acquiring lock "cinder-dd702801-a40d-4bb0-be1f-9a66a7e12319-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:06:40 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-e6a85958-5214-4486-9842-8fc0bb2c9777 tempest-ProjectReaderTests-1433171142 None] Lock "cinder-dd702801-a40d-4bb0-be1f-9a66a7e12319-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:06:40 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-e6a85958-5214-4486-9842-8fc0bb2c9777 tempest-ProjectReaderTests-1433171142 None] Acquiring lock "cinder-quobyte-dd702801-a40d-4bb0-be1f-9a66a7e12319" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:06:40 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-e6a85958-5214-4486-9842-8fc0bb2c9777 tempest-ProjectReaderTests-1433171142 None] Lock "cinder-quobyte-dd702801-a40d-4bb0-be1f-9a66a7e12319" acquired by "delete_volume" :: waited 0.018s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:06:40 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d8c9c0-e560-4ba9-9e2a-c2a95acc1414]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:06:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e6a85958-5214-4486-9842-8fc0bb2c9777 tempest-ProjectReaderTests-1433171142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-dd702801-a40d-4bb0-be1f-9a66a7e12319 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:40 devstack sudo[107104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-dd702801-a40d-4bb0-be1f-9a66a7e12319 Jul 08 02:06:40 devstack sudo[107104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:41 devstack sudo[107101]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-594e31e0-318c-4d60-a736-7885aec796e6 tempest-ProjectMemberTests-73815212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b617c3eb-e109-478e-b500-2b49be5ded56" returned: 0 in 0.949s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-594e31e0-318c-4d60-a736-7885aec796e6 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b617c3eb-e109-478e-b500-2b49be5ded56.6aa846d8-5cda-4e16-bb71-772b11881925 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:41 devstack sudo[107110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b617c3eb-e109-478e-b500-2b49be5ded56.6aa846d8-5cda-4e16-bb71-772b11881925 Jul 08 02:06:41 devstack sudo[107110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:41 devstack sudo[107104]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e6a85958-5214-4486-9842-8fc0bb2c9777 tempest-ProjectReaderTests-1433171142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-dd702801-a40d-4bb0-be1f-9a66a7e12319" returned: 0 in 0.831s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e6a85958-5214-4486-9842-8fc0bb2c9777 tempest-ProjectReaderTests-1433171142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-dd702801-a40d-4bb0-be1f-9a66a7e12319 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:41 devstack sudo[107116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-dd702801-a40d-4bb0-be1f-9a66a7e12319 Jul 08 02:06:41 devstack sudo[107116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:42 devstack sudo[107110]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-594e31e0-318c-4d60-a736-7885aec796e6 tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b617c3eb-e109-478e-b500-2b49be5ded56.6aa846d8-5cda-4e16-bb71-772b11881925" returned: 0 in 0.842s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-594e31e0-318c-4d60-a736-7885aec796e6 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b617c3eb-e109-478e-b500-2b49be5ded56.6aa846d8-5cda-4e16-bb71-772b11881925 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:42 devstack sudo[107121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b617c3eb-e109-478e-b500-2b49be5ded56.6aa846d8-5cda-4e16-bb71-772b11881925 Jul 08 02:06:42 devstack sudo[107121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:42 devstack sudo[107116]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e6a85958-5214-4486-9842-8fc0bb2c9777 tempest-ProjectReaderTests-1433171142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-dd702801-a40d-4bb0-be1f-9a66a7e12319" returned: 0 in 0.850s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:42 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-e6a85958-5214-4486-9842-8fc0bb2c9777 tempest-ProjectReaderTests-1433171142 None] Lock "cinder-quobyte-dd702801-a40d-4bb0-be1f-9a66a7e12319" released by "delete_volume" :: held 1.749s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:06:42 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-e6a85958-5214-4486-9842-8fc0bb2c9777 tempest-ProjectReaderTests-1433171142 None] Created reservations ['c9df0892-c4f1-4c64-b689-b19611aca0f5', '85c35af6-b35e-4f43-9607-05c38182aaba', 'cbd33fe9-0ba9-4a53-87a0-c0b6d31fa762', '7a8d7949-ad29-43bb-9f2d-9e3c26487e23'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:06:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e6a85958-5214-4486-9842-8fc0bb2c9777 tempest-ProjectReaderTests-1433171142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:06:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e6a85958-5214-4486-9842-8fc0bb2c9777 tempest-ProjectReaderTests-1433171142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:06:42 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-e6a85958-5214-4486-9842-8fc0bb2c9777 tempest-ProjectReaderTests-1433171142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:06:42 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-e6a85958-5214-4486-9842-8fc0bb2c9777 tempest-ProjectReaderTests-1433171142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:06:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-e6a85958-5214-4486-9842-8fc0bb2c9777 tempest-ProjectReaderTests-1433171142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:06:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e6a85958-5214-4486-9842-8fc0bb2c9777 tempest-ProjectReaderTests-1433171142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:42 devstack sudo[107124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 02:06:42 devstack sudo[107124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:42 devstack sudo[107121]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-594e31e0-318c-4d60-a736-7885aec796e6 tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b617c3eb-e109-478e-b500-2b49be5ded56.6aa846d8-5cda-4e16-bb71-772b11881925" returned: 0 in 0.802s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:42 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-594e31e0-318c-4d60-a736-7885aec796e6 tempest-ProjectMemberTests-73815212 None] Lock "cinder-quobyte-6aa846d8-5cda-4e16-bb71-772b11881925" released by "_delete_snapshot" :: held 3.693s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:06:42 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-594e31e0-318c-4d60-a736-7885aec796e6 tempest-ProjectMemberTests-73815212 None] Lock "cinder-quobyte-b617c3eb-e109-478e-b500-2b49be5ded56" released by "delete_snapshot" :: held 3.742s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:06:43 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-594e31e0-318c-4d60-a736-7885aec796e6 tempest-ProjectMemberTests-73815212 None] Created reservations ['a3fdd1d4-404b-4337-a1a6-1b290547be99', '8386f3ee-f534-4e77-8c50-56f2ede502df', '09581c11-1fdd-4927-a1b6-1c5e485c1785', '1c5c858a-4746-4f98-8ac4-5d1200b8985b'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:06:43 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-594e31e0-318c-4d60-a736-7885aec796e6 tempest-ProjectMemberTests-73815212 None] Delete snapshot completed successfully. Jul 08 02:06:43 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-594e31e0-318c-4d60-a736-7885aec796e6 tempest-ProjectMemberTests-73815212 None] Lock "cinder-6aa846d8-5cda-4e16-bb71-772b11881925-delete_snapshot" released by "delete_snapshot" :: held 3.971s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:06:43 devstack sudo[107124]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-e6a85958-5214-4486-9842-8fc0bb2c9777 tempest-ProjectReaderTests-1433171142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.875s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:43 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-e6a85958-5214-4486-9842-8fc0bb2c9777 tempest-ProjectReaderTests-1433171142 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:06:43 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-e6a85958-5214-4486-9842-8fc0bb2c9777 tempest-ProjectReaderTests-1433171142 None] Deleted volume successfully. Jul 08 02:06:43 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-285f35b4-6062-4718-aabf-9fb1733849bd tempest-ProjectMemberTests-73815212 None] Acquiring lock "cinder-b617c3eb-e109-478e-b500-2b49be5ded56-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:06:43 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-e6a85958-5214-4486-9842-8fc0bb2c9777 tempest-ProjectReaderTests-1433171142 None] Lock "cinder-dd702801-a40d-4bb0-be1f-9a66a7e12319-delete_volume" released by "delete_volume" :: held 2.935s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:06:43 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6cdbc60-f634-479c-b1d6-03a2b412fa95 tempest-ProjectReaderTests-1433171142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:06:43 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c6cdbc60-f634-479c-b1d6-03a2b412fa95 tempest-ProjectReaderTests-1433171142 None] Flow 'volume_create_manager' (b77440ad-1d6a-45fe-ba6f-51cd86780f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:06:43 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c6cdbc60-f634-479c-b1d6-03a2b412fa95 tempest-ProjectReaderTests-1433171142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b55b11a8-9db7-44ad-b058-62a0ce15b284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:06:43 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-285f35b4-6062-4718-aabf-9fb1733849bd tempest-ProjectMemberTests-73815212 None] Lock "cinder-b617c3eb-e109-478e-b500-2b49be5ded56-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:06:43 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c6cdbc60-f634-479c-b1d6-03a2b412fa95 tempest-ProjectReaderTests-1433171142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b55b11a8-9db7-44ad-b058-62a0ce15b284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:06:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-511055645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12bdb2cc-5b56-4a8e-a59b-0eb048f6e7dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fc2f26950e54299bf8795cacc9d2942',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:06:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:06:44Z,use_quota=True,user_id='1cb60482c75048c4acbb493dacb58905',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:06:43 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c6cdbc60-f634-479c-b1d6-03a2b412fa95 tempest-ProjectReaderTests-1433171142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f135cadb-07e3-4cb9-856b-8a3fae9c61f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:06:43 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c6cdbc60-f634-479c-b1d6-03a2b412fa95 tempest-ProjectReaderTests-1433171142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f135cadb-07e3-4cb9-856b-8a3fae9c61f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:06:43 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c6cdbc60-f634-479c-b1d6-03a2b412fa95 tempest-ProjectReaderTests-1433171142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd919b9f-3b3e-4734-8259-4403339dfc9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:06:43 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c6cdbc60-f634-479c-b1d6-03a2b412fa95 tempest-ProjectReaderTests-1433171142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd919b9f-3b3e-4734-8259-4403339dfc9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12bdb2cc-5b56-4a8e-a59b-0eb048f6e7dd', 'volume_name': 'volume-12bdb2cc-5b56-4a8e-a59b-0eb048f6e7dd', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:06:43 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c6cdbc60-f634-479c-b1d6-03a2b412fa95 tempest-ProjectReaderTests-1433171142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3543a8ad-f41b-4926-bd36-63081f152f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:06:43 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c6cdbc60-f634-479c-b1d6-03a2b412fa95 tempest-ProjectReaderTests-1433171142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3543a8ad-f41b-4926-bd36-63081f152f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:06:43 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c6cdbc60-f634-479c-b1d6-03a2b412fa95 tempest-ProjectReaderTests-1433171142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab0be2ef-0206-495a-a418-d338e0beb13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:06:43 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-c6cdbc60-f634-479c-b1d6-03a2b412fa95 tempest-ProjectReaderTests-1433171142 None] Volume 12bdb2cc-5b56-4a8e-a59b-0eb048f6e7dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12bdb2cc-5b56-4a8e-a59b-0eb048f6e7dd', 'volume_size': 1} Jul 08 02:06:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c6cdbc60-f634-479c-b1d6-03a2b412fa95 tempest-ProjectReaderTests-1433171142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:06:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c6cdbc60-f634-479c-b1d6-03a2b412fa95 tempest-ProjectReaderTests-1433171142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:06:43 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-c6cdbc60-f634-479c-b1d6-03a2b412fa95 tempest-ProjectReaderTests-1433171142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:06:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-511055645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12bdb2cc-5b56-4a8e-a59b-0eb048f6e7dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fc2f26950e54299bf8795cacc9d2942',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:06:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:06:44Z,use_quota=True,user_id='1cb60482c75048c4acbb493dacb58905',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:06:43 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-c6cdbc60-f634-479c-b1d6-03a2b412fa95 tempest-ProjectReaderTests-1433171142 None] Creating volume 12bdb2cc-5b56-4a8e-a59b-0eb048f6e7dd {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:06:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c6cdbc60-f634-479c-b1d6-03a2b412fa95 tempest-ProjectReaderTests-1433171142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:06:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c6cdbc60-f634-479c-b1d6-03a2b412fa95 tempest-ProjectReaderTests-1433171142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:06:43 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-c6cdbc60-f634-479c-b1d6-03a2b412fa95 tempest-ProjectReaderTests-1433171142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:06:43 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-c6cdbc60-f634-479c-b1d6-03a2b412fa95 tempest-ProjectReaderTests-1433171142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:06:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c6cdbc60-f634-479c-b1d6-03a2b412fa95 tempest-ProjectReaderTests-1433171142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:06:43 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-c6cdbc60-f634-479c-b1d6-03a2b412fa95 tempest-ProjectReaderTests-1433171142 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:06:43 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-c6cdbc60-f634-479c-b1d6-03a2b412fa95 tempest-ProjectReaderTests-1433171142 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 02:06:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c6cdbc60-f634-479c-b1d6-03a2b412fa95 tempest-ProjectReaderTests-1433171142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-12bdb2cc-5b56-4a8e-a59b-0eb048f6e7dd 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:43 devstack sudo[107130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-12bdb2cc-5b56-4a8e-a59b-0eb048f6e7dd 1073741824 Jul 08 02:06:43 devstack sudo[107130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:43 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-285f35b4-6062-4718-aabf-9fb1733849bd tempest-ProjectMemberTests-73815212 None] Acquiring lock "cinder-quobyte-b617c3eb-e109-478e-b500-2b49be5ded56" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:06:43 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-285f35b4-6062-4718-aabf-9fb1733849bd tempest-ProjectMemberTests-73815212 None] Lock "cinder-quobyte-b617c3eb-e109-478e-b500-2b49be5ded56" acquired by "delete_volume" :: waited 0.023s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:06:43 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1308a52-b509-4117-a063-48a703483ea4]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:06:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-285f35b4-6062-4718-aabf-9fb1733849bd tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b617c3eb-e109-478e-b500-2b49be5ded56 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:43 devstack sudo[107132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b617c3eb-e109-478e-b500-2b49be5ded56 Jul 08 02:06:43 devstack sudo[107132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:44 devstack sudo[107132]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-285f35b4-6062-4718-aabf-9fb1733849bd tempest-ProjectMemberTests-73815212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b617c3eb-e109-478e-b500-2b49be5ded56" returned: 0 in 0.879s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-285f35b4-6062-4718-aabf-9fb1733849bd tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b617c3eb-e109-478e-b500-2b49be5ded56 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:44 devstack sudo[107130]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c6cdbc60-f634-479c-b1d6-03a2b412fa95 tempest-ProjectReaderTests-1433171142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-12bdb2cc-5b56-4a8e-a59b-0eb048f6e7dd 1073741824" returned: 0 in 1.031s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:44 devstack sudo[107143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b617c3eb-e109-478e-b500-2b49be5ded56 Jul 08 02:06:44 devstack sudo[107143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c6cdbc60-f634-479c-b1d6-03a2b412fa95 tempest-ProjectReaderTests-1433171142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-12bdb2cc-5b56-4a8e-a59b-0eb048f6e7dd {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:44 devstack sudo[107145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-12bdb2cc-5b56-4a8e-a59b-0eb048f6e7dd Jul 08 02:06:44 devstack sudo[107145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:45 devstack sudo[107145]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c6cdbc60-f634-479c-b1d6-03a2b412fa95 tempest-ProjectReaderTests-1433171142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-12bdb2cc-5b56-4a8e-a59b-0eb048f6e7dd" returned: 0 in 0.721s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:45 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-c6cdbc60-f634-479c-b1d6-03a2b412fa95 tempest-ProjectReaderTests-1433171142 None] <== create_volume: return (1823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:06:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c6cdbc60-f634-479c-b1d6-03a2b412fa95 tempest-ProjectReaderTests-1433171142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.826s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:06:45 devstack sudo[107143]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:45 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c6cdbc60-f634-479c-b1d6-03a2b412fa95 tempest-ProjectReaderTests-1433171142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab0be2ef-0206-495a-a418-d338e0beb13f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12bdb2cc-5b56-4a8e-a59b-0eb048f6e7dd', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:06:45 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c6cdbc60-f634-479c-b1d6-03a2b412fa95 tempest-ProjectReaderTests-1433171142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4b54168-1069-4b83-824f-f471f2ee5b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:06:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-285f35b4-6062-4718-aabf-9fb1733849bd tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-b617c3eb-e109-478e-b500-2b49be5ded56" returned: 0 in 0.842s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:45 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-285f35b4-6062-4718-aabf-9fb1733849bd tempest-ProjectMemberTests-73815212 None] Lock "cinder-quobyte-b617c3eb-e109-478e-b500-2b49be5ded56" released by "delete_volume" :: held 1.800s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:06:45 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-c6cdbc60-f634-479c-b1d6-03a2b412fa95 tempest-ProjectReaderTests-1433171142 None] Volume volume-12bdb2cc-5b56-4a8e-a59b-0eb048f6e7dd (12bdb2cc-5b56-4a8e-a59b-0eb048f6e7dd): created successfully Jul 08 02:06:45 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c6cdbc60-f634-479c-b1d6-03a2b412fa95 tempest-ProjectReaderTests-1433171142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4b54168-1069-4b83-824f-f471f2ee5b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:06:45 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c6cdbc60-f634-479c-b1d6-03a2b412fa95 tempest-ProjectReaderTests-1433171142 None] Flow 'volume_create_manager' (b77440ad-1d6a-45fe-ba6f-51cd86780f1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:06:45 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-c6cdbc60-f634-479c-b1d6-03a2b412fa95 tempest-ProjectReaderTests-1433171142 None] Created volume successfully. Jul 08 02:06:45 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-285f35b4-6062-4718-aabf-9fb1733849bd tempest-ProjectMemberTests-73815212 None] Created reservations ['cb8ec4c2-2d95-4c3d-be43-099b0cf7b599', 'e183196d-6cdb-46d6-b6d0-2b79051c430c', '0428369c-fdd5-4fcd-8f19-6efe0e814c3e', '33538ad0-f64a-4d09-a443-016bcb5fbe1a'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:06:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-285f35b4-6062-4718-aabf-9fb1733849bd tempest-ProjectMemberTests-73815212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:06:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-285f35b4-6062-4718-aabf-9fb1733849bd tempest-ProjectMemberTests-73815212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:06:45 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-285f35b4-6062-4718-aabf-9fb1733849bd tempest-ProjectMemberTests-73815212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:06:45 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-285f35b4-6062-4718-aabf-9fb1733849bd tempest-ProjectMemberTests-73815212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:06:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-285f35b4-6062-4718-aabf-9fb1733849bd tempest-ProjectMemberTests-73815212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:06:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-285f35b4-6062-4718-aabf-9fb1733849bd tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:45 devstack sudo[107150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 02:06:45 devstack sudo[107150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:46 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c41677b-ae70-4441-bad3-3aba38da4c46 tempest-ProjectMemberTests-73815212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:06:46 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1c41677b-ae70-4441-bad3-3aba38da4c46 tempest-ProjectMemberTests-73815212 None] Flow 'volume_create_manager' (dc0e2b28-fa81-4006-acc8-3890162a8906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:06:46 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1c41677b-ae70-4441-bad3-3aba38da4c46 tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e8536c3-8820-4ed3-a9bb-9b681e4c07c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:06:46 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1c41677b-ae70-4441-bad3-3aba38da4c46 tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e8536c3-8820-4ed3-a9bb-9b681e4c07c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:06:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1534462841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8255fdaf-f9b1-419a-a7d9-68cd71e9dc26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f353d90ed9694fe88617e9c4eed37bf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:06:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:06:46Z,use_quota=True,user_id='6137db3fdb294c84a17fd39e57e13785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:06:46 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1c41677b-ae70-4441-bad3-3aba38da4c46 tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e83dcfc4-a547-4dd1-8cbe-b3610e08c325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:06:46 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1c41677b-ae70-4441-bad3-3aba38da4c46 tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e83dcfc4-a547-4dd1-8cbe-b3610e08c325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:06:46 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1c41677b-ae70-4441-bad3-3aba38da4c46 tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d031424-723b-41ec-b663-c8ffea6cd90a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:06:46 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1c41677b-ae70-4441-bad3-3aba38da4c46 tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d031424-723b-41ec-b663-c8ffea6cd90a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8255fdaf-f9b1-419a-a7d9-68cd71e9dc26', 'volume_name': 'volume-8255fdaf-f9b1-419a-a7d9-68cd71e9dc26', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:06:46 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1c41677b-ae70-4441-bad3-3aba38da4c46 tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1606bf8-9afc-4f20-9edf-3b12521c6e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:06:46 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1c41677b-ae70-4441-bad3-3aba38da4c46 tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1606bf8-9afc-4f20-9edf-3b12521c6e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:06:46 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1c41677b-ae70-4441-bad3-3aba38da4c46 tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5238ba78-d806-4664-a18e-8faabae5b289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:06:46 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-1c41677b-ae70-4441-bad3-3aba38da4c46 tempest-ProjectMemberTests-73815212 None] Volume 8255fdaf-f9b1-419a-a7d9-68cd71e9dc26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8255fdaf-f9b1-419a-a7d9-68cd71e9dc26', 'volume_size': 1} Jul 08 02:06:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-1c41677b-ae70-4441-bad3-3aba38da4c46 tempest-ProjectMemberTests-73815212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:06:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-1c41677b-ae70-4441-bad3-3aba38da4c46 tempest-ProjectMemberTests-73815212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:06:46 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-1c41677b-ae70-4441-bad3-3aba38da4c46 tempest-ProjectMemberTests-73815212 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:06:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1534462841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8255fdaf-f9b1-419a-a7d9-68cd71e9dc26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f353d90ed9694fe88617e9c4eed37bf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:06:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:06:46Z,use_quota=True,user_id='6137db3fdb294c84a17fd39e57e13785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:06:46 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-1c41677b-ae70-4441-bad3-3aba38da4c46 tempest-ProjectMemberTests-73815212 None] Creating volume 8255fdaf-f9b1-419a-a7d9-68cd71e9dc26 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:06:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-1c41677b-ae70-4441-bad3-3aba38da4c46 tempest-ProjectMemberTests-73815212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:06:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-1c41677b-ae70-4441-bad3-3aba38da4c46 tempest-ProjectMemberTests-73815212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:06:46 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-1c41677b-ae70-4441-bad3-3aba38da4c46 tempest-ProjectMemberTests-73815212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:06:46 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-1c41677b-ae70-4441-bad3-3aba38da4c46 tempest-ProjectMemberTests-73815212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:06:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-1c41677b-ae70-4441-bad3-3aba38da4c46 tempest-ProjectMemberTests-73815212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:06:46 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-1c41677b-ae70-4441-bad3-3aba38da4c46 tempest-ProjectMemberTests-73815212 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:06:46 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-1c41677b-ae70-4441-bad3-3aba38da4c46 tempest-ProjectMemberTests-73815212 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 02:06:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1c41677b-ae70-4441-bad3-3aba38da4c46 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8255fdaf-f9b1-419a-a7d9-68cd71e9dc26 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:46 devstack sudo[107150]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:46 devstack sudo[107153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8255fdaf-f9b1-419a-a7d9-68cd71e9dc26 1073741824 Jul 08 02:06:46 devstack sudo[107153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-285f35b4-6062-4718-aabf-9fb1733849bd tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.910s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:46 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-285f35b4-6062-4718-aabf-9fb1733849bd tempest-ProjectMemberTests-73815212 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:06:46 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-285f35b4-6062-4718-aabf-9fb1733849bd tempest-ProjectMemberTests-73815212 None] Deleted volume successfully. Jul 08 02:06:46 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-285f35b4-6062-4718-aabf-9fb1733849bd tempest-ProjectMemberTests-73815212 None] Lock "cinder-b617c3eb-e109-478e-b500-2b49be5ded56-delete_volume" released by "delete_volume" :: held 3.087s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:06:46 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-4837926c-f596-4a55-a828-429ebf428caa tempest-ProjectReaderTests-1433171142 None] Acquiring lock "cinder-12bdb2cc-5b56-4a8e-a59b-0eb048f6e7dd-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:06:46 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-4837926c-f596-4a55-a828-429ebf428caa tempest-ProjectReaderTests-1433171142 None] Lock "cinder-12bdb2cc-5b56-4a8e-a59b-0eb048f6e7dd-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:06:46 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-4837926c-f596-4a55-a828-429ebf428caa tempest-ProjectReaderTests-1433171142 None] Acquiring lock "cinder-quobyte-12bdb2cc-5b56-4a8e-a59b-0eb048f6e7dd" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:06:46 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-4837926c-f596-4a55-a828-429ebf428caa tempest-ProjectReaderTests-1433171142 None] Lock "cinder-quobyte-12bdb2cc-5b56-4a8e-a59b-0eb048f6e7dd" acquired by "delete_volume" :: waited 0.021s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:06:46 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d3c728-d996-4238-aab4-261b611561d7]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:06:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4837926c-f596-4a55-a828-429ebf428caa tempest-ProjectReaderTests-1433171142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-12bdb2cc-5b56-4a8e-a59b-0eb048f6e7dd {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:47 devstack sudo[107155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-12bdb2cc-5b56-4a8e-a59b-0eb048f6e7dd Jul 08 02:06:47 devstack sudo[107155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:47 devstack sudo[107153]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1c41677b-ae70-4441-bad3-3aba38da4c46 tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8255fdaf-f9b1-419a-a7d9-68cd71e9dc26 1073741824" returned: 0 in 1.107s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1c41677b-ae70-4441-bad3-3aba38da4c46 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8255fdaf-f9b1-419a-a7d9-68cd71e9dc26 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:47 devstack sudo[107165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8255fdaf-f9b1-419a-a7d9-68cd71e9dc26 Jul 08 02:06:47 devstack sudo[107165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:47 devstack sudo[107155]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4837926c-f596-4a55-a828-429ebf428caa tempest-ProjectReaderTests-1433171142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-12bdb2cc-5b56-4a8e-a59b-0eb048f6e7dd" returned: 0 in 0.997s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4837926c-f596-4a55-a828-429ebf428caa tempest-ProjectReaderTests-1433171142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-12bdb2cc-5b56-4a8e-a59b-0eb048f6e7dd {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:47 devstack sudo[107167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-12bdb2cc-5b56-4a8e-a59b-0eb048f6e7dd Jul 08 02:06:47 devstack sudo[107167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:48 devstack sudo[107165]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-1c41677b-ae70-4441-bad3-3aba38da4c46 tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8255fdaf-f9b1-419a-a7d9-68cd71e9dc26" returned: 0 in 0.889s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:48 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-1c41677b-ae70-4441-bad3-3aba38da4c46 tempest-ProjectMemberTests-73815212 None] <== create_volume: return (2055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:06:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-1c41677b-ae70-4441-bad3-3aba38da4c46 tempest-ProjectMemberTests-73815212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.059s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:06:48 devstack sudo[107167]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:48 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1c41677b-ae70-4441-bad3-3aba38da4c46 tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5238ba78-d806-4664-a18e-8faabae5b289) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8255fdaf-f9b1-419a-a7d9-68cd71e9dc26', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:06:48 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1c41677b-ae70-4441-bad3-3aba38da4c46 tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84c8ae78-30f7-4975-aa95-a0273a3c7216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:06:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4837926c-f596-4a55-a828-429ebf428caa tempest-ProjectReaderTests-1433171142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-12bdb2cc-5b56-4a8e-a59b-0eb048f6e7dd" returned: 0 in 0.789s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:48 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-4837926c-f596-4a55-a828-429ebf428caa tempest-ProjectReaderTests-1433171142 None] Lock "cinder-quobyte-12bdb2cc-5b56-4a8e-a59b-0eb048f6e7dd" released by "delete_volume" :: held 1.841s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:06:48 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-1c41677b-ae70-4441-bad3-3aba38da4c46 tempest-ProjectMemberTests-73815212 None] Volume volume-8255fdaf-f9b1-419a-a7d9-68cd71e9dc26 (8255fdaf-f9b1-419a-a7d9-68cd71e9dc26): created successfully Jul 08 02:06:48 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1c41677b-ae70-4441-bad3-3aba38da4c46 tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84c8ae78-30f7-4975-aa95-a0273a3c7216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:06:48 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-1c41677b-ae70-4441-bad3-3aba38da4c46 tempest-ProjectMemberTests-73815212 None] Flow 'volume_create_manager' (dc0e2b28-fa81-4006-acc8-3890162a8906) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:06:48 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-1c41677b-ae70-4441-bad3-3aba38da4c46 tempest-ProjectMemberTests-73815212 None] Created volume successfully. Jul 08 02:06:48 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-4837926c-f596-4a55-a828-429ebf428caa tempest-ProjectReaderTests-1433171142 None] Created reservations ['c17a19d4-70db-4ac4-8506-09cf9fb9528d', '9625da52-1ab1-43c6-b23a-2787b06320ea', '5c6a6407-37c9-4516-9fec-bc9cfc69acea', 'a5baed1f-e606-45b2-bb6a-1f47f7e636e4'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:06:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-4837926c-f596-4a55-a828-429ebf428caa tempest-ProjectReaderTests-1433171142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:06:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-4837926c-f596-4a55-a828-429ebf428caa tempest-ProjectReaderTests-1433171142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:06:48 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-4837926c-f596-4a55-a828-429ebf428caa tempest-ProjectReaderTests-1433171142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:06:48 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-4837926c-f596-4a55-a828-429ebf428caa tempest-ProjectReaderTests-1433171142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:06:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-4837926c-f596-4a55-a828-429ebf428caa tempest-ProjectReaderTests-1433171142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:06:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4837926c-f596-4a55-a828-429ebf428caa tempest-ProjectReaderTests-1433171142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:48 devstack sudo[107173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 02:06:48 devstack sudo[107173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:49 devstack sudo[107173]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:49 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4837926c-f596-4a55-a828-429ebf428caa tempest-ProjectReaderTests-1433171142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.720s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:49 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-4837926c-f596-4a55-a828-429ebf428caa tempest-ProjectReaderTests-1433171142 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:06:49 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-4837926c-f596-4a55-a828-429ebf428caa tempest-ProjectReaderTests-1433171142 None] Deleted volume successfully. Jul 08 02:06:49 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-4837926c-f596-4a55-a828-429ebf428caa tempest-ProjectReaderTests-1433171142 None] Lock "cinder-12bdb2cc-5b56-4a8e-a59b-0eb048f6e7dd-delete_volume" released by "delete_volume" :: held 2.850s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:06:49 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-9f8da558-6912-4d00-a50e-32c9d7576c44 tempest-ProjectMemberTests-73815212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:06:49 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-9f8da558-6912-4d00-a50e-32c9d7576c44 tempest-ProjectMemberTests-73815212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:06:49 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-9f8da558-6912-4d00-a50e-32c9d7576c44 tempest-ProjectMemberTests-73815212 None] Creating offline snapshot a6c80a96-9ed5-4a5c-ab42-fd41dd701be5 of volume 8255fdaf-f9b1-419a-a7d9-68cd71e9dc26 {{(pid=87134) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 02:06:49 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb98e3c-05ae-425b-9e5b-28d337aaf007]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:06:49 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9f8da558-6912-4d00-a50e-32c9d7576c44 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8255fdaf-f9b1-419a-a7d9-68cd71e9dc26 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:50 devstack sudo[107176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8255fdaf-f9b1-419a-a7d9-68cd71e9dc26 Jul 08 02:06:50 devstack sudo[107176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:50 devstack sudo[107176]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:50 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9f8da558-6912-4d00-a50e-32c9d7576c44 tempest-ProjectMemberTests-73815212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8255fdaf-f9b1-419a-a7d9-68cd71e9dc26" returned: 0 in 0.986s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:50 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9f8da558-6912-4d00-a50e-32c9d7576c44 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8255fdaf-f9b1-419a-a7d9-68cd71e9dc26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8255fdaf-f9b1-419a-a7d9-68cd71e9dc26.a6c80a96-9ed5-4a5c-ab42-fd41dd701be5 1G {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:50 devstack sudo[107182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8255fdaf-f9b1-419a-a7d9-68cd71e9dc26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8255fdaf-f9b1-419a-a7d9-68cd71e9dc26.a6c80a96-9ed5-4a5c-ab42-fd41dd701be5 1G Jul 08 02:06:50 devstack sudo[107182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:51 devstack sudo[107182]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9f8da558-6912-4d00-a50e-32c9d7576c44 tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8255fdaf-f9b1-419a-a7d9-68cd71e9dc26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8255fdaf-f9b1-419a-a7d9-68cd71e9dc26.a6c80a96-9ed5-4a5c-ab42-fd41dd701be5 1G" returned: 0 in 0.915s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9f8da558-6912-4d00-a50e-32c9d7576c44 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8255fdaf-f9b1-419a-a7d9-68cd71e9dc26 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8255fdaf-f9b1-419a-a7d9-68cd71e9dc26.a6c80a96-9ed5-4a5c-ab42-fd41dd701be5 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:51 devstack sudo[107187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8255fdaf-f9b1-419a-a7d9-68cd71e9dc26 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8255fdaf-f9b1-419a-a7d9-68cd71e9dc26.a6c80a96-9ed5-4a5c-ab42-fd41dd701be5 Jul 08 02:06:51 devstack sudo[107187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:52 devstack sudo[107187]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:52 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9f8da558-6912-4d00-a50e-32c9d7576c44 tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8255fdaf-f9b1-419a-a7d9-68cd71e9dc26 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8255fdaf-f9b1-419a-a7d9-68cd71e9dc26.a6c80a96-9ed5-4a5c-ab42-fd41dd701be5" returned: 0 in 0.679s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:52 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-9f8da558-6912-4d00-a50e-32c9d7576c44 tempest-ProjectMemberTests-73815212 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8255fdaf-f9b1-419a-a7d9-68cd71e9dc26.a6c80a96-9ed5-4a5c-ab42-fd41dd701be5 is being set with open permissions: ugo+rw Jul 08 02:06:52 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9f8da558-6912-4d00-a50e-32c9d7576c44 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8255fdaf-f9b1-419a-a7d9-68cd71e9dc26.a6c80a96-9ed5-4a5c-ab42-fd41dd701be5 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:52 devstack sudo[107193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8255fdaf-f9b1-419a-a7d9-68cd71e9dc26.a6c80a96-9ed5-4a5c-ab42-fd41dd701be5 Jul 08 02:06:52 devstack sudo[107193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:53 devstack sudo[107193]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9f8da558-6912-4d00-a50e-32c9d7576c44 tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8255fdaf-f9b1-419a-a7d9-68cd71e9dc26.a6c80a96-9ed5-4a5c-ab42-fd41dd701be5" returned: 0 in 0.675s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9f8da558-6912-4d00-a50e-32c9d7576c44 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8255fdaf-f9b1-419a-a7d9-68cd71e9dc26.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:53 devstack sudo[107197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8255fdaf-f9b1-419a-a7d9-68cd71e9dc26.info Jul 08 02:06:53 devstack sudo[107197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:53 devstack sudo[107197]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9f8da558-6912-4d00-a50e-32c9d7576c44 tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8255fdaf-f9b1-419a-a7d9-68cd71e9dc26.info" returned: 0 in 0.660s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:53 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-9f8da558-6912-4d00-a50e-32c9d7576c44 tempest-ProjectMemberTests-73815212 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8255fdaf-f9b1-419a-a7d9-68cd71e9dc26.info is being set with open permissions: ugo+rw Jul 08 02:06:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9f8da558-6912-4d00-a50e-32c9d7576c44 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8255fdaf-f9b1-419a-a7d9-68cd71e9dc26.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:53 devstack sudo[107200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8255fdaf-f9b1-419a-a7d9-68cd71e9dc26.info Jul 08 02:06:53 devstack sudo[107200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:54 devstack sudo[107200]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9f8da558-6912-4d00-a50e-32c9d7576c44 tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8255fdaf-f9b1-419a-a7d9-68cd71e9dc26.info" returned: 0 in 0.668s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-9f8da558-6912-4d00-a50e-32c9d7576c44 tempest-ProjectMemberTests-73815212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.675s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:06:54 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-9f8da558-6912-4d00-a50e-32c9d7576c44 tempest-ProjectMemberTests-73815212 None] Create snapshot completed successfully Jul 08 02:06:55 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-2306052b-4e82-4fef-bd28-b58f84f4233b tempest-ProjectMemberTests-73815212 None] Acquiring lock "cinder-a6c80a96-9ed5-4a5c-ab42-fd41dd701be5-delete_snapshot" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:06:55 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-2306052b-4e82-4fef-bd28-b58f84f4233b tempest-ProjectMemberTests-73815212 None] Lock "cinder-a6c80a96-9ed5-4a5c-ab42-fd41dd701be5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:06:55 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-2306052b-4e82-4fef-bd28-b58f84f4233b tempest-ProjectMemberTests-73815212 None] Acquiring lock "cinder-quobyte-8255fdaf-f9b1-419a-a7d9-68cd71e9dc26" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:06:55 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-2306052b-4e82-4fef-bd28-b58f84f4233b tempest-ProjectMemberTests-73815212 None] Lock "cinder-quobyte-8255fdaf-f9b1-419a-a7d9-68cd71e9dc26" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:06:55 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-2306052b-4e82-4fef-bd28-b58f84f4233b tempest-ProjectMemberTests-73815212 None] Acquiring lock "cinder-quobyte-a6c80a96-9ed5-4a5c-ab42-fd41dd701be5" by "_delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:06:55 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-2306052b-4e82-4fef-bd28-b58f84f4233b tempest-ProjectMemberTests-73815212 None] Lock "cinder-quobyte-a6c80a96-9ed5-4a5c-ab42-fd41dd701be5" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:06:55 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-2306052b-4e82-4fef-bd28-b58f84f4233b tempest-ProjectMemberTests-73815212 None] Deleting offline snapshot a6c80a96-9ed5-4a5c-ab42-fd41dd701be5 of volume 8255fdaf-f9b1-419a-a7d9-68cd71e9dc26 {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 02:06:55 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-2306052b-4e82-4fef-bd28-b58f84f4233b tempest-ProjectMemberTests-73815212 None] snapshot_file for this snap is: volume-8255fdaf-f9b1-419a-a7d9-68cd71e9dc26.a6c80a96-9ed5-4a5c-ab42-fd41dd701be5 {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 02:06:55 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[e43a35eb-22fd-4fa7-997e-3423a687b8a6]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:06:55 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2306052b-4e82-4fef-bd28-b58f84f4233b tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8255fdaf-f9b1-419a-a7d9-68cd71e9dc26.a6c80a96-9ed5-4a5c-ab42-fd41dd701be5 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:55 devstack sudo[107203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8255fdaf-f9b1-419a-a7d9-68cd71e9dc26.a6c80a96-9ed5-4a5c-ab42-fd41dd701be5 Jul 08 02:06:55 devstack sudo[107203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:55 devstack sudo[107203]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:55 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2306052b-4e82-4fef-bd28-b58f84f4233b tempest-ProjectMemberTests-73815212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8255fdaf-f9b1-419a-a7d9-68cd71e9dc26.a6c80a96-9ed5-4a5c-ab42-fd41dd701be5" returned: 0 in 0.778s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:55 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-2306052b-4e82-4fef-bd28-b58f84f4233b tempest-ProjectMemberTests-73815212 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8255fdaf-f9b1-419a-a7d9-68cd71e9dc26(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:06:56 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55a8796-7d16-4ede-b7fb-3d9dc7ddb57c]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:06:56 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2306052b-4e82-4fef-bd28-b58f84f4233b tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8255fdaf-f9b1-419a-a7d9-68cd71e9dc26 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:56 devstack sudo[107208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8255fdaf-f9b1-419a-a7d9-68cd71e9dc26 Jul 08 02:06:56 devstack sudo[107208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:56 devstack sudo[107208]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:56 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2306052b-4e82-4fef-bd28-b58f84f4233b tempest-ProjectMemberTests-73815212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8255fdaf-f9b1-419a-a7d9-68cd71e9dc26" returned: 0 in 0.813s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:56 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2306052b-4e82-4fef-bd28-b58f84f4233b tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8255fdaf-f9b1-419a-a7d9-68cd71e9dc26.a6c80a96-9ed5-4a5c-ab42-fd41dd701be5 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:56 devstack sudo[107213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8255fdaf-f9b1-419a-a7d9-68cd71e9dc26.a6c80a96-9ed5-4a5c-ab42-fd41dd701be5 Jul 08 02:06:56 devstack sudo[107213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:57 devstack sudo[107213]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:57 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2306052b-4e82-4fef-bd28-b58f84f4233b tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8255fdaf-f9b1-419a-a7d9-68cd71e9dc26.a6c80a96-9ed5-4a5c-ab42-fd41dd701be5" returned: 0 in 0.837s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:57 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2306052b-4e82-4fef-bd28-b58f84f4233b tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8255fdaf-f9b1-419a-a7d9-68cd71e9dc26.a6c80a96-9ed5-4a5c-ab42-fd41dd701be5 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:57 devstack sudo[107218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8255fdaf-f9b1-419a-a7d9-68cd71e9dc26.a6c80a96-9ed5-4a5c-ab42-fd41dd701be5 Jul 08 02:06:57 devstack sudo[107218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:06:58 devstack sudo[107218]: pam_unix(sudo:session): session closed for user root Jul 08 02:06:58 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2306052b-4e82-4fef-bd28-b58f84f4233b tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8255fdaf-f9b1-419a-a7d9-68cd71e9dc26.a6c80a96-9ed5-4a5c-ab42-fd41dd701be5" returned: 0 in 0.656s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:06:58 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-2306052b-4e82-4fef-bd28-b58f84f4233b tempest-ProjectMemberTests-73815212 None] Lock "cinder-quobyte-a6c80a96-9ed5-4a5c-ab42-fd41dd701be5" released by "_delete_snapshot" :: held 3.185s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:06:58 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-2306052b-4e82-4fef-bd28-b58f84f4233b tempest-ProjectMemberTests-73815212 None] Lock "cinder-quobyte-8255fdaf-f9b1-419a-a7d9-68cd71e9dc26" released by "delete_snapshot" :: held 3.208s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:06:58 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-2306052b-4e82-4fef-bd28-b58f84f4233b tempest-ProjectMemberTests-73815212 None] Created reservations ['b5c53b25-1cbd-4792-9aec-37180cdb4124', '39c0cabb-826e-4820-a9e9-e732dfd73133', 'd6c73cd5-dcd3-477b-8a8b-82744a2b720b', '09b0c741-ee96-487b-a2bf-88c7b1b08fcf'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:06:58 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-2306052b-4e82-4fef-bd28-b58f84f4233b tempest-ProjectMemberTests-73815212 None] Delete snapshot completed successfully. Jul 08 02:06:58 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-2306052b-4e82-4fef-bd28-b58f84f4233b tempest-ProjectMemberTests-73815212 None] Lock "cinder-a6c80a96-9ed5-4a5c-ab42-fd41dd701be5-delete_snapshot" released by "delete_snapshot" :: held 3.378s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:06:59 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-29af4acc-3611-4619-8191-c061626bf71e tempest-ProjectMemberTests-73815212 None] Acquiring lock "cinder-8255fdaf-f9b1-419a-a7d9-68cd71e9dc26-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:06:59 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-29af4acc-3611-4619-8191-c061626bf71e tempest-ProjectMemberTests-73815212 None] Lock "cinder-8255fdaf-f9b1-419a-a7d9-68cd71e9dc26-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:06:59 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-29af4acc-3611-4619-8191-c061626bf71e tempest-ProjectMemberTests-73815212 None] Acquiring lock "cinder-quobyte-8255fdaf-f9b1-419a-a7d9-68cd71e9dc26" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:06:59 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-29af4acc-3611-4619-8191-c061626bf71e tempest-ProjectMemberTests-73815212 None] Lock "cinder-quobyte-8255fdaf-f9b1-419a-a7d9-68cd71e9dc26" acquired by "delete_volume" :: waited 0.017s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:06:59 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c0e5ec3-edb3-4b54-99bb-c4f8acd635ad]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:06:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-29af4acc-3611-4619-8191-c061626bf71e tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8255fdaf-f9b1-419a-a7d9-68cd71e9dc26 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:06:59 devstack sudo[107221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8255fdaf-f9b1-419a-a7d9-68cd71e9dc26 Jul 08 02:06:59 devstack sudo[107221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:07:00 devstack sudo[107221]: pam_unix(sudo:session): session closed for user root Jul 08 02:07:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-29af4acc-3611-4619-8191-c061626bf71e tempest-ProjectMemberTests-73815212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8255fdaf-f9b1-419a-a7d9-68cd71e9dc26" returned: 0 in 0.799s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:07:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-29af4acc-3611-4619-8191-c061626bf71e tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8255fdaf-f9b1-419a-a7d9-68cd71e9dc26 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:07:00 devstack sudo[107226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8255fdaf-f9b1-419a-a7d9-68cd71e9dc26 Jul 08 02:07:00 devstack sudo[107226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:07:00 devstack sudo[107226]: pam_unix(sudo:session): session closed for user root Jul 08 02:07:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-29af4acc-3611-4619-8191-c061626bf71e tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-8255fdaf-f9b1-419a-a7d9-68cd71e9dc26" returned: 0 in 0.712s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:07:01 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-29af4acc-3611-4619-8191-c061626bf71e tempest-ProjectMemberTests-73815212 None] Lock "cinder-quobyte-8255fdaf-f9b1-419a-a7d9-68cd71e9dc26" released by "delete_volume" :: held 1.573s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:07:01 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-29af4acc-3611-4619-8191-c061626bf71e tempest-ProjectMemberTests-73815212 None] Created reservations ['6b5c8530-d319-4d30-aad2-1d59ed77ac05', '7b764f26-3004-47f5-a6ab-2ffa9902e1dd', '199fed98-03f3-455c-a790-c5b8fec51350', '51f92aca-25dc-40d5-a387-7efaf215fd4a'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:07:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-29af4acc-3611-4619-8191-c061626bf71e tempest-ProjectMemberTests-73815212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:07:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-29af4acc-3611-4619-8191-c061626bf71e tempest-ProjectMemberTests-73815212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:07:01 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-29af4acc-3611-4619-8191-c061626bf71e tempest-ProjectMemberTests-73815212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:07:01 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-29af4acc-3611-4619-8191-c061626bf71e tempest-ProjectMemberTests-73815212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:07:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-29af4acc-3611-4619-8191-c061626bf71e tempest-ProjectMemberTests-73815212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:07:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-29af4acc-3611-4619-8191-c061626bf71e tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:07:01 devstack sudo[107229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 02:07:01 devstack sudo[107229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:07:01 devstack sudo[107229]: pam_unix(sudo:session): session closed for user root Jul 08 02:07:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-29af4acc-3611-4619-8191-c061626bf71e tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.708s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:07:01 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-29af4acc-3611-4619-8191-c061626bf71e tempest-ProjectMemberTests-73815212 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:07:01 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-29af4acc-3611-4619-8191-c061626bf71e tempest-ProjectMemberTests-73815212 None] Deleted volume successfully. Jul 08 02:07:01 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-29af4acc-3611-4619-8191-c061626bf71e tempest-ProjectMemberTests-73815212 None] Lock "cinder-8255fdaf-f9b1-419a-a7d9-68cd71e9dc26-delete_volume" released by "delete_volume" :: held 2.504s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:07:02 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5694d75-db58-45ad-a656-d860ed7ce2ef tempest-ProjectMemberTests-73815212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:07:02 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c5694d75-db58-45ad-a656-d860ed7ce2ef tempest-ProjectMemberTests-73815212 None] Flow 'volume_create_manager' (a5579316-2513-4202-bc9b-b3e5f791e781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:07:02 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c5694d75-db58-45ad-a656-d860ed7ce2ef tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51e8dbae-f45d-4520-9aaa-4776711083c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:07:02 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c5694d75-db58-45ad-a656-d860ed7ce2ef tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51e8dbae-f45d-4520-9aaa-4776711083c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:07:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1879080413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bd8a801-a0e3-4eac-afb0-d8a4ac1605a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f353d90ed9694fe88617e9c4eed37bf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:07:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:07:02Z,use_quota=True,user_id='6137db3fdb294c84a17fd39e57e13785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:07:02 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c5694d75-db58-45ad-a656-d860ed7ce2ef tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dae7e4ef-f9c1-46d7-b34b-6a855899886c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:07:02 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c5694d75-db58-45ad-a656-d860ed7ce2ef tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dae7e4ef-f9c1-46d7-b34b-6a855899886c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:07:02 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c5694d75-db58-45ad-a656-d860ed7ce2ef tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f453f00-2f3a-44ce-a46f-8f0c485039ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:07:02 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c5694d75-db58-45ad-a656-d860ed7ce2ef tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f453f00-2f3a-44ce-a46f-8f0c485039ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bd8a801-a0e3-4eac-afb0-d8a4ac1605a1', 'volume_name': 'volume-7bd8a801-a0e3-4eac-afb0-d8a4ac1605a1', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:07:02 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c5694d75-db58-45ad-a656-d860ed7ce2ef tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bac11c66-2739-4848-93dd-3c12ab635a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:07:02 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c5694d75-db58-45ad-a656-d860ed7ce2ef tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bac11c66-2739-4848-93dd-3c12ab635a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:07:02 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c5694d75-db58-45ad-a656-d860ed7ce2ef tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b934ebba-e214-450c-a326-2bf46209f7c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:07:02 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-c5694d75-db58-45ad-a656-d860ed7ce2ef tempest-ProjectMemberTests-73815212 None] Volume 7bd8a801-a0e3-4eac-afb0-d8a4ac1605a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bd8a801-a0e3-4eac-afb0-d8a4ac1605a1', 'volume_size': 1} Jul 08 02:07:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c5694d75-db58-45ad-a656-d860ed7ce2ef tempest-ProjectMemberTests-73815212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:07:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c5694d75-db58-45ad-a656-d860ed7ce2ef tempest-ProjectMemberTests-73815212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:07:02 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-c5694d75-db58-45ad-a656-d860ed7ce2ef tempest-ProjectMemberTests-73815212 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:07:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1879080413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bd8a801-a0e3-4eac-afb0-d8a4ac1605a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f353d90ed9694fe88617e9c4eed37bf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:07:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:07:02Z,use_quota=True,user_id='6137db3fdb294c84a17fd39e57e13785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:07:02 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-c5694d75-db58-45ad-a656-d860ed7ce2ef tempest-ProjectMemberTests-73815212 None] Creating volume 7bd8a801-a0e3-4eac-afb0-d8a4ac1605a1 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:07:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c5694d75-db58-45ad-a656-d860ed7ce2ef tempest-ProjectMemberTests-73815212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:07:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c5694d75-db58-45ad-a656-d860ed7ce2ef tempest-ProjectMemberTests-73815212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:07:02 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-c5694d75-db58-45ad-a656-d860ed7ce2ef tempest-ProjectMemberTests-73815212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:07:02 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-c5694d75-db58-45ad-a656-d860ed7ce2ef tempest-ProjectMemberTests-73815212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:07:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c5694d75-db58-45ad-a656-d860ed7ce2ef tempest-ProjectMemberTests-73815212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:07:02 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-c5694d75-db58-45ad-a656-d860ed7ce2ef tempest-ProjectMemberTests-73815212 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:07:02 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-c5694d75-db58-45ad-a656-d860ed7ce2ef tempest-ProjectMemberTests-73815212 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 02:07:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c5694d75-db58-45ad-a656-d860ed7ce2ef tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7bd8a801-a0e3-4eac-afb0-d8a4ac1605a1 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:07:02 devstack sudo[107232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7bd8a801-a0e3-4eac-afb0-d8a4ac1605a1 1073741824 Jul 08 02:07:02 devstack sudo[107232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:07:03 devstack sudo[107232]: pam_unix(sudo:session): session closed for user root Jul 08 02:07:03 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c5694d75-db58-45ad-a656-d860ed7ce2ef tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7bd8a801-a0e3-4eac-afb0-d8a4ac1605a1 1073741824" returned: 0 in 0.902s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:07:03 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c5694d75-db58-45ad-a656-d860ed7ce2ef tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7bd8a801-a0e3-4eac-afb0-d8a4ac1605a1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:07:03 devstack sudo[107237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7bd8a801-a0e3-4eac-afb0-d8a4ac1605a1 Jul 08 02:07:03 devstack sudo[107237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:07:03 devstack sudo[107237]: pam_unix(sudo:session): session closed for user root Jul 08 02:07:03 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c5694d75-db58-45ad-a656-d860ed7ce2ef tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7bd8a801-a0e3-4eac-afb0-d8a4ac1605a1" returned: 0 in 0.744s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:07:03 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-c5694d75-db58-45ad-a656-d860ed7ce2ef tempest-ProjectMemberTests-73815212 None] <== create_volume: return (1736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:07:03 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c5694d75-db58-45ad-a656-d860ed7ce2ef tempest-ProjectMemberTests-73815212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.739s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:07:03 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c5694d75-db58-45ad-a656-d860ed7ce2ef tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b934ebba-e214-450c-a326-2bf46209f7c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bd8a801-a0e3-4eac-afb0-d8a4ac1605a1', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:07:03 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c5694d75-db58-45ad-a656-d860ed7ce2ef tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54b8f924-f5bd-4f86-95cc-34025bc7c7ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:07:03 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-c5694d75-db58-45ad-a656-d860ed7ce2ef tempest-ProjectMemberTests-73815212 None] Volume volume-7bd8a801-a0e3-4eac-afb0-d8a4ac1605a1 (7bd8a801-a0e3-4eac-afb0-d8a4ac1605a1): created successfully Jul 08 02:07:03 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c5694d75-db58-45ad-a656-d860ed7ce2ef tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54b8f924-f5bd-4f86-95cc-34025bc7c7ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:07:03 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c5694d75-db58-45ad-a656-d860ed7ce2ef tempest-ProjectMemberTests-73815212 None] Flow 'volume_create_manager' (a5579316-2513-4202-bc9b-b3e5f791e781) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:07:04 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-c5694d75-db58-45ad-a656-d860ed7ce2ef tempest-ProjectMemberTests-73815212 None] Created volume successfully. Jul 08 02:07:04 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-41806f5a-22a0-490c-90e3-1e2e9ff96712 tempest-ProjectMemberTests-73815212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:07:04 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-41806f5a-22a0-490c-90e3-1e2e9ff96712 tempest-ProjectMemberTests-73815212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:07:04 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-41806f5a-22a0-490c-90e3-1e2e9ff96712 tempest-ProjectMemberTests-73815212 None] Creating offline snapshot 88537add-6024-47e5-b8d0-576f9dae7885 of volume 7bd8a801-a0e3-4eac-afb0-d8a4ac1605a1 {{(pid=87134) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 02:07:04 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[a36b2e6c-6ef7-4a00-83a6-15f1fc08a102]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:07:04 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-41806f5a-22a0-490c-90e3-1e2e9ff96712 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7bd8a801-a0e3-4eac-afb0-d8a4ac1605a1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:07:04 devstack sudo[107243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7bd8a801-a0e3-4eac-afb0-d8a4ac1605a1 Jul 08 02:07:04 devstack sudo[107243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:07:05 devstack sudo[107243]: pam_unix(sudo:session): session closed for user root Jul 08 02:07:05 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-41806f5a-22a0-490c-90e3-1e2e9ff96712 tempest-ProjectMemberTests-73815212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7bd8a801-a0e3-4eac-afb0-d8a4ac1605a1" returned: 0 in 0.821s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:07:05 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-41806f5a-22a0-490c-90e3-1e2e9ff96712 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7bd8a801-a0e3-4eac-afb0-d8a4ac1605a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7bd8a801-a0e3-4eac-afb0-d8a4ac1605a1.88537add-6024-47e5-b8d0-576f9dae7885 1G {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:07:05 devstack sudo[107248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7bd8a801-a0e3-4eac-afb0-d8a4ac1605a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7bd8a801-a0e3-4eac-afb0-d8a4ac1605a1.88537add-6024-47e5-b8d0-576f9dae7885 1G Jul 08 02:07:05 devstack sudo[107248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:07:06 devstack sudo[107248]: pam_unix(sudo:session): session closed for user root Jul 08 02:07:06 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-41806f5a-22a0-490c-90e3-1e2e9ff96712 tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7bd8a801-a0e3-4eac-afb0-d8a4ac1605a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7bd8a801-a0e3-4eac-afb0-d8a4ac1605a1.88537add-6024-47e5-b8d0-576f9dae7885 1G" returned: 0 in 0.860s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:07:06 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-41806f5a-22a0-490c-90e3-1e2e9ff96712 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7bd8a801-a0e3-4eac-afb0-d8a4ac1605a1 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7bd8a801-a0e3-4eac-afb0-d8a4ac1605a1.88537add-6024-47e5-b8d0-576f9dae7885 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:07:06 devstack sudo[107253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7bd8a801-a0e3-4eac-afb0-d8a4ac1605a1 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7bd8a801-a0e3-4eac-afb0-d8a4ac1605a1.88537add-6024-47e5-b8d0-576f9dae7885 Jul 08 02:07:06 devstack sudo[107253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:07:06 devstack sudo[107253]: pam_unix(sudo:session): session closed for user root Jul 08 02:07:06 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-41806f5a-22a0-490c-90e3-1e2e9ff96712 tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7bd8a801-a0e3-4eac-afb0-d8a4ac1605a1 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7bd8a801-a0e3-4eac-afb0-d8a4ac1605a1.88537add-6024-47e5-b8d0-576f9dae7885" returned: 0 in 0.707s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:07:06 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-41806f5a-22a0-490c-90e3-1e2e9ff96712 tempest-ProjectMemberTests-73815212 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7bd8a801-a0e3-4eac-afb0-d8a4ac1605a1.88537add-6024-47e5-b8d0-576f9dae7885 is being set with open permissions: ugo+rw Jul 08 02:07:06 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-41806f5a-22a0-490c-90e3-1e2e9ff96712 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7bd8a801-a0e3-4eac-afb0-d8a4ac1605a1.88537add-6024-47e5-b8d0-576f9dae7885 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:07:06 devstack sudo[107258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7bd8a801-a0e3-4eac-afb0-d8a4ac1605a1.88537add-6024-47e5-b8d0-576f9dae7885 Jul 08 02:07:06 devstack sudo[107258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:07:07 devstack sudo[107258]: pam_unix(sudo:session): session closed for user root Jul 08 02:07:07 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-41806f5a-22a0-490c-90e3-1e2e9ff96712 tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7bd8a801-a0e3-4eac-afb0-d8a4ac1605a1.88537add-6024-47e5-b8d0-576f9dae7885" returned: 0 in 0.690s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:07:07 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-41806f5a-22a0-490c-90e3-1e2e9ff96712 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7bd8a801-a0e3-4eac-afb0-d8a4ac1605a1.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:07:07 devstack sudo[107261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7bd8a801-a0e3-4eac-afb0-d8a4ac1605a1.info Jul 08 02:07:07 devstack sudo[107261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:07:08 devstack sudo[107261]: pam_unix(sudo:session): session closed for user root Jul 08 02:07:08 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-41806f5a-22a0-490c-90e3-1e2e9ff96712 tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7bd8a801-a0e3-4eac-afb0-d8a4ac1605a1.info" returned: 0 in 0.680s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:07:08 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-41806f5a-22a0-490c-90e3-1e2e9ff96712 tempest-ProjectMemberTests-73815212 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7bd8a801-a0e3-4eac-afb0-d8a4ac1605a1.info is being set with open permissions: ugo+rw Jul 08 02:07:08 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-41806f5a-22a0-490c-90e3-1e2e9ff96712 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7bd8a801-a0e3-4eac-afb0-d8a4ac1605a1.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:07:08 devstack sudo[107264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7bd8a801-a0e3-4eac-afb0-d8a4ac1605a1.info Jul 08 02:07:08 devstack sudo[107264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:07:08 devstack sudo[107264]: pam_unix(sudo:session): session closed for user root Jul 08 02:07:08 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-41806f5a-22a0-490c-90e3-1e2e9ff96712 tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7bd8a801-a0e3-4eac-afb0-d8a4ac1605a1.info" returned: 0 in 0.676s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:07:08 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-41806f5a-22a0-490c-90e3-1e2e9ff96712 tempest-ProjectMemberTests-73815212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.523s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:07:08 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-41806f5a-22a0-490c-90e3-1e2e9ff96712 tempest-ProjectMemberTests-73815212 None] Create snapshot completed successfully Jul 08 02:07:09 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-41781ddf-ac4c-44d8-be04-0817f152785f tempest-ProjectMemberTests-73815212 None] Acquiring lock "cinder-88537add-6024-47e5-b8d0-576f9dae7885-delete_snapshot" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:07:09 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-41781ddf-ac4c-44d8-be04-0817f152785f tempest-ProjectMemberTests-73815212 None] Lock "cinder-88537add-6024-47e5-b8d0-576f9dae7885-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:07:09 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-41781ddf-ac4c-44d8-be04-0817f152785f tempest-ProjectMemberTests-73815212 None] Acquiring lock "cinder-quobyte-7bd8a801-a0e3-4eac-afb0-d8a4ac1605a1" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:07:09 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-41781ddf-ac4c-44d8-be04-0817f152785f tempest-ProjectMemberTests-73815212 None] Lock "cinder-quobyte-7bd8a801-a0e3-4eac-afb0-d8a4ac1605a1" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:07:09 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-41781ddf-ac4c-44d8-be04-0817f152785f tempest-ProjectMemberTests-73815212 None] Acquiring lock "cinder-quobyte-88537add-6024-47e5-b8d0-576f9dae7885" by "_delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:07:09 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-41781ddf-ac4c-44d8-be04-0817f152785f tempest-ProjectMemberTests-73815212 None] Lock "cinder-quobyte-88537add-6024-47e5-b8d0-576f9dae7885" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:07:09 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-41781ddf-ac4c-44d8-be04-0817f152785f tempest-ProjectMemberTests-73815212 None] Deleting offline snapshot 88537add-6024-47e5-b8d0-576f9dae7885 of volume 7bd8a801-a0e3-4eac-afb0-d8a4ac1605a1 {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 02:07:09 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-41781ddf-ac4c-44d8-be04-0817f152785f tempest-ProjectMemberTests-73815212 None] snapshot_file for this snap is: volume-7bd8a801-a0e3-4eac-afb0-d8a4ac1605a1.88537add-6024-47e5-b8d0-576f9dae7885 {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 02:07:09 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[405e76ee-8bd7-4b48-b27b-d328904144c3]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:07:09 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-41781ddf-ac4c-44d8-be04-0817f152785f tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7bd8a801-a0e3-4eac-afb0-d8a4ac1605a1.88537add-6024-47e5-b8d0-576f9dae7885 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:07:09 devstack sudo[107268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7bd8a801-a0e3-4eac-afb0-d8a4ac1605a1.88537add-6024-47e5-b8d0-576f9dae7885 Jul 08 02:07:09 devstack sudo[107268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:07:10 devstack sudo[107268]: pam_unix(sudo:session): session closed for user root Jul 08 02:07:10 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-41781ddf-ac4c-44d8-be04-0817f152785f tempest-ProjectMemberTests-73815212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7bd8a801-a0e3-4eac-afb0-d8a4ac1605a1.88537add-6024-47e5-b8d0-576f9dae7885" returned: 0 in 0.787s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:07:10 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-41781ddf-ac4c-44d8-be04-0817f152785f tempest-ProjectMemberTests-73815212 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7bd8a801-a0e3-4eac-afb0-d8a4ac1605a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:07:10 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc50de0c-9dcd-4fb7-aa77-1c42722ba60f]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:07:10 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-41781ddf-ac4c-44d8-be04-0817f152785f tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7bd8a801-a0e3-4eac-afb0-d8a4ac1605a1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:07:10 devstack sudo[107273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7bd8a801-a0e3-4eac-afb0-d8a4ac1605a1 Jul 08 02:07:10 devstack sudo[107273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:07:11 devstack sudo[107273]: pam_unix(sudo:session): session closed for user root Jul 08 02:07:11 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-41781ddf-ac4c-44d8-be04-0817f152785f tempest-ProjectMemberTests-73815212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7bd8a801-a0e3-4eac-afb0-d8a4ac1605a1" returned: 0 in 0.801s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:07:11 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-41781ddf-ac4c-44d8-be04-0817f152785f tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7bd8a801-a0e3-4eac-afb0-d8a4ac1605a1.88537add-6024-47e5-b8d0-576f9dae7885 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:07:11 devstack sudo[107280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7bd8a801-a0e3-4eac-afb0-d8a4ac1605a1.88537add-6024-47e5-b8d0-576f9dae7885 Jul 08 02:07:11 devstack sudo[107280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:07:12 devstack sudo[107280]: pam_unix(sudo:session): session closed for user root Jul 08 02:07:12 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-41781ddf-ac4c-44d8-be04-0817f152785f tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7bd8a801-a0e3-4eac-afb0-d8a4ac1605a1.88537add-6024-47e5-b8d0-576f9dae7885" returned: 0 in 0.767s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:07:12 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-41781ddf-ac4c-44d8-be04-0817f152785f tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7bd8a801-a0e3-4eac-afb0-d8a4ac1605a1.88537add-6024-47e5-b8d0-576f9dae7885 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:07:12 devstack sudo[107285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7bd8a801-a0e3-4eac-afb0-d8a4ac1605a1.88537add-6024-47e5-b8d0-576f9dae7885 Jul 08 02:07:12 devstack sudo[107285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:07:12 devstack sudo[107285]: pam_unix(sudo:session): session closed for user root Jul 08 02:07:12 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-41781ddf-ac4c-44d8-be04-0817f152785f tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7bd8a801-a0e3-4eac-afb0-d8a4ac1605a1.88537add-6024-47e5-b8d0-576f9dae7885" returned: 0 in 0.709s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:07:12 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-41781ddf-ac4c-44d8-be04-0817f152785f tempest-ProjectMemberTests-73815212 None] Lock "cinder-quobyte-88537add-6024-47e5-b8d0-576f9dae7885" released by "_delete_snapshot" :: held 3.169s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:07:12 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-41781ddf-ac4c-44d8-be04-0817f152785f tempest-ProjectMemberTests-73815212 None] Lock "cinder-quobyte-7bd8a801-a0e3-4eac-afb0-d8a4ac1605a1" released by "delete_snapshot" :: held 3.191s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:07:12 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-41781ddf-ac4c-44d8-be04-0817f152785f tempest-ProjectMemberTests-73815212 None] Created reservations ['5ad35501-3f3e-4a4a-9b89-c4afc25d6e95', 'da32f660-145c-444f-bc60-e1497d1977e1', 'c4b495af-a0a9-400b-bdfa-152cce474e97', '00ef77dd-61b4-4163-bc8c-249ad6ce1cce'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:07:12 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-41781ddf-ac4c-44d8-be04-0817f152785f tempest-ProjectMemberTests-73815212 None] Delete snapshot completed successfully. Jul 08 02:07:12 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-41781ddf-ac4c-44d8-be04-0817f152785f tempest-ProjectMemberTests-73815212 None] Lock "cinder-88537add-6024-47e5-b8d0-576f9dae7885-delete_snapshot" released by "delete_snapshot" :: held 3.331s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:07:13 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-84a49575-e23c-462f-ac44-dec3891a9b8f tempest-ProjectMemberTests-73815212 None] Acquiring lock "cinder-7bd8a801-a0e3-4eac-afb0-d8a4ac1605a1-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:07:13 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-84a49575-e23c-462f-ac44-dec3891a9b8f tempest-ProjectMemberTests-73815212 None] Lock "cinder-7bd8a801-a0e3-4eac-afb0-d8a4ac1605a1-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:07:13 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-84a49575-e23c-462f-ac44-dec3891a9b8f tempest-ProjectMemberTests-73815212 None] Acquiring lock "cinder-quobyte-7bd8a801-a0e3-4eac-afb0-d8a4ac1605a1" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:07:13 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-84a49575-e23c-462f-ac44-dec3891a9b8f tempest-ProjectMemberTests-73815212 None] Lock "cinder-quobyte-7bd8a801-a0e3-4eac-afb0-d8a4ac1605a1" acquired by "delete_volume" :: waited 0.017s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:07:13 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b6bd8bc-c902-45b6-a89a-9be459cddc5b]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:07:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-84a49575-e23c-462f-ac44-dec3891a9b8f tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7bd8a801-a0e3-4eac-afb0-d8a4ac1605a1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:07:14 devstack sudo[107289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7bd8a801-a0e3-4eac-afb0-d8a4ac1605a1 Jul 08 02:07:14 devstack sudo[107289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:07:14 devstack sudo[107289]: pam_unix(sudo:session): session closed for user root Jul 08 02:07:14 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-84a49575-e23c-462f-ac44-dec3891a9b8f tempest-ProjectMemberTests-73815212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7bd8a801-a0e3-4eac-afb0-d8a4ac1605a1" returned: 0 in 0.825s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:07:14 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-84a49575-e23c-462f-ac44-dec3891a9b8f tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7bd8a801-a0e3-4eac-afb0-d8a4ac1605a1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:07:14 devstack sudo[107294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7bd8a801-a0e3-4eac-afb0-d8a4ac1605a1 Jul 08 02:07:14 devstack sudo[107294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:07:15 devstack sudo[107294]: pam_unix(sudo:session): session closed for user root Jul 08 02:07:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-84a49575-e23c-462f-ac44-dec3891a9b8f tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-7bd8a801-a0e3-4eac-afb0-d8a4ac1605a1" returned: 0 in 0.702s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:07:15 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-84a49575-e23c-462f-ac44-dec3891a9b8f tempest-ProjectMemberTests-73815212 None] Lock "cinder-quobyte-7bd8a801-a0e3-4eac-afb0-d8a4ac1605a1" released by "delete_volume" :: held 1.592s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:07:15 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-84a49575-e23c-462f-ac44-dec3891a9b8f tempest-ProjectMemberTests-73815212 None] Created reservations ['cb4a549c-1c4d-4be0-afc2-5a337481e4a5', 'f87005c4-71e9-431e-a29b-01b634ac4fc6', 'b9cb027b-c8b8-4907-9cc5-ea447f7f125c', 'fee8ba85-ddb4-4bca-a49e-4aa05be19371'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:07:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-84a49575-e23c-462f-ac44-dec3891a9b8f tempest-ProjectMemberTests-73815212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:07:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-84a49575-e23c-462f-ac44-dec3891a9b8f tempest-ProjectMemberTests-73815212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:07:15 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-84a49575-e23c-462f-ac44-dec3891a9b8f tempest-ProjectMemberTests-73815212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:07:15 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-84a49575-e23c-462f-ac44-dec3891a9b8f tempest-ProjectMemberTests-73815212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:07:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-84a49575-e23c-462f-ac44-dec3891a9b8f tempest-ProjectMemberTests-73815212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:07:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-84a49575-e23c-462f-ac44-dec3891a9b8f tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:07:15 devstack sudo[107297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 02:07:15 devstack sudo[107297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:07:16 devstack sudo[107297]: pam_unix(sudo:session): session closed for user root Jul 08 02:07:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-84a49575-e23c-462f-ac44-dec3891a9b8f tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.724s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:07:16 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-84a49575-e23c-462f-ac44-dec3891a9b8f tempest-ProjectMemberTests-73815212 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:07:16 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-84a49575-e23c-462f-ac44-dec3891a9b8f tempest-ProjectMemberTests-73815212 None] Deleted volume successfully. Jul 08 02:07:16 devstack cinder-volume[87134]: DEBUG dbcounter [-] [87134] Writing DB stats cinder:SELECT=99,cinder:UPDATE=138,cinder:INSERT=39,cinder:DELETE=12 {{(pid=87134) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:07:16 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-84a49575-e23c-462f-ac44-dec3891a9b8f tempest-ProjectMemberTests-73815212 None] Lock "cinder-7bd8a801-a0e3-4eac-afb0-d8a4ac1605a1-delete_volume" released by "delete_volume" :: held 2.547s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:07:16 devstack cinder-volume[87134]: DEBUG dbcounter [-] [87134] Writing DB stats cinder:SELECT=100,cinder:INSERT=32,cinder:UPDATE=133,cinder:DELETE=10 {{(pid=87134) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:07:16 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-429d30e8-1ed6-4cbd-9aa6-a8cbf24b87f9 tempest-ProjectMemberTests-73815212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:07:16 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-429d30e8-1ed6-4cbd-9aa6-a8cbf24b87f9 tempest-ProjectMemberTests-73815212 None] Flow 'volume_create_manager' (7eab1d08-29e8-439b-ac4c-3f51fb4a3d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:07:16 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-429d30e8-1ed6-4cbd-9aa6-a8cbf24b87f9 tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb841434-4bee-4131-a61b-31c6d5cf2ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:07:16 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-429d30e8-1ed6-4cbd-9aa6-a8cbf24b87f9 tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb841434-4bee-4131-a61b-31c6d5cf2ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:07:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1071056468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c7a10a7-440e-43f3-891b-4377a496b925,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f353d90ed9694fe88617e9c4eed37bf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:07:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:07:17Z,use_quota=True,user_id='6137db3fdb294c84a17fd39e57e13785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:07:16 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-429d30e8-1ed6-4cbd-9aa6-a8cbf24b87f9 tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (832e835b-d509-4b82-959d-9115f4361668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:07:16 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-429d30e8-1ed6-4cbd-9aa6-a8cbf24b87f9 tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (832e835b-d509-4b82-959d-9115f4361668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:07:16 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-429d30e8-1ed6-4cbd-9aa6-a8cbf24b87f9 tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaf28133-a5bb-49e7-bdcc-1c1ee42473bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:07:16 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-429d30e8-1ed6-4cbd-9aa6-a8cbf24b87f9 tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaf28133-a5bb-49e7-bdcc-1c1ee42473bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c7a10a7-440e-43f3-891b-4377a496b925', 'volume_name': 'volume-5c7a10a7-440e-43f3-891b-4377a496b925', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:07:16 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-429d30e8-1ed6-4cbd-9aa6-a8cbf24b87f9 tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89b895ff-faa3-45e6-90cc-c641fc42514e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:07:16 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-429d30e8-1ed6-4cbd-9aa6-a8cbf24b87f9 tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89b895ff-faa3-45e6-90cc-c641fc42514e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:07:16 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-429d30e8-1ed6-4cbd-9aa6-a8cbf24b87f9 tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bef4dd12-b7c7-4cad-a082-48b4b53c15fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:07:16 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-429d30e8-1ed6-4cbd-9aa6-a8cbf24b87f9 tempest-ProjectMemberTests-73815212 None] Volume 5c7a10a7-440e-43f3-891b-4377a496b925: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c7a10a7-440e-43f3-891b-4377a496b925', 'volume_size': 1} Jul 08 02:07:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-429d30e8-1ed6-4cbd-9aa6-a8cbf24b87f9 tempest-ProjectMemberTests-73815212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:07:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-429d30e8-1ed6-4cbd-9aa6-a8cbf24b87f9 tempest-ProjectMemberTests-73815212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:07:16 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-429d30e8-1ed6-4cbd-9aa6-a8cbf24b87f9 tempest-ProjectMemberTests-73815212 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:07:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1071056468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c7a10a7-440e-43f3-891b-4377a496b925,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f353d90ed9694fe88617e9c4eed37bf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:07:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:07:17Z,use_quota=True,user_id='6137db3fdb294c84a17fd39e57e13785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:07:16 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-429d30e8-1ed6-4cbd-9aa6-a8cbf24b87f9 tempest-ProjectMemberTests-73815212 None] Creating volume 5c7a10a7-440e-43f3-891b-4377a496b925 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:07:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-429d30e8-1ed6-4cbd-9aa6-a8cbf24b87f9 tempest-ProjectMemberTests-73815212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:07:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-429d30e8-1ed6-4cbd-9aa6-a8cbf24b87f9 tempest-ProjectMemberTests-73815212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:07:16 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-429d30e8-1ed6-4cbd-9aa6-a8cbf24b87f9 tempest-ProjectMemberTests-73815212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:07:16 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-429d30e8-1ed6-4cbd-9aa6-a8cbf24b87f9 tempest-ProjectMemberTests-73815212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:07:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-429d30e8-1ed6-4cbd-9aa6-a8cbf24b87f9 tempest-ProjectMemberTests-73815212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:07:16 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-429d30e8-1ed6-4cbd-9aa6-a8cbf24b87f9 tempest-ProjectMemberTests-73815212 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:07:16 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-429d30e8-1ed6-4cbd-9aa6-a8cbf24b87f9 tempest-ProjectMemberTests-73815212 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 02:07:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-429d30e8-1ed6-4cbd-9aa6-a8cbf24b87f9 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-5c7a10a7-440e-43f3-891b-4377a496b925 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:07:16 devstack sudo[107300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-5c7a10a7-440e-43f3-891b-4377a496b925 1073741824 Jul 08 02:07:16 devstack sudo[107300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:07:17 devstack sudo[107300]: pam_unix(sudo:session): session closed for user root Jul 08 02:07:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-429d30e8-1ed6-4cbd-9aa6-a8cbf24b87f9 tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-5c7a10a7-440e-43f3-891b-4377a496b925 1073741824" returned: 0 in 0.861s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:07:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-429d30e8-1ed6-4cbd-9aa6-a8cbf24b87f9 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-5c7a10a7-440e-43f3-891b-4377a496b925 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:07:17 devstack sudo[107306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-5c7a10a7-440e-43f3-891b-4377a496b925 Jul 08 02:07:17 devstack sudo[107306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:07:18 devstack sudo[107306]: pam_unix(sudo:session): session closed for user root Jul 08 02:07:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-429d30e8-1ed6-4cbd-9aa6-a8cbf24b87f9 tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-5c7a10a7-440e-43f3-891b-4377a496b925" returned: 0 in 0.690s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:07:18 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-429d30e8-1ed6-4cbd-9aa6-a8cbf24b87f9 tempest-ProjectMemberTests-73815212 None] <== create_volume: return (1594ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:07:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-429d30e8-1ed6-4cbd-9aa6-a8cbf24b87f9 tempest-ProjectMemberTests-73815212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.596s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:07:18 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-429d30e8-1ed6-4cbd-9aa6-a8cbf24b87f9 tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bef4dd12-b7c7-4cad-a082-48b4b53c15fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c7a10a7-440e-43f3-891b-4377a496b925', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:07:18 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-429d30e8-1ed6-4cbd-9aa6-a8cbf24b87f9 tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79eed5a8-5d08-4ac5-87c4-44e589edf07c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:07:18 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-429d30e8-1ed6-4cbd-9aa6-a8cbf24b87f9 tempest-ProjectMemberTests-73815212 None] Volume volume-5c7a10a7-440e-43f3-891b-4377a496b925 (5c7a10a7-440e-43f3-891b-4377a496b925): created successfully Jul 08 02:07:18 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-429d30e8-1ed6-4cbd-9aa6-a8cbf24b87f9 tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79eed5a8-5d08-4ac5-87c4-44e589edf07c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:07:18 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-429d30e8-1ed6-4cbd-9aa6-a8cbf24b87f9 tempest-ProjectMemberTests-73815212 None] Flow 'volume_create_manager' (7eab1d08-29e8-439b-ac4c-3f51fb4a3d22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:07:18 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-429d30e8-1ed6-4cbd-9aa6-a8cbf24b87f9 tempest-ProjectMemberTests-73815212 None] Created volume successfully. Jul 08 02:07:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-516d48c6-81ea-4a45-86ea-6ac6897648f2 tempest-ProjectMemberTests-73815212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:07:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-516d48c6-81ea-4a45-86ea-6ac6897648f2 tempest-ProjectMemberTests-73815212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:07:18 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-516d48c6-81ea-4a45-86ea-6ac6897648f2 tempest-ProjectMemberTests-73815212 None] Creating offline snapshot f98b9415-6747-4bd5-b8cb-6f17166a2921 of volume 5c7a10a7-440e-43f3-891b-4377a496b925 {{(pid=87134) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 02:07:18 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd914c40-f14c-4da1-95b6-9eb9c910fab0]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:07:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-516d48c6-81ea-4a45-86ea-6ac6897648f2 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-5c7a10a7-440e-43f3-891b-4377a496b925 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:07:19 devstack sudo[107310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-5c7a10a7-440e-43f3-891b-4377a496b925 Jul 08 02:07:19 devstack sudo[107310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:07:19 devstack sudo[107310]: pam_unix(sudo:session): session closed for user root Jul 08 02:07:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-516d48c6-81ea-4a45-86ea-6ac6897648f2 tempest-ProjectMemberTests-73815212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-5c7a10a7-440e-43f3-891b-4377a496b925" returned: 0 in 0.885s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:07:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-516d48c6-81ea-4a45-86ea-6ac6897648f2 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-5c7a10a7-440e-43f3-891b-4377a496b925,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-5c7a10a7-440e-43f3-891b-4377a496b925.f98b9415-6747-4bd5-b8cb-6f17166a2921 1G {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:07:19 devstack sudo[107315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-5c7a10a7-440e-43f3-891b-4377a496b925,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-5c7a10a7-440e-43f3-891b-4377a496b925.f98b9415-6747-4bd5-b8cb-6f17166a2921 1G Jul 08 02:07:19 devstack sudo[107315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:07:20 devstack sudo[107315]: pam_unix(sudo:session): session closed for user root Jul 08 02:07:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-516d48c6-81ea-4a45-86ea-6ac6897648f2 tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-5c7a10a7-440e-43f3-891b-4377a496b925,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-5c7a10a7-440e-43f3-891b-4377a496b925.f98b9415-6747-4bd5-b8cb-6f17166a2921 1G" returned: 0 in 0.891s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:07:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-516d48c6-81ea-4a45-86ea-6ac6897648f2 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c7a10a7-440e-43f3-891b-4377a496b925 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-5c7a10a7-440e-43f3-891b-4377a496b925.f98b9415-6747-4bd5-b8cb-6f17166a2921 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:07:20 devstack sudo[107321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c7a10a7-440e-43f3-891b-4377a496b925 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-5c7a10a7-440e-43f3-891b-4377a496b925.f98b9415-6747-4bd5-b8cb-6f17166a2921 Jul 08 02:07:20 devstack sudo[107321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:07:20 devstack cinder-volume[87134]: DEBUG oslo_service.periodic_task [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87134) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 02:07:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:07:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:07:20 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:07:20 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:07:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:07:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:07:20 devstack sudo[107323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 02:07:20 devstack sudo[107323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:07:21 devstack sudo[107321]: pam_unix(sudo:session): session closed for user root Jul 08 02:07:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-516d48c6-81ea-4a45-86ea-6ac6897648f2 tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c7a10a7-440e-43f3-891b-4377a496b925 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-5c7a10a7-440e-43f3-891b-4377a496b925.f98b9415-6747-4bd5-b8cb-6f17166a2921" returned: 0 in 0.761s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:07:21 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-516d48c6-81ea-4a45-86ea-6ac6897648f2 tempest-ProjectMemberTests-73815212 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-5c7a10a7-440e-43f3-891b-4377a496b925.f98b9415-6747-4bd5-b8cb-6f17166a2921 is being set with open permissions: ugo+rw Jul 08 02:07:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-516d48c6-81ea-4a45-86ea-6ac6897648f2 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-5c7a10a7-440e-43f3-891b-4377a496b925.f98b9415-6747-4bd5-b8cb-6f17166a2921 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:07:21 devstack sudo[107328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-5c7a10a7-440e-43f3-891b-4377a496b925.f98b9415-6747-4bd5-b8cb-6f17166a2921 Jul 08 02:07:21 devstack sudo[107328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:07:21 devstack sudo[107323]: pam_unix(sudo:session): session closed for user root Jul 08 02:07:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.876s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:07:21 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:07:21 devstack cinder-volume[87134]: DEBUG oslo_service.periodic_task [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running periodic task VolumeManager._thread_info {{(pid=87134) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 02:07:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] thread count: 28 {{(pid=87134) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 02:07:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] thread info: [<_MainThread(MainThread, started 129378964615296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87134) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 02:07:22 devstack sudo[107328]: pam_unix(sudo:session): session closed for user root Jul 08 02:07:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-516d48c6-81ea-4a45-86ea-6ac6897648f2 tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-5c7a10a7-440e-43f3-891b-4377a496b925.f98b9415-6747-4bd5-b8cb-6f17166a2921" returned: 0 in 0.694s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:07:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-516d48c6-81ea-4a45-86ea-6ac6897648f2 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-5c7a10a7-440e-43f3-891b-4377a496b925.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:07:22 devstack sudo[107332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-5c7a10a7-440e-43f3-891b-4377a496b925.info Jul 08 02:07:22 devstack sudo[107332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:07:22 devstack sudo[107332]: pam_unix(sudo:session): session closed for user root Jul 08 02:07:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-516d48c6-81ea-4a45-86ea-6ac6897648f2 tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-5c7a10a7-440e-43f3-891b-4377a496b925.info" returned: 0 in 0.668s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:07:22 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-516d48c6-81ea-4a45-86ea-6ac6897648f2 tempest-ProjectMemberTests-73815212 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-5c7a10a7-440e-43f3-891b-4377a496b925.info is being set with open permissions: ugo+rw Jul 08 02:07:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-516d48c6-81ea-4a45-86ea-6ac6897648f2 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-5c7a10a7-440e-43f3-891b-4377a496b925.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:07:22 devstack sudo[107335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-5c7a10a7-440e-43f3-891b-4377a496b925.info Jul 08 02:07:22 devstack sudo[107335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:07:23 devstack sudo[107335]: pam_unix(sudo:session): session closed for user root Jul 08 02:07:23 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-516d48c6-81ea-4a45-86ea-6ac6897648f2 tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-5c7a10a7-440e-43f3-891b-4377a496b925.info" returned: 0 in 0.629s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:07:23 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-516d48c6-81ea-4a45-86ea-6ac6897648f2 tempest-ProjectMemberTests-73815212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.615s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:07:23 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-516d48c6-81ea-4a45-86ea-6ac6897648f2 tempest-ProjectMemberTests-73815212 None] Create snapshot completed successfully Jul 08 02:07:24 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-52990acb-c275-439c-87f1-53f5a1ea2d5d tempest-ProjectMemberTests-73815212 None] Acquiring lock "cinder-f98b9415-6747-4bd5-b8cb-6f17166a2921-delete_snapshot" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:07:24 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-52990acb-c275-439c-87f1-53f5a1ea2d5d tempest-ProjectMemberTests-73815212 None] Lock "cinder-f98b9415-6747-4bd5-b8cb-6f17166a2921-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:07:24 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-52990acb-c275-439c-87f1-53f5a1ea2d5d tempest-ProjectMemberTests-73815212 None] Acquiring lock "cinder-quobyte-5c7a10a7-440e-43f3-891b-4377a496b925" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:07:24 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-52990acb-c275-439c-87f1-53f5a1ea2d5d tempest-ProjectMemberTests-73815212 None] Lock "cinder-quobyte-5c7a10a7-440e-43f3-891b-4377a496b925" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:07:24 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-52990acb-c275-439c-87f1-53f5a1ea2d5d tempest-ProjectMemberTests-73815212 None] Acquiring lock "cinder-quobyte-f98b9415-6747-4bd5-b8cb-6f17166a2921" by "_delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:07:24 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-52990acb-c275-439c-87f1-53f5a1ea2d5d tempest-ProjectMemberTests-73815212 None] Lock "cinder-quobyte-f98b9415-6747-4bd5-b8cb-6f17166a2921" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:07:24 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-52990acb-c275-439c-87f1-53f5a1ea2d5d tempest-ProjectMemberTests-73815212 None] Deleting offline snapshot f98b9415-6747-4bd5-b8cb-6f17166a2921 of volume 5c7a10a7-440e-43f3-891b-4377a496b925 {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 02:07:24 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-52990acb-c275-439c-87f1-53f5a1ea2d5d tempest-ProjectMemberTests-73815212 None] snapshot_file for this snap is: volume-5c7a10a7-440e-43f3-891b-4377a496b925.f98b9415-6747-4bd5-b8cb-6f17166a2921 {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 02:07:24 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada0da7c-4e2d-4f9e-824f-685abb9052ed]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:07:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-52990acb-c275-439c-87f1-53f5a1ea2d5d tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-5c7a10a7-440e-43f3-891b-4377a496b925.f98b9415-6747-4bd5-b8cb-6f17166a2921 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:07:24 devstack sudo[107339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-5c7a10a7-440e-43f3-891b-4377a496b925.f98b9415-6747-4bd5-b8cb-6f17166a2921 Jul 08 02:07:24 devstack sudo[107339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:07:25 devstack sudo[107339]: pam_unix(sudo:session): session closed for user root Jul 08 02:07:25 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-52990acb-c275-439c-87f1-53f5a1ea2d5d tempest-ProjectMemberTests-73815212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-5c7a10a7-440e-43f3-891b-4377a496b925.f98b9415-6747-4bd5-b8cb-6f17166a2921" returned: 0 in 0.798s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:07:25 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-52990acb-c275-439c-87f1-53f5a1ea2d5d tempest-ProjectMemberTests-73815212 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c7a10a7-440e-43f3-891b-4377a496b925(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:07:25 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e90ca11-706a-4eda-87d3-ef585ab2fc99]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:07:25 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-52990acb-c275-439c-87f1-53f5a1ea2d5d tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-5c7a10a7-440e-43f3-891b-4377a496b925 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:07:25 devstack sudo[107344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-5c7a10a7-440e-43f3-891b-4377a496b925 Jul 08 02:07:25 devstack sudo[107344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:07:25 devstack sudo[107344]: pam_unix(sudo:session): session closed for user root Jul 08 02:07:25 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-52990acb-c275-439c-87f1-53f5a1ea2d5d tempest-ProjectMemberTests-73815212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-5c7a10a7-440e-43f3-891b-4377a496b925" returned: 0 in 0.765s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:07:25 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-52990acb-c275-439c-87f1-53f5a1ea2d5d tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-5c7a10a7-440e-43f3-891b-4377a496b925.f98b9415-6747-4bd5-b8cb-6f17166a2921 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:07:25 devstack sudo[107349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-5c7a10a7-440e-43f3-891b-4377a496b925.f98b9415-6747-4bd5-b8cb-6f17166a2921 Jul 08 02:07:25 devstack sudo[107349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:07:26 devstack sudo[107349]: pam_unix(sudo:session): session closed for user root Jul 08 02:07:26 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-52990acb-c275-439c-87f1-53f5a1ea2d5d tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-5c7a10a7-440e-43f3-891b-4377a496b925.f98b9415-6747-4bd5-b8cb-6f17166a2921" returned: 0 in 0.769s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:07:26 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-52990acb-c275-439c-87f1-53f5a1ea2d5d tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-5c7a10a7-440e-43f3-891b-4377a496b925.f98b9415-6747-4bd5-b8cb-6f17166a2921 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:07:26 devstack sudo[107354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-5c7a10a7-440e-43f3-891b-4377a496b925.f98b9415-6747-4bd5-b8cb-6f17166a2921 Jul 08 02:07:26 devstack sudo[107354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:07:27 devstack sudo[107354]: pam_unix(sudo:session): session closed for user root Jul 08 02:07:27 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-52990acb-c275-439c-87f1-53f5a1ea2d5d tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-5c7a10a7-440e-43f3-891b-4377a496b925.f98b9415-6747-4bd5-b8cb-6f17166a2921" returned: 0 in 0.673s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:07:27 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-52990acb-c275-439c-87f1-53f5a1ea2d5d tempest-ProjectMemberTests-73815212 None] Lock "cinder-quobyte-f98b9415-6747-4bd5-b8cb-6f17166a2921" released by "_delete_snapshot" :: held 3.108s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:07:27 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-52990acb-c275-439c-87f1-53f5a1ea2d5d tempest-ProjectMemberTests-73815212 None] Lock "cinder-quobyte-5c7a10a7-440e-43f3-891b-4377a496b925" released by "delete_snapshot" :: held 3.132s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:07:27 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-52990acb-c275-439c-87f1-53f5a1ea2d5d tempest-ProjectMemberTests-73815212 None] Created reservations ['542c6dce-20f8-4d4d-a986-98c8a3932c7e', 'e080dd1b-e5ea-4d5e-9eeb-e52002d44368', 'cf7fa38a-c605-4735-88ea-7a9f522f0bd9', '32e7954b-1c96-4f8f-b817-349c56a7d017'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:07:27 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-52990acb-c275-439c-87f1-53f5a1ea2d5d tempest-ProjectMemberTests-73815212 None] Delete snapshot completed successfully. Jul 08 02:07:27 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-52990acb-c275-439c-87f1-53f5a1ea2d5d tempest-ProjectMemberTests-73815212 None] Lock "cinder-f98b9415-6747-4bd5-b8cb-6f17166a2921-delete_snapshot" released by "delete_snapshot" :: held 3.335s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:07:28 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-63df933d-9f18-4eea-b160-1b92d8fdbbe5 tempest-ProjectMemberTests-73815212 None] Acquiring lock "cinder-5c7a10a7-440e-43f3-891b-4377a496b925-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:07:28 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-63df933d-9f18-4eea-b160-1b92d8fdbbe5 tempest-ProjectMemberTests-73815212 None] Lock "cinder-5c7a10a7-440e-43f3-891b-4377a496b925-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:07:28 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-63df933d-9f18-4eea-b160-1b92d8fdbbe5 tempest-ProjectMemberTests-73815212 None] Acquiring lock "cinder-quobyte-5c7a10a7-440e-43f3-891b-4377a496b925" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:07:28 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-63df933d-9f18-4eea-b160-1b92d8fdbbe5 tempest-ProjectMemberTests-73815212 None] Lock "cinder-quobyte-5c7a10a7-440e-43f3-891b-4377a496b925" acquired by "delete_volume" :: waited 0.016s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:07:28 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc7137f8-11dc-4fb8-8497-bf5fd1aca393]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:07:28 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-63df933d-9f18-4eea-b160-1b92d8fdbbe5 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-5c7a10a7-440e-43f3-891b-4377a496b925 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:07:28 devstack sudo[107357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-5c7a10a7-440e-43f3-891b-4377a496b925 Jul 08 02:07:28 devstack sudo[107357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:07:29 devstack sudo[107357]: pam_unix(sudo:session): session closed for user root Jul 08 02:07:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-63df933d-9f18-4eea-b160-1b92d8fdbbe5 tempest-ProjectMemberTests-73815212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-5c7a10a7-440e-43f3-891b-4377a496b925" returned: 0 in 0.817s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:07:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-63df933d-9f18-4eea-b160-1b92d8fdbbe5 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-5c7a10a7-440e-43f3-891b-4377a496b925 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:07:29 devstack sudo[107362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-5c7a10a7-440e-43f3-891b-4377a496b925 Jul 08 02:07:29 devstack sudo[107362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:07:30 devstack sudo[107362]: pam_unix(sudo:session): session closed for user root Jul 08 02:07:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-63df933d-9f18-4eea-b160-1b92d8fdbbe5 tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-5c7a10a7-440e-43f3-891b-4377a496b925" returned: 0 in 0.752s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:07:30 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-63df933d-9f18-4eea-b160-1b92d8fdbbe5 tempest-ProjectMemberTests-73815212 None] Lock "cinder-quobyte-5c7a10a7-440e-43f3-891b-4377a496b925" released by "delete_volume" :: held 1.639s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:07:30 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-63df933d-9f18-4eea-b160-1b92d8fdbbe5 tempest-ProjectMemberTests-73815212 None] Created reservations ['12531a73-3c3d-4d8c-b036-1b040d3371fc', '29cc4c1a-d405-40c3-a31c-c38d22ddf06f', '40fb82d1-b810-4418-9c95-2f6bda62a391', '47a1e289-5954-49be-b7a6-d1213a19da18'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:07:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-63df933d-9f18-4eea-b160-1b92d8fdbbe5 tempest-ProjectMemberTests-73815212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:07:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-63df933d-9f18-4eea-b160-1b92d8fdbbe5 tempest-ProjectMemberTests-73815212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:07:30 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-63df933d-9f18-4eea-b160-1b92d8fdbbe5 tempest-ProjectMemberTests-73815212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:07:30 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-63df933d-9f18-4eea-b160-1b92d8fdbbe5 tempest-ProjectMemberTests-73815212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:07:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-63df933d-9f18-4eea-b160-1b92d8fdbbe5 tempest-ProjectMemberTests-73815212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:07:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-63df933d-9f18-4eea-b160-1b92d8fdbbe5 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:07:30 devstack sudo[107365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 02:07:30 devstack sudo[107365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:07:31 devstack sudo[107365]: pam_unix(sudo:session): session closed for user root Jul 08 02:07:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-63df933d-9f18-4eea-b160-1b92d8fdbbe5 tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.787s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:07:31 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-63df933d-9f18-4eea-b160-1b92d8fdbbe5 tempest-ProjectMemberTests-73815212 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:07:31 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-63df933d-9f18-4eea-b160-1b92d8fdbbe5 tempest-ProjectMemberTests-73815212 None] Deleted volume successfully. Jul 08 02:07:31 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-63df933d-9f18-4eea-b160-1b92d8fdbbe5 tempest-ProjectMemberTests-73815212 None] Lock "cinder-5c7a10a7-440e-43f3-891b-4377a496b925-delete_volume" released by "delete_volume" :: held 2.666s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:07:31 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-6417d331-6441-4151-b7d2-3fbfde17b501 tempest-ProjectMemberTests-73815212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:07:31 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6417d331-6441-4151-b7d2-3fbfde17b501 tempest-ProjectMemberTests-73815212 None] Flow 'volume_create_manager' (e935d9cd-ad0a-44ff-805f-00dce21e7cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:07:31 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6417d331-6441-4151-b7d2-3fbfde17b501 tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2e33e49-753b-419a-ad1b-7c258680c55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:07:31 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6417d331-6441-4151-b7d2-3fbfde17b501 tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2e33e49-753b-419a-ad1b-7c258680c55d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1963673621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd090f8f-9152-453c-af35-7e684e7a517e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f353d90ed9694fe88617e9c4eed37bf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:07:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:07:31Z,use_quota=True,user_id='6137db3fdb294c84a17fd39e57e13785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:07:31 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6417d331-6441-4151-b7d2-3fbfde17b501 tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5ed0364-d5a5-4516-a16f-d2f01588cbbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:07:31 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6417d331-6441-4151-b7d2-3fbfde17b501 tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5ed0364-d5a5-4516-a16f-d2f01588cbbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:07:31 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6417d331-6441-4151-b7d2-3fbfde17b501 tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e364d78-27b7-4184-bd6c-962c639776b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:07:31 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6417d331-6441-4151-b7d2-3fbfde17b501 tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e364d78-27b7-4184-bd6c-962c639776b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd090f8f-9152-453c-af35-7e684e7a517e', 'volume_name': 'volume-bd090f8f-9152-453c-af35-7e684e7a517e', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:07:31 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6417d331-6441-4151-b7d2-3fbfde17b501 tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76a0791d-e077-4445-b9a3-aba6ee9fc8ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:07:31 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6417d331-6441-4151-b7d2-3fbfde17b501 tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76a0791d-e077-4445-b9a3-aba6ee9fc8ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:07:31 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6417d331-6441-4151-b7d2-3fbfde17b501 tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a851e09f-9dd5-417d-b150-4efb68926614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:07:31 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-6417d331-6441-4151-b7d2-3fbfde17b501 tempest-ProjectMemberTests-73815212 None] Volume bd090f8f-9152-453c-af35-7e684e7a517e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd090f8f-9152-453c-af35-7e684e7a517e', 'volume_size': 1} Jul 08 02:07:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6417d331-6441-4151-b7d2-3fbfde17b501 tempest-ProjectMemberTests-73815212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:07:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6417d331-6441-4151-b7d2-3fbfde17b501 tempest-ProjectMemberTests-73815212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:07:31 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-6417d331-6441-4151-b7d2-3fbfde17b501 tempest-ProjectMemberTests-73815212 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1963673621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd090f8f-9152-453c-af35-7e684e7a517e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f353d90ed9694fe88617e9c4eed37bf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:07:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:07:31Z,use_quota=True,user_id='6137db3fdb294c84a17fd39e57e13785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:07:31 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-6417d331-6441-4151-b7d2-3fbfde17b501 tempest-ProjectMemberTests-73815212 None] Creating volume bd090f8f-9152-453c-af35-7e684e7a517e {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:07:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6417d331-6441-4151-b7d2-3fbfde17b501 tempest-ProjectMemberTests-73815212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:07:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6417d331-6441-4151-b7d2-3fbfde17b501 tempest-ProjectMemberTests-73815212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:07:31 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-6417d331-6441-4151-b7d2-3fbfde17b501 tempest-ProjectMemberTests-73815212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:07:31 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-6417d331-6441-4151-b7d2-3fbfde17b501 tempest-ProjectMemberTests-73815212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:07:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6417d331-6441-4151-b7d2-3fbfde17b501 tempest-ProjectMemberTests-73815212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:07:31 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-6417d331-6441-4151-b7d2-3fbfde17b501 tempest-ProjectMemberTests-73815212 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:07:31 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-6417d331-6441-4151-b7d2-3fbfde17b501 tempest-ProjectMemberTests-73815212 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 02:07:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6417d331-6441-4151-b7d2-3fbfde17b501 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-bd090f8f-9152-453c-af35-7e684e7a517e 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:07:31 devstack sudo[107368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-bd090f8f-9152-453c-af35-7e684e7a517e 1073741824 Jul 08 02:07:31 devstack sudo[107368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:07:32 devstack sudo[107368]: pam_unix(sudo:session): session closed for user root Jul 08 02:07:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6417d331-6441-4151-b7d2-3fbfde17b501 tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-bd090f8f-9152-453c-af35-7e684e7a517e 1073741824" returned: 0 in 0.878s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:07:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6417d331-6441-4151-b7d2-3fbfde17b501 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-bd090f8f-9152-453c-af35-7e684e7a517e {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:07:32 devstack sudo[107380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-bd090f8f-9152-453c-af35-7e684e7a517e Jul 08 02:07:32 devstack sudo[107380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:07:32 devstack sudo[107380]: pam_unix(sudo:session): session closed for user root Jul 08 02:07:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6417d331-6441-4151-b7d2-3fbfde17b501 tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-bd090f8f-9152-453c-af35-7e684e7a517e" returned: 0 in 0.645s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:07:32 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-6417d331-6441-4151-b7d2-3fbfde17b501 tempest-ProjectMemberTests-73815212 None] <== create_volume: return (1565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:07:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6417d331-6441-4151-b7d2-3fbfde17b501 tempest-ProjectMemberTests-73815212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.568s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:07:32 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6417d331-6441-4151-b7d2-3fbfde17b501 tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a851e09f-9dd5-417d-b150-4efb68926614) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd090f8f-9152-453c-af35-7e684e7a517e', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:07:32 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6417d331-6441-4151-b7d2-3fbfde17b501 tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2914749-24f7-4a7c-a19d-52ad207efc64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:07:32 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-6417d331-6441-4151-b7d2-3fbfde17b501 tempest-ProjectMemberTests-73815212 None] Volume volume-bd090f8f-9152-453c-af35-7e684e7a517e (bd090f8f-9152-453c-af35-7e684e7a517e): created successfully Jul 08 02:07:32 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6417d331-6441-4151-b7d2-3fbfde17b501 tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2914749-24f7-4a7c-a19d-52ad207efc64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:07:32 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6417d331-6441-4151-b7d2-3fbfde17b501 tempest-ProjectMemberTests-73815212 None] Flow 'volume_create_manager' (e935d9cd-ad0a-44ff-805f-00dce21e7cbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:07:32 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-6417d331-6441-4151-b7d2-3fbfde17b501 tempest-ProjectMemberTests-73815212 None] Created volume successfully. Jul 08 02:07:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c153a91e-0ab6-4e49-8931-23d83dd6f255 tempest-ProjectMemberTests-73815212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:07:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c153a91e-0ab6-4e49-8931-23d83dd6f255 tempest-ProjectMemberTests-73815212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:07:33 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-c153a91e-0ab6-4e49-8931-23d83dd6f255 tempest-ProjectMemberTests-73815212 None] Creating offline snapshot 7b704151-8ad9-4c3d-9922-d755c23b24f8 of volume bd090f8f-9152-453c-af35-7e684e7a517e {{(pid=87134) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 02:07:33 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad18250-bb36-457a-ac4b-5241a72ac053]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:07:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c153a91e-0ab6-4e49-8931-23d83dd6f255 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-bd090f8f-9152-453c-af35-7e684e7a517e {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:07:33 devstack sudo[107384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-bd090f8f-9152-453c-af35-7e684e7a517e Jul 08 02:07:33 devstack sudo[107384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:07:34 devstack sudo[107384]: pam_unix(sudo:session): session closed for user root Jul 08 02:07:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c153a91e-0ab6-4e49-8931-23d83dd6f255 tempest-ProjectMemberTests-73815212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-bd090f8f-9152-453c-af35-7e684e7a517e" returned: 0 in 0.777s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:07:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c153a91e-0ab6-4e49-8931-23d83dd6f255 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-bd090f8f-9152-453c-af35-7e684e7a517e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-bd090f8f-9152-453c-af35-7e684e7a517e.7b704151-8ad9-4c3d-9922-d755c23b24f8 1G {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:07:34 devstack sudo[107389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-bd090f8f-9152-453c-af35-7e684e7a517e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-bd090f8f-9152-453c-af35-7e684e7a517e.7b704151-8ad9-4c3d-9922-d755c23b24f8 1G Jul 08 02:07:34 devstack sudo[107389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:07:35 devstack sudo[107389]: pam_unix(sudo:session): session closed for user root Jul 08 02:07:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c153a91e-0ab6-4e49-8931-23d83dd6f255 tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-bd090f8f-9152-453c-af35-7e684e7a517e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-bd090f8f-9152-453c-af35-7e684e7a517e.7b704151-8ad9-4c3d-9922-d755c23b24f8 1G" returned: 0 in 0.805s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:07:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c153a91e-0ab6-4e49-8931-23d83dd6f255 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd090f8f-9152-453c-af35-7e684e7a517e -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-bd090f8f-9152-453c-af35-7e684e7a517e.7b704151-8ad9-4c3d-9922-d755c23b24f8 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:07:35 devstack sudo[107395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd090f8f-9152-453c-af35-7e684e7a517e -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-bd090f8f-9152-453c-af35-7e684e7a517e.7b704151-8ad9-4c3d-9922-d755c23b24f8 Jul 08 02:07:35 devstack sudo[107395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:07:35 devstack sudo[107395]: pam_unix(sudo:session): session closed for user root Jul 08 02:07:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c153a91e-0ab6-4e49-8931-23d83dd6f255 tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd090f8f-9152-453c-af35-7e684e7a517e -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-bd090f8f-9152-453c-af35-7e684e7a517e.7b704151-8ad9-4c3d-9922-d755c23b24f8" returned: 0 in 0.748s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:07:35 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-c153a91e-0ab6-4e49-8931-23d83dd6f255 tempest-ProjectMemberTests-73815212 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-bd090f8f-9152-453c-af35-7e684e7a517e.7b704151-8ad9-4c3d-9922-d755c23b24f8 is being set with open permissions: ugo+rw Jul 08 02:07:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c153a91e-0ab6-4e49-8931-23d83dd6f255 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-bd090f8f-9152-453c-af35-7e684e7a517e.7b704151-8ad9-4c3d-9922-d755c23b24f8 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:07:35 devstack sudo[107434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-bd090f8f-9152-453c-af35-7e684e7a517e.7b704151-8ad9-4c3d-9922-d755c23b24f8 Jul 08 02:07:35 devstack sudo[107434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:07:36 devstack sudo[107434]: pam_unix(sudo:session): session closed for user root Jul 08 02:07:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c153a91e-0ab6-4e49-8931-23d83dd6f255 tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-bd090f8f-9152-453c-af35-7e684e7a517e.7b704151-8ad9-4c3d-9922-d755c23b24f8" returned: 0 in 0.653s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:07:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c153a91e-0ab6-4e49-8931-23d83dd6f255 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-bd090f8f-9152-453c-af35-7e684e7a517e.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:07:36 devstack sudo[107439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-bd090f8f-9152-453c-af35-7e684e7a517e.info Jul 08 02:07:36 devstack sudo[107439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:07:37 devstack sudo[107439]: pam_unix(sudo:session): session closed for user root Jul 08 02:07:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c153a91e-0ab6-4e49-8931-23d83dd6f255 tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-bd090f8f-9152-453c-af35-7e684e7a517e.info" returned: 0 in 0.673s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:07:37 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-c153a91e-0ab6-4e49-8931-23d83dd6f255 tempest-ProjectMemberTests-73815212 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-bd090f8f-9152-453c-af35-7e684e7a517e.info is being set with open permissions: ugo+rw Jul 08 02:07:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c153a91e-0ab6-4e49-8931-23d83dd6f255 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-bd090f8f-9152-453c-af35-7e684e7a517e.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:07:37 devstack sudo[107442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-bd090f8f-9152-453c-af35-7e684e7a517e.info Jul 08 02:07:37 devstack sudo[107442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:07:37 devstack sudo[107442]: pam_unix(sudo:session): session closed for user root Jul 08 02:07:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c153a91e-0ab6-4e49-8931-23d83dd6f255 tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-bd090f8f-9152-453c-af35-7e684e7a517e.info" returned: 0 in 0.741s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:07:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c153a91e-0ab6-4e49-8931-23d83dd6f255 tempest-ProjectMemberTests-73815212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.493s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:07:38 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-c153a91e-0ab6-4e49-8931-23d83dd6f255 tempest-ProjectMemberTests-73815212 None] Create snapshot completed successfully Jul 08 02:07:38 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-f8d11f77-b0b9-4daf-9acc-04522f4f0e33 tempest-ProjectMemberTests-73815212 None] Acquiring lock "cinder-7b704151-8ad9-4c3d-9922-d755c23b24f8-delete_snapshot" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:07:38 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-f8d11f77-b0b9-4daf-9acc-04522f4f0e33 tempest-ProjectMemberTests-73815212 None] Lock "cinder-7b704151-8ad9-4c3d-9922-d755c23b24f8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:07:38 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-f8d11f77-b0b9-4daf-9acc-04522f4f0e33 tempest-ProjectMemberTests-73815212 None] Acquiring lock "cinder-quobyte-bd090f8f-9152-453c-af35-7e684e7a517e" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:07:38 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-f8d11f77-b0b9-4daf-9acc-04522f4f0e33 tempest-ProjectMemberTests-73815212 None] Lock "cinder-quobyte-bd090f8f-9152-453c-af35-7e684e7a517e" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:07:38 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-f8d11f77-b0b9-4daf-9acc-04522f4f0e33 tempest-ProjectMemberTests-73815212 None] Acquiring lock "cinder-quobyte-7b704151-8ad9-4c3d-9922-d755c23b24f8" by "_delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:07:38 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-f8d11f77-b0b9-4daf-9acc-04522f4f0e33 tempest-ProjectMemberTests-73815212 None] Lock "cinder-quobyte-7b704151-8ad9-4c3d-9922-d755c23b24f8" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:07:38 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-f8d11f77-b0b9-4daf-9acc-04522f4f0e33 tempest-ProjectMemberTests-73815212 None] Deleting offline snapshot 7b704151-8ad9-4c3d-9922-d755c23b24f8 of volume bd090f8f-9152-453c-af35-7e684e7a517e {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 02:07:38 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-f8d11f77-b0b9-4daf-9acc-04522f4f0e33 tempest-ProjectMemberTests-73815212 None] snapshot_file for this snap is: volume-bd090f8f-9152-453c-af35-7e684e7a517e.7b704151-8ad9-4c3d-9922-d755c23b24f8 {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 02:07:38 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d919b3f-ebd1-4da7-8450-32bb74e8d613]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:07:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f8d11f77-b0b9-4daf-9acc-04522f4f0e33 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-bd090f8f-9152-453c-af35-7e684e7a517e.7b704151-8ad9-4c3d-9922-d755c23b24f8 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:07:38 devstack sudo[107445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-bd090f8f-9152-453c-af35-7e684e7a517e.7b704151-8ad9-4c3d-9922-d755c23b24f8 Jul 08 02:07:38 devstack sudo[107445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:07:39 devstack sudo[107445]: pam_unix(sudo:session): session closed for user root Jul 08 02:07:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f8d11f77-b0b9-4daf-9acc-04522f4f0e33 tempest-ProjectMemberTests-73815212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-bd090f8f-9152-453c-af35-7e684e7a517e.7b704151-8ad9-4c3d-9922-d755c23b24f8" returned: 0 in 0.812s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:07:39 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-f8d11f77-b0b9-4daf-9acc-04522f4f0e33 tempest-ProjectMemberTests-73815212 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd090f8f-9152-453c-af35-7e684e7a517e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:07:39 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[e484411a-561f-4093-908b-d93bbb3abea0]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:07:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f8d11f77-b0b9-4daf-9acc-04522f4f0e33 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-bd090f8f-9152-453c-af35-7e684e7a517e {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:07:39 devstack sudo[107450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-bd090f8f-9152-453c-af35-7e684e7a517e Jul 08 02:07:39 devstack sudo[107450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:07:40 devstack sudo[107450]: pam_unix(sudo:session): session closed for user root Jul 08 02:07:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f8d11f77-b0b9-4daf-9acc-04522f4f0e33 tempest-ProjectMemberTests-73815212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-bd090f8f-9152-453c-af35-7e684e7a517e" returned: 0 in 0.811s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:07:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f8d11f77-b0b9-4daf-9acc-04522f4f0e33 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-bd090f8f-9152-453c-af35-7e684e7a517e.7b704151-8ad9-4c3d-9922-d755c23b24f8 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:07:40 devstack sudo[107455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-bd090f8f-9152-453c-af35-7e684e7a517e.7b704151-8ad9-4c3d-9922-d755c23b24f8 Jul 08 02:07:40 devstack sudo[107455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:07:41 devstack sudo[107455]: pam_unix(sudo:session): session closed for user root Jul 08 02:07:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f8d11f77-b0b9-4daf-9acc-04522f4f0e33 tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-bd090f8f-9152-453c-af35-7e684e7a517e.7b704151-8ad9-4c3d-9922-d755c23b24f8" returned: 0 in 0.765s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:07:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f8d11f77-b0b9-4daf-9acc-04522f4f0e33 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-bd090f8f-9152-453c-af35-7e684e7a517e.7b704151-8ad9-4c3d-9922-d755c23b24f8 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:07:41 devstack sudo[107460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-bd090f8f-9152-453c-af35-7e684e7a517e.7b704151-8ad9-4c3d-9922-d755c23b24f8 Jul 08 02:07:41 devstack sudo[107460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:07:41 devstack sudo[107460]: pam_unix(sudo:session): session closed for user root Jul 08 02:07:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f8d11f77-b0b9-4daf-9acc-04522f4f0e33 tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-bd090f8f-9152-453c-af35-7e684e7a517e.7b704151-8ad9-4c3d-9922-d755c23b24f8" returned: 0 in 0.667s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:07:41 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-f8d11f77-b0b9-4daf-9acc-04522f4f0e33 tempest-ProjectMemberTests-73815212 None] Lock "cinder-quobyte-7b704151-8ad9-4c3d-9922-d755c23b24f8" released by "_delete_snapshot" :: held 3.162s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:07:41 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-f8d11f77-b0b9-4daf-9acc-04522f4f0e33 tempest-ProjectMemberTests-73815212 None] Lock "cinder-quobyte-bd090f8f-9152-453c-af35-7e684e7a517e" released by "delete_snapshot" :: held 3.187s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:07:42 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-f8d11f77-b0b9-4daf-9acc-04522f4f0e33 tempest-ProjectMemberTests-73815212 None] Created reservations ['d7eaa63f-7e8c-4195-837d-826f1686bd60', '20809342-78e1-4973-9f34-d58443cd2f17', '50d9b1a0-a1c6-423a-8b0d-0166590b8868', 'fbf21d83-bd62-4725-9cf1-3b9036c75a72'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:07:42 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-f8d11f77-b0b9-4daf-9acc-04522f4f0e33 tempest-ProjectMemberTests-73815212 None] Delete snapshot completed successfully. Jul 08 02:07:42 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-f8d11f77-b0b9-4daf-9acc-04522f4f0e33 tempest-ProjectMemberTests-73815212 None] Lock "cinder-7b704151-8ad9-4c3d-9922-d755c23b24f8-delete_snapshot" released by "delete_snapshot" :: held 3.325s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:07:43 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-262e6d0d-3b24-40c9-a7bd-e25095b0e725 tempest-ProjectMemberTests-73815212 None] Acquiring lock "cinder-bd090f8f-9152-453c-af35-7e684e7a517e-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:07:43 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-262e6d0d-3b24-40c9-a7bd-e25095b0e725 tempest-ProjectMemberTests-73815212 None] Lock "cinder-bd090f8f-9152-453c-af35-7e684e7a517e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:07:43 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-262e6d0d-3b24-40c9-a7bd-e25095b0e725 tempest-ProjectMemberTests-73815212 None] Acquiring lock "cinder-quobyte-bd090f8f-9152-453c-af35-7e684e7a517e" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:07:43 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-262e6d0d-3b24-40c9-a7bd-e25095b0e725 tempest-ProjectMemberTests-73815212 None] Lock "cinder-quobyte-bd090f8f-9152-453c-af35-7e684e7a517e" acquired by "delete_volume" :: waited 0.018s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:07:43 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f2170ea-7e77-4c19-9213-2fb8892d2aa7]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:07:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-262e6d0d-3b24-40c9-a7bd-e25095b0e725 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-bd090f8f-9152-453c-af35-7e684e7a517e {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:07:43 devstack sudo[107463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-bd090f8f-9152-453c-af35-7e684e7a517e Jul 08 02:07:43 devstack sudo[107463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:07:43 devstack sudo[107463]: pam_unix(sudo:session): session closed for user root Jul 08 02:07:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-262e6d0d-3b24-40c9-a7bd-e25095b0e725 tempest-ProjectMemberTests-73815212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-bd090f8f-9152-453c-af35-7e684e7a517e" returned: 0 in 0.833s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:07:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-262e6d0d-3b24-40c9-a7bd-e25095b0e725 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-bd090f8f-9152-453c-af35-7e684e7a517e {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:07:43 devstack sudo[107469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-bd090f8f-9152-453c-af35-7e684e7a517e Jul 08 02:07:43 devstack sudo[107469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:07:44 devstack sudo[107469]: pam_unix(sudo:session): session closed for user root Jul 08 02:07:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-262e6d0d-3b24-40c9-a7bd-e25095b0e725 tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-bd090f8f-9152-453c-af35-7e684e7a517e" returned: 0 in 0.719s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:07:44 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-262e6d0d-3b24-40c9-a7bd-e25095b0e725 tempest-ProjectMemberTests-73815212 None] Lock "cinder-quobyte-bd090f8f-9152-453c-af35-7e684e7a517e" released by "delete_volume" :: held 1.618s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:07:44 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-262e6d0d-3b24-40c9-a7bd-e25095b0e725 tempest-ProjectMemberTests-73815212 None] Created reservations ['e4a6395c-cb1b-4b44-8561-87dca92c417b', 'b30c8268-1253-4cb8-b7b1-c2a3d949f96e', '2738e0f9-7aaf-4ded-898d-0ff49be2a71c', 'bd3c32d8-550d-487f-a087-52c7b8921471'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:07:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-262e6d0d-3b24-40c9-a7bd-e25095b0e725 tempest-ProjectMemberTests-73815212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:07:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-262e6d0d-3b24-40c9-a7bd-e25095b0e725 tempest-ProjectMemberTests-73815212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:07:44 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-262e6d0d-3b24-40c9-a7bd-e25095b0e725 tempest-ProjectMemberTests-73815212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:07:44 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-262e6d0d-3b24-40c9-a7bd-e25095b0e725 tempest-ProjectMemberTests-73815212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:07:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-262e6d0d-3b24-40c9-a7bd-e25095b0e725 tempest-ProjectMemberTests-73815212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:07:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-262e6d0d-3b24-40c9-a7bd-e25095b0e725 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:07:44 devstack sudo[107473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 02:07:44 devstack sudo[107473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:07:45 devstack sudo[107473]: pam_unix(sudo:session): session closed for user root Jul 08 02:07:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-262e6d0d-3b24-40c9-a7bd-e25095b0e725 tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.760s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:07:45 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-262e6d0d-3b24-40c9-a7bd-e25095b0e725 tempest-ProjectMemberTests-73815212 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:07:45 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-262e6d0d-3b24-40c9-a7bd-e25095b0e725 tempest-ProjectMemberTests-73815212 None] Deleted volume successfully. Jul 08 02:07:45 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-262e6d0d-3b24-40c9-a7bd-e25095b0e725 tempest-ProjectMemberTests-73815212 None] Lock "cinder-bd090f8f-9152-453c-af35-7e684e7a517e-delete_volume" released by "delete_volume" :: held 2.617s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:07:45 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-c85dac8e-960d-43e9-b577-80c947df2d79 tempest-ProjectMemberTests-73815212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:07:45 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c85dac8e-960d-43e9-b577-80c947df2d79 tempest-ProjectMemberTests-73815212 None] Flow 'volume_create_manager' (b40dd01b-c888-4b05-9d9c-96012d62026e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:07:45 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c85dac8e-960d-43e9-b577-80c947df2d79 tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bb97bc2-5948-4e2b-991a-9ec614679812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:07:45 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c85dac8e-960d-43e9-b577-80c947df2d79 tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bb97bc2-5948-4e2b-991a-9ec614679812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:07:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-898368501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40c42976-4b6c-40b6-a681-1489b5666de1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f353d90ed9694fe88617e9c4eed37bf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:07:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:07:46Z,use_quota=True,user_id='6137db3fdb294c84a17fd39e57e13785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:07:45 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c85dac8e-960d-43e9-b577-80c947df2d79 tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f189e77-d68a-4ffd-b745-a3ac62bdd255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:07:45 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c85dac8e-960d-43e9-b577-80c947df2d79 tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f189e77-d68a-4ffd-b745-a3ac62bdd255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:07:45 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c85dac8e-960d-43e9-b577-80c947df2d79 tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e98a1796-9c48-4551-b90c-f62c6e481a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:07:45 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c85dac8e-960d-43e9-b577-80c947df2d79 tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e98a1796-9c48-4551-b90c-f62c6e481a0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40c42976-4b6c-40b6-a681-1489b5666de1', 'volume_name': 'volume-40c42976-4b6c-40b6-a681-1489b5666de1', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:07:45 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c85dac8e-960d-43e9-b577-80c947df2d79 tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f2d37fc-5b8d-4d0d-82d0-1468324ffc76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:07:45 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c85dac8e-960d-43e9-b577-80c947df2d79 tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f2d37fc-5b8d-4d0d-82d0-1468324ffc76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:07:45 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c85dac8e-960d-43e9-b577-80c947df2d79 tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0c7febd-c51b-48c0-85f7-f12b37cde6ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:07:45 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-c85dac8e-960d-43e9-b577-80c947df2d79 tempest-ProjectMemberTests-73815212 None] Volume 40c42976-4b6c-40b6-a681-1489b5666de1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40c42976-4b6c-40b6-a681-1489b5666de1', 'volume_size': 1} Jul 08 02:07:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c85dac8e-960d-43e9-b577-80c947df2d79 tempest-ProjectMemberTests-73815212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:07:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c85dac8e-960d-43e9-b577-80c947df2d79 tempest-ProjectMemberTests-73815212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:07:45 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-c85dac8e-960d-43e9-b577-80c947df2d79 tempest-ProjectMemberTests-73815212 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:07:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-898368501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40c42976-4b6c-40b6-a681-1489b5666de1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f353d90ed9694fe88617e9c4eed37bf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:07:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:07:46Z,use_quota=True,user_id='6137db3fdb294c84a17fd39e57e13785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:07:45 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-c85dac8e-960d-43e9-b577-80c947df2d79 tempest-ProjectMemberTests-73815212 None] Creating volume 40c42976-4b6c-40b6-a681-1489b5666de1 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:07:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c85dac8e-960d-43e9-b577-80c947df2d79 tempest-ProjectMemberTests-73815212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:07:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c85dac8e-960d-43e9-b577-80c947df2d79 tempest-ProjectMemberTests-73815212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:07:45 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-c85dac8e-960d-43e9-b577-80c947df2d79 tempest-ProjectMemberTests-73815212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:07:45 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-c85dac8e-960d-43e9-b577-80c947df2d79 tempest-ProjectMemberTests-73815212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:07:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c85dac8e-960d-43e9-b577-80c947df2d79 tempest-ProjectMemberTests-73815212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:07:45 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-c85dac8e-960d-43e9-b577-80c947df2d79 tempest-ProjectMemberTests-73815212 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:07:45 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-c85dac8e-960d-43e9-b577-80c947df2d79 tempest-ProjectMemberTests-73815212 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 02:07:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c85dac8e-960d-43e9-b577-80c947df2d79 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-40c42976-4b6c-40b6-a681-1489b5666de1 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:07:45 devstack sudo[107476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-40c42976-4b6c-40b6-a681-1489b5666de1 1073741824 Jul 08 02:07:45 devstack sudo[107476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:07:46 devstack sudo[107476]: pam_unix(sudo:session): session closed for user root Jul 08 02:07:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c85dac8e-960d-43e9-b577-80c947df2d79 tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-40c42976-4b6c-40b6-a681-1489b5666de1 1073741824" returned: 0 in 0.926s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:07:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c85dac8e-960d-43e9-b577-80c947df2d79 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-40c42976-4b6c-40b6-a681-1489b5666de1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:07:46 devstack sudo[107482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-40c42976-4b6c-40b6-a681-1489b5666de1 Jul 08 02:07:46 devstack sudo[107482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:07:47 devstack sudo[107482]: pam_unix(sudo:session): session closed for user root Jul 08 02:07:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c85dac8e-960d-43e9-b577-80c947df2d79 tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-40c42976-4b6c-40b6-a681-1489b5666de1" returned: 0 in 0.673s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:07:47 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-c85dac8e-960d-43e9-b577-80c947df2d79 tempest-ProjectMemberTests-73815212 None] <== create_volume: return (1644ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:07:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c85dac8e-960d-43e9-b577-80c947df2d79 tempest-ProjectMemberTests-73815212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.646s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:07:47 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c85dac8e-960d-43e9-b577-80c947df2d79 tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0c7febd-c51b-48c0-85f7-f12b37cde6ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40c42976-4b6c-40b6-a681-1489b5666de1', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:07:47 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c85dac8e-960d-43e9-b577-80c947df2d79 tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5911c87-9d13-48fb-bd68-3b24b8505e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:07:47 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-c85dac8e-960d-43e9-b577-80c947df2d79 tempest-ProjectMemberTests-73815212 None] Volume volume-40c42976-4b6c-40b6-a681-1489b5666de1 (40c42976-4b6c-40b6-a681-1489b5666de1): created successfully Jul 08 02:07:47 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c85dac8e-960d-43e9-b577-80c947df2d79 tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5911c87-9d13-48fb-bd68-3b24b8505e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:07:47 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c85dac8e-960d-43e9-b577-80c947df2d79 tempest-ProjectMemberTests-73815212 None] Flow 'volume_create_manager' (b40dd01b-c888-4b05-9d9c-96012d62026e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:07:47 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-c85dac8e-960d-43e9-b577-80c947df2d79 tempest-ProjectMemberTests-73815212 None] Created volume successfully. Jul 08 02:07:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-9e9c0765-4c67-472a-bf23-d35a71705588 tempest-ProjectMemberTests-73815212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:07:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-9e9c0765-4c67-472a-bf23-d35a71705588 tempest-ProjectMemberTests-73815212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:07:48 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-9e9c0765-4c67-472a-bf23-d35a71705588 tempest-ProjectMemberTests-73815212 None] Creating offline snapshot 41c8106c-384f-4c9c-9abe-2e7084b9e6d7 of volume 40c42976-4b6c-40b6-a681-1489b5666de1 {{(pid=87134) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 02:07:48 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe31960f-1fd4-4b8a-a561-367994d54769]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:07:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9e9c0765-4c67-472a-bf23-d35a71705588 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-40c42976-4b6c-40b6-a681-1489b5666de1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:07:48 devstack sudo[107485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-40c42976-4b6c-40b6-a681-1489b5666de1 Jul 08 02:07:48 devstack sudo[107485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:07:49 devstack sudo[107485]: pam_unix(sudo:session): session closed for user root Jul 08 02:07:49 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9e9c0765-4c67-472a-bf23-d35a71705588 tempest-ProjectMemberTests-73815212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-40c42976-4b6c-40b6-a681-1489b5666de1" returned: 0 in 0.881s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:07:49 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9e9c0765-4c67-472a-bf23-d35a71705588 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-40c42976-4b6c-40b6-a681-1489b5666de1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-40c42976-4b6c-40b6-a681-1489b5666de1.41c8106c-384f-4c9c-9abe-2e7084b9e6d7 1G {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:07:49 devstack sudo[107490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-40c42976-4b6c-40b6-a681-1489b5666de1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-40c42976-4b6c-40b6-a681-1489b5666de1.41c8106c-384f-4c9c-9abe-2e7084b9e6d7 1G Jul 08 02:07:49 devstack sudo[107490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:07:49 devstack sudo[107490]: pam_unix(sudo:session): session closed for user root Jul 08 02:07:49 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9e9c0765-4c67-472a-bf23-d35a71705588 tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-40c42976-4b6c-40b6-a681-1489b5666de1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-40c42976-4b6c-40b6-a681-1489b5666de1.41c8106c-384f-4c9c-9abe-2e7084b9e6d7 1G" returned: 0 in 0.901s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:07:49 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9e9c0765-4c67-472a-bf23-d35a71705588 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40c42976-4b6c-40b6-a681-1489b5666de1 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-40c42976-4b6c-40b6-a681-1489b5666de1.41c8106c-384f-4c9c-9abe-2e7084b9e6d7 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:07:49 devstack sudo[107495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40c42976-4b6c-40b6-a681-1489b5666de1 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-40c42976-4b6c-40b6-a681-1489b5666de1.41c8106c-384f-4c9c-9abe-2e7084b9e6d7 Jul 08 02:07:49 devstack sudo[107495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:07:50 devstack sudo[107495]: pam_unix(sudo:session): session closed for user root Jul 08 02:07:50 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9e9c0765-4c67-472a-bf23-d35a71705588 tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40c42976-4b6c-40b6-a681-1489b5666de1 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-40c42976-4b6c-40b6-a681-1489b5666de1.41c8106c-384f-4c9c-9abe-2e7084b9e6d7" returned: 0 in 0.711s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:07:50 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-9e9c0765-4c67-472a-bf23-d35a71705588 tempest-ProjectMemberTests-73815212 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-40c42976-4b6c-40b6-a681-1489b5666de1.41c8106c-384f-4c9c-9abe-2e7084b9e6d7 is being set with open permissions: ugo+rw Jul 08 02:07:50 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9e9c0765-4c67-472a-bf23-d35a71705588 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-40c42976-4b6c-40b6-a681-1489b5666de1.41c8106c-384f-4c9c-9abe-2e7084b9e6d7 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:07:50 devstack sudo[107500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-40c42976-4b6c-40b6-a681-1489b5666de1.41c8106c-384f-4c9c-9abe-2e7084b9e6d7 Jul 08 02:07:50 devstack sudo[107500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:07:51 devstack sudo[107500]: pam_unix(sudo:session): session closed for user root Jul 08 02:07:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9e9c0765-4c67-472a-bf23-d35a71705588 tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-40c42976-4b6c-40b6-a681-1489b5666de1.41c8106c-384f-4c9c-9abe-2e7084b9e6d7" returned: 0 in 0.673s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:07:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9e9c0765-4c67-472a-bf23-d35a71705588 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-40c42976-4b6c-40b6-a681-1489b5666de1.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:07:51 devstack sudo[107503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-40c42976-4b6c-40b6-a681-1489b5666de1.info Jul 08 02:07:51 devstack sudo[107503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:07:52 devstack sudo[107503]: pam_unix(sudo:session): session closed for user root Jul 08 02:07:52 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9e9c0765-4c67-472a-bf23-d35a71705588 tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-40c42976-4b6c-40b6-a681-1489b5666de1.info" returned: 0 in 0.655s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:07:52 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-9e9c0765-4c67-472a-bf23-d35a71705588 tempest-ProjectMemberTests-73815212 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-40c42976-4b6c-40b6-a681-1489b5666de1.info is being set with open permissions: ugo+rw Jul 08 02:07:52 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9e9c0765-4c67-472a-bf23-d35a71705588 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-40c42976-4b6c-40b6-a681-1489b5666de1.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:07:52 devstack sudo[107506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-40c42976-4b6c-40b6-a681-1489b5666de1.info Jul 08 02:07:52 devstack sudo[107506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:07:52 devstack sudo[107506]: pam_unix(sudo:session): session closed for user root Jul 08 02:07:52 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9e9c0765-4c67-472a-bf23-d35a71705588 tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-40c42976-4b6c-40b6-a681-1489b5666de1.info" returned: 0 in 0.624s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:07:52 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-9e9c0765-4c67-472a-bf23-d35a71705588 tempest-ProjectMemberTests-73815212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.541s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:07:52 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-9e9c0765-4c67-472a-bf23-d35a71705588 tempest-ProjectMemberTests-73815212 None] Create snapshot completed successfully Jul 08 02:07:53 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-2ca9e585-b5d7-44b1-bd25-0fba4d645b71 tempest-ProjectMemberTests-73815212 None] Acquiring lock "cinder-41c8106c-384f-4c9c-9abe-2e7084b9e6d7-delete_snapshot" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:07:53 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-2ca9e585-b5d7-44b1-bd25-0fba4d645b71 tempest-ProjectMemberTests-73815212 None] Lock "cinder-41c8106c-384f-4c9c-9abe-2e7084b9e6d7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:07:53 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-2ca9e585-b5d7-44b1-bd25-0fba4d645b71 tempest-ProjectMemberTests-73815212 None] Acquiring lock "cinder-quobyte-40c42976-4b6c-40b6-a681-1489b5666de1" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:07:53 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-2ca9e585-b5d7-44b1-bd25-0fba4d645b71 tempest-ProjectMemberTests-73815212 None] Lock "cinder-quobyte-40c42976-4b6c-40b6-a681-1489b5666de1" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:07:53 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-2ca9e585-b5d7-44b1-bd25-0fba4d645b71 tempest-ProjectMemberTests-73815212 None] Acquiring lock "cinder-quobyte-41c8106c-384f-4c9c-9abe-2e7084b9e6d7" by "_delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:07:53 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-2ca9e585-b5d7-44b1-bd25-0fba4d645b71 tempest-ProjectMemberTests-73815212 None] Lock "cinder-quobyte-41c8106c-384f-4c9c-9abe-2e7084b9e6d7" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:07:53 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-2ca9e585-b5d7-44b1-bd25-0fba4d645b71 tempest-ProjectMemberTests-73815212 None] Deleting offline snapshot 41c8106c-384f-4c9c-9abe-2e7084b9e6d7 of volume 40c42976-4b6c-40b6-a681-1489b5666de1 {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 02:07:53 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-2ca9e585-b5d7-44b1-bd25-0fba4d645b71 tempest-ProjectMemberTests-73815212 None] snapshot_file for this snap is: volume-40c42976-4b6c-40b6-a681-1489b5666de1.41c8106c-384f-4c9c-9abe-2e7084b9e6d7 {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 02:07:53 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[7367db89-ba0c-480c-b8f0-5f19f41c5ff4]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:07:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2ca9e585-b5d7-44b1-bd25-0fba4d645b71 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-40c42976-4b6c-40b6-a681-1489b5666de1.41c8106c-384f-4c9c-9abe-2e7084b9e6d7 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:07:53 devstack sudo[107510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-40c42976-4b6c-40b6-a681-1489b5666de1.41c8106c-384f-4c9c-9abe-2e7084b9e6d7 Jul 08 02:07:53 devstack sudo[107510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:07:54 devstack sudo[107510]: pam_unix(sudo:session): session closed for user root Jul 08 02:07:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2ca9e585-b5d7-44b1-bd25-0fba4d645b71 tempest-ProjectMemberTests-73815212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-40c42976-4b6c-40b6-a681-1489b5666de1.41c8106c-384f-4c9c-9abe-2e7084b9e6d7" returned: 0 in 0.790s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:07:54 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-2ca9e585-b5d7-44b1-bd25-0fba4d645b71 tempest-ProjectMemberTests-73815212 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40c42976-4b6c-40b6-a681-1489b5666de1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:07:54 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce3a197a-1ad3-4202-8e1c-34f8c6b11c87]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:07:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2ca9e585-b5d7-44b1-bd25-0fba4d645b71 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-40c42976-4b6c-40b6-a681-1489b5666de1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:07:54 devstack sudo[107515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-40c42976-4b6c-40b6-a681-1489b5666de1 Jul 08 02:07:54 devstack sudo[107515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:07:55 devstack sudo[107515]: pam_unix(sudo:session): session closed for user root Jul 08 02:07:55 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2ca9e585-b5d7-44b1-bd25-0fba4d645b71 tempest-ProjectMemberTests-73815212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-40c42976-4b6c-40b6-a681-1489b5666de1" returned: 0 in 0.863s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:07:55 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2ca9e585-b5d7-44b1-bd25-0fba4d645b71 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-40c42976-4b6c-40b6-a681-1489b5666de1.41c8106c-384f-4c9c-9abe-2e7084b9e6d7 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:07:55 devstack sudo[107520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-40c42976-4b6c-40b6-a681-1489b5666de1.41c8106c-384f-4c9c-9abe-2e7084b9e6d7 Jul 08 02:07:55 devstack sudo[107520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:07:55 devstack sudo[107520]: pam_unix(sudo:session): session closed for user root Jul 08 02:07:55 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2ca9e585-b5d7-44b1-bd25-0fba4d645b71 tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-40c42976-4b6c-40b6-a681-1489b5666de1.41c8106c-384f-4c9c-9abe-2e7084b9e6d7" returned: 0 in 0.807s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:07:55 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2ca9e585-b5d7-44b1-bd25-0fba4d645b71 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-40c42976-4b6c-40b6-a681-1489b5666de1.41c8106c-384f-4c9c-9abe-2e7084b9e6d7 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:07:55 devstack sudo[107525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-40c42976-4b6c-40b6-a681-1489b5666de1.41c8106c-384f-4c9c-9abe-2e7084b9e6d7 Jul 08 02:07:55 devstack sudo[107525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:07:56 devstack sudo[107525]: pam_unix(sudo:session): session closed for user root Jul 08 02:07:56 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2ca9e585-b5d7-44b1-bd25-0fba4d645b71 tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-40c42976-4b6c-40b6-a681-1489b5666de1.41c8106c-384f-4c9c-9abe-2e7084b9e6d7" returned: 0 in 0.660s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:07:56 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-2ca9e585-b5d7-44b1-bd25-0fba4d645b71 tempest-ProjectMemberTests-73815212 None] Lock "cinder-quobyte-41c8106c-384f-4c9c-9abe-2e7084b9e6d7" released by "_delete_snapshot" :: held 3.221s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:07:56 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-2ca9e585-b5d7-44b1-bd25-0fba4d645b71 tempest-ProjectMemberTests-73815212 None] Lock "cinder-quobyte-40c42976-4b6c-40b6-a681-1489b5666de1" released by "delete_snapshot" :: held 3.242s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:07:56 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-2ca9e585-b5d7-44b1-bd25-0fba4d645b71 tempest-ProjectMemberTests-73815212 None] Created reservations ['2d7115c6-3b7d-4981-939a-9dafc7a0a479', '3624c59c-cced-4522-b98c-9ad6548a1c71', '484b3f68-d370-480b-af6e-f3e348773f03', '9618332b-81e3-4c63-a741-6a1f8a07d898'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:07:56 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-2ca9e585-b5d7-44b1-bd25-0fba4d645b71 tempest-ProjectMemberTests-73815212 None] Delete snapshot completed successfully. Jul 08 02:07:56 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-2ca9e585-b5d7-44b1-bd25-0fba4d645b71 tempest-ProjectMemberTests-73815212 None] Lock "cinder-41c8106c-384f-4c9c-9abe-2e7084b9e6d7-delete_snapshot" released by "delete_snapshot" :: held 3.382s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:07:57 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7e83c39a-9194-4759-bb4f-b93252d011b8 tempest-ProjectMemberTests-73815212 None] Acquiring lock "cinder-40c42976-4b6c-40b6-a681-1489b5666de1-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:07:57 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7e83c39a-9194-4759-bb4f-b93252d011b8 tempest-ProjectMemberTests-73815212 None] Lock "cinder-40c42976-4b6c-40b6-a681-1489b5666de1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:07:57 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7e83c39a-9194-4759-bb4f-b93252d011b8 tempest-ProjectMemberTests-73815212 None] Acquiring lock "cinder-quobyte-40c42976-4b6c-40b6-a681-1489b5666de1" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:07:57 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7e83c39a-9194-4759-bb4f-b93252d011b8 tempest-ProjectMemberTests-73815212 None] Lock "cinder-quobyte-40c42976-4b6c-40b6-a681-1489b5666de1" acquired by "delete_volume" :: waited 0.016s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:07:57 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[0665fc88-54a1-4008-962a-6bce084e4e9d]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:07:57 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7e83c39a-9194-4759-bb4f-b93252d011b8 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-40c42976-4b6c-40b6-a681-1489b5666de1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:07:57 devstack sudo[107528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-40c42976-4b6c-40b6-a681-1489b5666de1 Jul 08 02:07:57 devstack sudo[107528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:07:58 devstack sudo[107528]: pam_unix(sudo:session): session closed for user root Jul 08 02:07:58 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7e83c39a-9194-4759-bb4f-b93252d011b8 tempest-ProjectMemberTests-73815212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-40c42976-4b6c-40b6-a681-1489b5666de1" returned: 0 in 0.793s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:07:58 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7e83c39a-9194-4759-bb4f-b93252d011b8 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-40c42976-4b6c-40b6-a681-1489b5666de1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:07:58 devstack sudo[107533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-40c42976-4b6c-40b6-a681-1489b5666de1 Jul 08 02:07:58 devstack sudo[107533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:07:59 devstack sudo[107533]: pam_unix(sudo:session): session closed for user root Jul 08 02:07:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7e83c39a-9194-4759-bb4f-b93252d011b8 tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-40c42976-4b6c-40b6-a681-1489b5666de1" returned: 0 in 0.711s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:07:59 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7e83c39a-9194-4759-bb4f-b93252d011b8 tempest-ProjectMemberTests-73815212 None] Lock "cinder-quobyte-40c42976-4b6c-40b6-a681-1489b5666de1" released by "delete_volume" :: held 1.571s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:07:59 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-7e83c39a-9194-4759-bb4f-b93252d011b8 tempest-ProjectMemberTests-73815212 None] Created reservations ['74db4139-fc6d-4436-91c9-11f8d307b0b4', 'a86417ca-3576-42c6-8d52-31b3c427bb43', '6fcb8b95-ee1c-47f1-b5a9-f618cdd268e3', '88a307ea-e36f-403c-94cb-67b66efaaea5'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:07:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7e83c39a-9194-4759-bb4f-b93252d011b8 tempest-ProjectMemberTests-73815212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:07:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7e83c39a-9194-4759-bb4f-b93252d011b8 tempest-ProjectMemberTests-73815212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:07:59 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-7e83c39a-9194-4759-bb4f-b93252d011b8 tempest-ProjectMemberTests-73815212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:07:59 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-7e83c39a-9194-4759-bb4f-b93252d011b8 tempest-ProjectMemberTests-73815212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:07:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7e83c39a-9194-4759-bb4f-b93252d011b8 tempest-ProjectMemberTests-73815212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:07:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7e83c39a-9194-4759-bb4f-b93252d011b8 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:07:59 devstack sudo[107536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 02:07:59 devstack sudo[107536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:08:00 devstack sudo[107536]: pam_unix(sudo:session): session closed for user root Jul 08 02:08:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7e83c39a-9194-4759-bb4f-b93252d011b8 tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.686s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:08:00 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-7e83c39a-9194-4759-bb4f-b93252d011b8 tempest-ProjectMemberTests-73815212 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:08:00 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-7e83c39a-9194-4759-bb4f-b93252d011b8 tempest-ProjectMemberTests-73815212 None] Deleted volume successfully. Jul 08 02:08:00 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-7e83c39a-9194-4759-bb4f-b93252d011b8 tempest-ProjectMemberTests-73815212 None] Lock "cinder-40c42976-4b6c-40b6-a681-1489b5666de1-delete_volume" released by "delete_volume" :: held 2.497s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:08:00 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-6aae505a-ff90-4f7a-b9d4-af0ae06d124a tempest-ProjectMemberTests-73815212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:08:00 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6aae505a-ff90-4f7a-b9d4-af0ae06d124a tempest-ProjectMemberTests-73815212 None] Flow 'volume_create_manager' (6615e22b-7bf4-4568-975e-5afa760b875c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:08:00 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6aae505a-ff90-4f7a-b9d4-af0ae06d124a tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (805e169a-3091-4918-a7cf-41e7ce50ad61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:08:00 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6aae505a-ff90-4f7a-b9d4-af0ae06d124a tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (805e169a-3091-4918-a7cf-41e7ce50ad61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:08:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1497298105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e087c56-4e99-43aa-baff-f08962e20db0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f353d90ed9694fe88617e9c4eed37bf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:08:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:08:00Z,use_quota=True,user_id='6137db3fdb294c84a17fd39e57e13785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:08:00 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6aae505a-ff90-4f7a-b9d4-af0ae06d124a tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0a570e2-0f90-4ad5-8022-1fbf0380ed08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:08:00 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6aae505a-ff90-4f7a-b9d4-af0ae06d124a tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0a570e2-0f90-4ad5-8022-1fbf0380ed08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:08:00 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6aae505a-ff90-4f7a-b9d4-af0ae06d124a tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48ac6425-83c8-46a7-ae9a-f50871fced2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:08:00 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6aae505a-ff90-4f7a-b9d4-af0ae06d124a tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48ac6425-83c8-46a7-ae9a-f50871fced2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e087c56-4e99-43aa-baff-f08962e20db0', 'volume_name': 'volume-4e087c56-4e99-43aa-baff-f08962e20db0', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:08:00 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6aae505a-ff90-4f7a-b9d4-af0ae06d124a tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f7e8c96-aaf2-4844-87b9-c6aa0d5bad33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:08:00 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6aae505a-ff90-4f7a-b9d4-af0ae06d124a tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f7e8c96-aaf2-4844-87b9-c6aa0d5bad33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:08:00 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6aae505a-ff90-4f7a-b9d4-af0ae06d124a tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83cdc419-5a8c-4731-a370-d82a4474c6cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:08:00 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-6aae505a-ff90-4f7a-b9d4-af0ae06d124a tempest-ProjectMemberTests-73815212 None] Volume 4e087c56-4e99-43aa-baff-f08962e20db0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e087c56-4e99-43aa-baff-f08962e20db0', 'volume_size': 1} Jul 08 02:08:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6aae505a-ff90-4f7a-b9d4-af0ae06d124a tempest-ProjectMemberTests-73815212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:08:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6aae505a-ff90-4f7a-b9d4-af0ae06d124a tempest-ProjectMemberTests-73815212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:08:00 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-6aae505a-ff90-4f7a-b9d4-af0ae06d124a tempest-ProjectMemberTests-73815212 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:08:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1497298105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e087c56-4e99-43aa-baff-f08962e20db0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f353d90ed9694fe88617e9c4eed37bf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:08:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:08:00Z,use_quota=True,user_id='6137db3fdb294c84a17fd39e57e13785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:08:00 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-6aae505a-ff90-4f7a-b9d4-af0ae06d124a tempest-ProjectMemberTests-73815212 None] Creating volume 4e087c56-4e99-43aa-baff-f08962e20db0 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:08:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6aae505a-ff90-4f7a-b9d4-af0ae06d124a tempest-ProjectMemberTests-73815212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:08:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6aae505a-ff90-4f7a-b9d4-af0ae06d124a tempest-ProjectMemberTests-73815212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:08:00 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-6aae505a-ff90-4f7a-b9d4-af0ae06d124a tempest-ProjectMemberTests-73815212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:08:00 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-6aae505a-ff90-4f7a-b9d4-af0ae06d124a tempest-ProjectMemberTests-73815212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:08:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6aae505a-ff90-4f7a-b9d4-af0ae06d124a tempest-ProjectMemberTests-73815212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:08:00 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-6aae505a-ff90-4f7a-b9d4-af0ae06d124a tempest-ProjectMemberTests-73815212 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:08:00 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-6aae505a-ff90-4f7a-b9d4-af0ae06d124a tempest-ProjectMemberTests-73815212 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 02:08:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6aae505a-ff90-4f7a-b9d4-af0ae06d124a tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4e087c56-4e99-43aa-baff-f08962e20db0 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:08:00 devstack sudo[107539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4e087c56-4e99-43aa-baff-f08962e20db0 1073741824 Jul 08 02:08:00 devstack sudo[107539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:08:01 devstack sudo[107539]: pam_unix(sudo:session): session closed for user root Jul 08 02:08:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6aae505a-ff90-4f7a-b9d4-af0ae06d124a tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4e087c56-4e99-43aa-baff-f08962e20db0 1073741824" returned: 0 in 0.988s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:08:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6aae505a-ff90-4f7a-b9d4-af0ae06d124a tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4e087c56-4e99-43aa-baff-f08962e20db0 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:08:01 devstack sudo[107545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4e087c56-4e99-43aa-baff-f08962e20db0 Jul 08 02:08:01 devstack sudo[107545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:08:02 devstack sudo[107545]: pam_unix(sudo:session): session closed for user root Jul 08 02:08:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6aae505a-ff90-4f7a-b9d4-af0ae06d124a tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4e087c56-4e99-43aa-baff-f08962e20db0" returned: 0 in 0.639s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:08:02 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-6aae505a-ff90-4f7a-b9d4-af0ae06d124a tempest-ProjectMemberTests-73815212 None] <== create_volume: return (1671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:08:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6aae505a-ff90-4f7a-b9d4-af0ae06d124a tempest-ProjectMemberTests-73815212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.674s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:08:02 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6aae505a-ff90-4f7a-b9d4-af0ae06d124a tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83cdc419-5a8c-4731-a370-d82a4474c6cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e087c56-4e99-43aa-baff-f08962e20db0', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:08:02 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6aae505a-ff90-4f7a-b9d4-af0ae06d124a tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e69a811e-9074-4884-838b-c9d7dbc75723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:08:02 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-6aae505a-ff90-4f7a-b9d4-af0ae06d124a tempest-ProjectMemberTests-73815212 None] Volume volume-4e087c56-4e99-43aa-baff-f08962e20db0 (4e087c56-4e99-43aa-baff-f08962e20db0): created successfully Jul 08 02:08:02 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6aae505a-ff90-4f7a-b9d4-af0ae06d124a tempest-ProjectMemberTests-73815212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e69a811e-9074-4884-838b-c9d7dbc75723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:08:02 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-6aae505a-ff90-4f7a-b9d4-af0ae06d124a tempest-ProjectMemberTests-73815212 None] Flow 'volume_create_manager' (6615e22b-7bf4-4568-975e-5afa760b875c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:08:02 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-6aae505a-ff90-4f7a-b9d4-af0ae06d124a tempest-ProjectMemberTests-73815212 None] Created volume successfully. Jul 08 02:08:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-341ed716-231c-47cc-9d10-8f29cf5a8122 tempest-ProjectMemberTests-73815212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:08:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-341ed716-231c-47cc-9d10-8f29cf5a8122 tempest-ProjectMemberTests-73815212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:08:02 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-341ed716-231c-47cc-9d10-8f29cf5a8122 tempest-ProjectMemberTests-73815212 None] Creating offline snapshot 89a38a0b-5bf7-428a-96f6-dc761f092f39 of volume 4e087c56-4e99-43aa-baff-f08962e20db0 {{(pid=87134) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 02:08:02 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[995346b1-3ef3-42e5-8a57-7f4e0401d592]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:08:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-341ed716-231c-47cc-9d10-8f29cf5a8122 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4e087c56-4e99-43aa-baff-f08962e20db0 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:08:02 devstack sudo[107548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4e087c56-4e99-43aa-baff-f08962e20db0 Jul 08 02:08:02 devstack sudo[107548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:08:03 devstack sudo[107548]: pam_unix(sudo:session): session closed for user root Jul 08 02:08:03 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-341ed716-231c-47cc-9d10-8f29cf5a8122 tempest-ProjectMemberTests-73815212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4e087c56-4e99-43aa-baff-f08962e20db0" returned: 0 in 0.839s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:08:03 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-341ed716-231c-47cc-9d10-8f29cf5a8122 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4e087c56-4e99-43aa-baff-f08962e20db0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4e087c56-4e99-43aa-baff-f08962e20db0.89a38a0b-5bf7-428a-96f6-dc761f092f39 1G {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:08:03 devstack sudo[107554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4e087c56-4e99-43aa-baff-f08962e20db0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4e087c56-4e99-43aa-baff-f08962e20db0.89a38a0b-5bf7-428a-96f6-dc761f092f39 1G Jul 08 02:08:03 devstack sudo[107554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:08:04 devstack sudo[107554]: pam_unix(sudo:session): session closed for user root Jul 08 02:08:04 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-341ed716-231c-47cc-9d10-8f29cf5a8122 tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4e087c56-4e99-43aa-baff-f08962e20db0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4e087c56-4e99-43aa-baff-f08962e20db0.89a38a0b-5bf7-428a-96f6-dc761f092f39 1G" returned: 0 in 0.918s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:08:04 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-341ed716-231c-47cc-9d10-8f29cf5a8122 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e087c56-4e99-43aa-baff-f08962e20db0 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4e087c56-4e99-43aa-baff-f08962e20db0.89a38a0b-5bf7-428a-96f6-dc761f092f39 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:08:04 devstack sudo[107559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e087c56-4e99-43aa-baff-f08962e20db0 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4e087c56-4e99-43aa-baff-f08962e20db0.89a38a0b-5bf7-428a-96f6-dc761f092f39 Jul 08 02:08:04 devstack sudo[107559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:08:05 devstack sudo[107559]: pam_unix(sudo:session): session closed for user root Jul 08 02:08:05 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-341ed716-231c-47cc-9d10-8f29cf5a8122 tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e087c56-4e99-43aa-baff-f08962e20db0 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4e087c56-4e99-43aa-baff-f08962e20db0.89a38a0b-5bf7-428a-96f6-dc761f092f39" returned: 0 in 0.717s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:08:05 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-341ed716-231c-47cc-9d10-8f29cf5a8122 tempest-ProjectMemberTests-73815212 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4e087c56-4e99-43aa-baff-f08962e20db0.89a38a0b-5bf7-428a-96f6-dc761f092f39 is being set with open permissions: ugo+rw Jul 08 02:08:05 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-341ed716-231c-47cc-9d10-8f29cf5a8122 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4e087c56-4e99-43aa-baff-f08962e20db0.89a38a0b-5bf7-428a-96f6-dc761f092f39 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:08:05 devstack sudo[107564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4e087c56-4e99-43aa-baff-f08962e20db0.89a38a0b-5bf7-428a-96f6-dc761f092f39 Jul 08 02:08:05 devstack sudo[107564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:08:05 devstack sudo[107564]: pam_unix(sudo:session): session closed for user root Jul 08 02:08:05 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-341ed716-231c-47cc-9d10-8f29cf5a8122 tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4e087c56-4e99-43aa-baff-f08962e20db0.89a38a0b-5bf7-428a-96f6-dc761f092f39" returned: 0 in 0.657s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:08:05 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-341ed716-231c-47cc-9d10-8f29cf5a8122 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4e087c56-4e99-43aa-baff-f08962e20db0.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:08:05 devstack sudo[107567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4e087c56-4e99-43aa-baff-f08962e20db0.info Jul 08 02:08:05 devstack sudo[107567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:08:06 devstack sudo[107567]: pam_unix(sudo:session): session closed for user root Jul 08 02:08:06 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-341ed716-231c-47cc-9d10-8f29cf5a8122 tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4e087c56-4e99-43aa-baff-f08962e20db0.info" returned: 0 in 0.704s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:08:06 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-341ed716-231c-47cc-9d10-8f29cf5a8122 tempest-ProjectMemberTests-73815212 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4e087c56-4e99-43aa-baff-f08962e20db0.info is being set with open permissions: ugo+rw Jul 08 02:08:06 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-341ed716-231c-47cc-9d10-8f29cf5a8122 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4e087c56-4e99-43aa-baff-f08962e20db0.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:08:06 devstack sudo[107570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4e087c56-4e99-43aa-baff-f08962e20db0.info Jul 08 02:08:06 devstack sudo[107570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:08:07 devstack sudo[107570]: pam_unix(sudo:session): session closed for user root Jul 08 02:08:07 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-341ed716-231c-47cc-9d10-8f29cf5a8122 tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4e087c56-4e99-43aa-baff-f08962e20db0.info" returned: 0 in 0.674s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:08:07 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-341ed716-231c-47cc-9d10-8f29cf5a8122 tempest-ProjectMemberTests-73815212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.596s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:08:07 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-341ed716-231c-47cc-9d10-8f29cf5a8122 tempest-ProjectMemberTests-73815212 None] Create snapshot completed successfully Jul 08 02:08:08 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a3d22de4-a798-40fb-a996-f1b9d04dcc50 tempest-ProjectMemberTests-73815212 None] Acquiring lock "cinder-89a38a0b-5bf7-428a-96f6-dc761f092f39-delete_snapshot" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:08:08 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a3d22de4-a798-40fb-a996-f1b9d04dcc50 tempest-ProjectMemberTests-73815212 None] Lock "cinder-89a38a0b-5bf7-428a-96f6-dc761f092f39-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:08:08 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a3d22de4-a798-40fb-a996-f1b9d04dcc50 tempest-ProjectMemberTests-73815212 None] Acquiring lock "cinder-quobyte-4e087c56-4e99-43aa-baff-f08962e20db0" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:08:08 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a3d22de4-a798-40fb-a996-f1b9d04dcc50 tempest-ProjectMemberTests-73815212 None] Lock "cinder-quobyte-4e087c56-4e99-43aa-baff-f08962e20db0" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:08:08 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a3d22de4-a798-40fb-a996-f1b9d04dcc50 tempest-ProjectMemberTests-73815212 None] Acquiring lock "cinder-quobyte-89a38a0b-5bf7-428a-96f6-dc761f092f39" by "_delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:08:08 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a3d22de4-a798-40fb-a996-f1b9d04dcc50 tempest-ProjectMemberTests-73815212 None] Lock "cinder-quobyte-89a38a0b-5bf7-428a-96f6-dc761f092f39" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:08:08 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-a3d22de4-a798-40fb-a996-f1b9d04dcc50 tempest-ProjectMemberTests-73815212 None] Deleting offline snapshot 89a38a0b-5bf7-428a-96f6-dc761f092f39 of volume 4e087c56-4e99-43aa-baff-f08962e20db0 {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 02:08:08 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-a3d22de4-a798-40fb-a996-f1b9d04dcc50 tempest-ProjectMemberTests-73815212 None] snapshot_file for this snap is: volume-4e087c56-4e99-43aa-baff-f08962e20db0.89a38a0b-5bf7-428a-96f6-dc761f092f39 {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 02:08:08 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[145cbff2-0013-4b82-81b6-004618f398a6]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:08:08 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a3d22de4-a798-40fb-a996-f1b9d04dcc50 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4e087c56-4e99-43aa-baff-f08962e20db0.89a38a0b-5bf7-428a-96f6-dc761f092f39 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:08:08 devstack sudo[107573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4e087c56-4e99-43aa-baff-f08962e20db0.89a38a0b-5bf7-428a-96f6-dc761f092f39 Jul 08 02:08:08 devstack sudo[107573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:08:09 devstack sudo[107573]: pam_unix(sudo:session): session closed for user root Jul 08 02:08:09 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a3d22de4-a798-40fb-a996-f1b9d04dcc50 tempest-ProjectMemberTests-73815212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4e087c56-4e99-43aa-baff-f08962e20db0.89a38a0b-5bf7-428a-96f6-dc761f092f39" returned: 0 in 0.861s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:08:09 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-a3d22de4-a798-40fb-a996-f1b9d04dcc50 tempest-ProjectMemberTests-73815212 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e087c56-4e99-43aa-baff-f08962e20db0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:08:09 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[383e5ba7-6603-4c9f-8fe8-5df8a6fc0acc]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:08:09 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a3d22de4-a798-40fb-a996-f1b9d04dcc50 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4e087c56-4e99-43aa-baff-f08962e20db0 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:08:09 devstack sudo[107579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4e087c56-4e99-43aa-baff-f08962e20db0 Jul 08 02:08:09 devstack sudo[107579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:08:09 devstack sudo[107579]: pam_unix(sudo:session): session closed for user root Jul 08 02:08:09 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a3d22de4-a798-40fb-a996-f1b9d04dcc50 tempest-ProjectMemberTests-73815212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4e087c56-4e99-43aa-baff-f08962e20db0" returned: 0 in 0.832s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:08:09 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a3d22de4-a798-40fb-a996-f1b9d04dcc50 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4e087c56-4e99-43aa-baff-f08962e20db0.89a38a0b-5bf7-428a-96f6-dc761f092f39 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:08:09 devstack sudo[107584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4e087c56-4e99-43aa-baff-f08962e20db0.89a38a0b-5bf7-428a-96f6-dc761f092f39 Jul 08 02:08:09 devstack sudo[107584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:08:10 devstack sudo[107584]: pam_unix(sudo:session): session closed for user root Jul 08 02:08:10 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a3d22de4-a798-40fb-a996-f1b9d04dcc50 tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4e087c56-4e99-43aa-baff-f08962e20db0.89a38a0b-5bf7-428a-96f6-dc761f092f39" returned: 0 in 0.792s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:08:10 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a3d22de4-a798-40fb-a996-f1b9d04dcc50 tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4e087c56-4e99-43aa-baff-f08962e20db0.89a38a0b-5bf7-428a-96f6-dc761f092f39 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:08:10 devstack sudo[107589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4e087c56-4e99-43aa-baff-f08962e20db0.89a38a0b-5bf7-428a-96f6-dc761f092f39 Jul 08 02:08:10 devstack sudo[107589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:08:11 devstack sudo[107589]: pam_unix(sudo:session): session closed for user root Jul 08 02:08:11 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-a3d22de4-a798-40fb-a996-f1b9d04dcc50 tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4e087c56-4e99-43aa-baff-f08962e20db0.89a38a0b-5bf7-428a-96f6-dc761f092f39" returned: 0 in 0.687s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:08:11 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a3d22de4-a798-40fb-a996-f1b9d04dcc50 tempest-ProjectMemberTests-73815212 None] Lock "cinder-quobyte-89a38a0b-5bf7-428a-96f6-dc761f092f39" released by "_delete_snapshot" :: held 3.270s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:08:11 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a3d22de4-a798-40fb-a996-f1b9d04dcc50 tempest-ProjectMemberTests-73815212 None] Lock "cinder-quobyte-4e087c56-4e99-43aa-baff-f08962e20db0" released by "delete_snapshot" :: held 3.294s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:08:11 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-a3d22de4-a798-40fb-a996-f1b9d04dcc50 tempest-ProjectMemberTests-73815212 None] Created reservations ['a0dcea84-d054-4245-9a42-b5819a39ea71', '32df1573-cab3-47c2-af09-f0c008f243b8', 'dfc4d523-a778-42f1-9b14-6b3c2c7877bf', 'f3906d0a-18bd-46c9-9631-8890e7b503f3'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:08:11 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-a3d22de4-a798-40fb-a996-f1b9d04dcc50 tempest-ProjectMemberTests-73815212 None] Delete snapshot completed successfully. Jul 08 02:08:11 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-a3d22de4-a798-40fb-a996-f1b9d04dcc50 tempest-ProjectMemberTests-73815212 None] Lock "cinder-89a38a0b-5bf7-428a-96f6-dc761f092f39-delete_snapshot" released by "delete_snapshot" :: held 3.440s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:08:12 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-03e7128a-a134-4870-819f-b31c4e71752c tempest-ProjectMemberTests-73815212 None] Acquiring lock "cinder-4e087c56-4e99-43aa-baff-f08962e20db0-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:08:12 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-03e7128a-a134-4870-819f-b31c4e71752c tempest-ProjectMemberTests-73815212 None] Lock "cinder-4e087c56-4e99-43aa-baff-f08962e20db0-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:08:12 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-03e7128a-a134-4870-819f-b31c4e71752c tempest-ProjectMemberTests-73815212 None] Acquiring lock "cinder-quobyte-4e087c56-4e99-43aa-baff-f08962e20db0" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:08:12 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-03e7128a-a134-4870-819f-b31c4e71752c tempest-ProjectMemberTests-73815212 None] Lock "cinder-quobyte-4e087c56-4e99-43aa-baff-f08962e20db0" acquired by "delete_volume" :: waited 0.015s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:08:12 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d5f9a9-d2eb-416b-81c0-9cb2e11cb809]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:08:12 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-03e7128a-a134-4870-819f-b31c4e71752c tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4e087c56-4e99-43aa-baff-f08962e20db0 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:08:12 devstack sudo[107594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4e087c56-4e99-43aa-baff-f08962e20db0 Jul 08 02:08:12 devstack sudo[107594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:08:13 devstack sudo[107594]: pam_unix(sudo:session): session closed for user root Jul 08 02:08:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-03e7128a-a134-4870-819f-b31c4e71752c tempest-ProjectMemberTests-73815212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4e087c56-4e99-43aa-baff-f08962e20db0" returned: 0 in 0.824s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:08:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-03e7128a-a134-4870-819f-b31c4e71752c tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4e087c56-4e99-43aa-baff-f08962e20db0 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:08:13 devstack sudo[107600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4e087c56-4e99-43aa-baff-f08962e20db0 Jul 08 02:08:13 devstack sudo[107600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:08:13 devstack sudo[107600]: pam_unix(sudo:session): session closed for user root Jul 08 02:08:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-03e7128a-a134-4870-819f-b31c4e71752c tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-4e087c56-4e99-43aa-baff-f08962e20db0" returned: 0 in 0.665s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:08:13 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-03e7128a-a134-4870-819f-b31c4e71752c tempest-ProjectMemberTests-73815212 None] Lock "cinder-quobyte-4e087c56-4e99-43aa-baff-f08962e20db0" released by "delete_volume" :: held 1.551s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:08:14 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-03e7128a-a134-4870-819f-b31c4e71752c tempest-ProjectMemberTests-73815212 None] Created reservations ['c2569459-ac71-445a-91c9-59710541bf0e', 'abb48569-8254-4e9d-838f-e8eb79088838', 'e3962a32-bcbf-4110-bf3c-c81c2f4f57a7', '8cfebeaa-152a-4e03-89b3-740d941b02d2'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:08:14 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-03e7128a-a134-4870-819f-b31c4e71752c tempest-ProjectMemberTests-73815212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:08:14 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-03e7128a-a134-4870-819f-b31c4e71752c tempest-ProjectMemberTests-73815212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:08:14 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-03e7128a-a134-4870-819f-b31c4e71752c tempest-ProjectMemberTests-73815212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:08:14 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-03e7128a-a134-4870-819f-b31c4e71752c tempest-ProjectMemberTests-73815212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:08:14 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-03e7128a-a134-4870-819f-b31c4e71752c tempest-ProjectMemberTests-73815212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:08:14 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-03e7128a-a134-4870-819f-b31c4e71752c tempest-ProjectMemberTests-73815212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:08:14 devstack sudo[107603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 02:08:14 devstack sudo[107603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:08:14 devstack sudo[107603]: pam_unix(sudo:session): session closed for user root Jul 08 02:08:14 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-03e7128a-a134-4870-819f-b31c4e71752c tempest-ProjectMemberTests-73815212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.713s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:08:14 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-03e7128a-a134-4870-819f-b31c4e71752c tempest-ProjectMemberTests-73815212 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:08:14 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-03e7128a-a134-4870-819f-b31c4e71752c tempest-ProjectMemberTests-73815212 None] Deleted volume successfully. Jul 08 02:08:14 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-03e7128a-a134-4870-819f-b31c4e71752c tempest-ProjectMemberTests-73815212 None] Lock "cinder-4e087c56-4e99-43aa-baff-f08962e20db0-delete_volume" released by "delete_volume" :: held 2.489s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:08:19 devstack cinder-volume[87134]: DEBUG dbcounter [-] [87134] Writing DB stats cinder:SELECT=62,cinder:UPDATE=71,cinder:INSERT=13,cinder:DELETE=5 {{(pid=87134) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:08:19 devstack cinder-volume[87134]: DEBUG dbcounter [-] [87134] Writing DB stats cinder:UPDATE=75,cinder:SELECT=51,cinder:DELETE=7,cinder:INSERT=27 {{(pid=87134) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:08:19 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5587fcd-e9d8-4a0b-a197-88ca846d2e01 tempest-ProjectReaderTests-402678827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:08:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c5587fcd-e9d8-4a0b-a197-88ca846d2e01 tempest-ProjectReaderTests-402678827 None] Flow 'volume_create_manager' (4df24390-fd2b-4525-b0a8-f70e4ce6849d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:08:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c5587fcd-e9d8-4a0b-a197-88ca846d2e01 tempest-ProjectReaderTests-402678827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eafad85b-6c5e-48f6-9088-8921f3c97e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:08:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c5587fcd-e9d8-4a0b-a197-88ca846d2e01 tempest-ProjectReaderTests-402678827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eafad85b-6c5e-48f6-9088-8921f3c97e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:08:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1912831414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7f6f901-a4a0-47e5-891b-68078c5d61e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='010cd051a2434efcab451de7970a9ed3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:08:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:08:19Z,use_quota=True,user_id='fd11f14eeb354dd7acd84ed9187a6aa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:08:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c5587fcd-e9d8-4a0b-a197-88ca846d2e01 tempest-ProjectReaderTests-402678827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ac4d942-60cc-40a3-93dc-47d417a2359e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:08:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c5587fcd-e9d8-4a0b-a197-88ca846d2e01 tempest-ProjectReaderTests-402678827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ac4d942-60cc-40a3-93dc-47d417a2359e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:08:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c5587fcd-e9d8-4a0b-a197-88ca846d2e01 tempest-ProjectReaderTests-402678827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0809e7a7-9efb-4541-8a5f-588c98ff8c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:08:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c5587fcd-e9d8-4a0b-a197-88ca846d2e01 tempest-ProjectReaderTests-402678827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0809e7a7-9efb-4541-8a5f-588c98ff8c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7f6f901-a4a0-47e5-891b-68078c5d61e3', 'volume_name': 'volume-a7f6f901-a4a0-47e5-891b-68078c5d61e3', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:08:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c5587fcd-e9d8-4a0b-a197-88ca846d2e01 tempest-ProjectReaderTests-402678827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f553084c-8971-47e0-9df7-7b3f38c0df10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:08:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c5587fcd-e9d8-4a0b-a197-88ca846d2e01 tempest-ProjectReaderTests-402678827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f553084c-8971-47e0-9df7-7b3f38c0df10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:08:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c5587fcd-e9d8-4a0b-a197-88ca846d2e01 tempest-ProjectReaderTests-402678827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42133c96-b6d4-42db-9c44-2856551b59ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:08:19 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-c5587fcd-e9d8-4a0b-a197-88ca846d2e01 tempest-ProjectReaderTests-402678827 None] Volume a7f6f901-a4a0-47e5-891b-68078c5d61e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7f6f901-a4a0-47e5-891b-68078c5d61e3', 'volume_size': 1} Jul 08 02:08:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c5587fcd-e9d8-4a0b-a197-88ca846d2e01 tempest-ProjectReaderTests-402678827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:08:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c5587fcd-e9d8-4a0b-a197-88ca846d2e01 tempest-ProjectReaderTests-402678827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:08:19 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-c5587fcd-e9d8-4a0b-a197-88ca846d2e01 tempest-ProjectReaderTests-402678827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:08:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1912831414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7f6f901-a4a0-47e5-891b-68078c5d61e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='010cd051a2434efcab451de7970a9ed3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:08:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:08:19Z,use_quota=True,user_id='fd11f14eeb354dd7acd84ed9187a6aa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:08:19 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-c5587fcd-e9d8-4a0b-a197-88ca846d2e01 tempest-ProjectReaderTests-402678827 None] Creating volume a7f6f901-a4a0-47e5-891b-68078c5d61e3 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:08:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c5587fcd-e9d8-4a0b-a197-88ca846d2e01 tempest-ProjectReaderTests-402678827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:08:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c5587fcd-e9d8-4a0b-a197-88ca846d2e01 tempest-ProjectReaderTests-402678827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:08:19 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-c5587fcd-e9d8-4a0b-a197-88ca846d2e01 tempest-ProjectReaderTests-402678827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:08:19 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-c5587fcd-e9d8-4a0b-a197-88ca846d2e01 tempest-ProjectReaderTests-402678827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:08:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c5587fcd-e9d8-4a0b-a197-88ca846d2e01 tempest-ProjectReaderTests-402678827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:08:19 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-c5587fcd-e9d8-4a0b-a197-88ca846d2e01 tempest-ProjectReaderTests-402678827 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:08:19 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-c5587fcd-e9d8-4a0b-a197-88ca846d2e01 tempest-ProjectReaderTests-402678827 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 02:08:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c5587fcd-e9d8-4a0b-a197-88ca846d2e01 tempest-ProjectReaderTests-402678827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a7f6f901-a4a0-47e5-891b-68078c5d61e3 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:08:19 devstack sudo[107607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a7f6f901-a4a0-47e5-891b-68078c5d61e3 1073741824 Jul 08 02:08:19 devstack sudo[107607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:08:20 devstack sudo[107607]: pam_unix(sudo:session): session closed for user root Jul 08 02:08:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c5587fcd-e9d8-4a0b-a197-88ca846d2e01 tempest-ProjectReaderTests-402678827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a7f6f901-a4a0-47e5-891b-68078c5d61e3 1073741824" returned: 0 in 0.915s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:08:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c5587fcd-e9d8-4a0b-a197-88ca846d2e01 tempest-ProjectReaderTests-402678827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a7f6f901-a4a0-47e5-891b-68078c5d61e3 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:08:20 devstack sudo[107612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a7f6f901-a4a0-47e5-891b-68078c5d61e3 Jul 08 02:08:20 devstack sudo[107612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:08:20 devstack cinder-volume[87134]: DEBUG oslo_service.periodic_task [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87134) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 02:08:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:08:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:08:20 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:08:20 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:08:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:08:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:08:20 devstack sudo[107612]: pam_unix(sudo:session): session closed for user root Jul 08 02:08:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-c5587fcd-e9d8-4a0b-a197-88ca846d2e01 tempest-ProjectReaderTests-402678827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a7f6f901-a4a0-47e5-891b-68078c5d61e3" returned: 0 in 0.680s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:08:20 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-c5587fcd-e9d8-4a0b-a197-88ca846d2e01 tempest-ProjectReaderTests-402678827 None] <== create_volume: return (1637ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:08:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-c5587fcd-e9d8-4a0b-a197-88ca846d2e01 tempest-ProjectReaderTests-402678827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.640s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:08:20 devstack sudo[107616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 02:08:20 devstack sudo[107616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:08:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c5587fcd-e9d8-4a0b-a197-88ca846d2e01 tempest-ProjectReaderTests-402678827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42133c96-b6d4-42db-9c44-2856551b59ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7f6f901-a4a0-47e5-891b-68078c5d61e3', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:08:20 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c5587fcd-e9d8-4a0b-a197-88ca846d2e01 tempest-ProjectReaderTests-402678827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5bc8b90-3f5e-4b08-be3c-769c193769c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:08:21 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-c5587fcd-e9d8-4a0b-a197-88ca846d2e01 tempest-ProjectReaderTests-402678827 None] Volume volume-a7f6f901-a4a0-47e5-891b-68078c5d61e3 (a7f6f901-a4a0-47e5-891b-68078c5d61e3): created successfully Jul 08 02:08:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c5587fcd-e9d8-4a0b-a197-88ca846d2e01 tempest-ProjectReaderTests-402678827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5bc8b90-3f5e-4b08-be3c-769c193769c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:08:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-c5587fcd-e9d8-4a0b-a197-88ca846d2e01 tempest-ProjectReaderTests-402678827 None] Flow 'volume_create_manager' (4df24390-fd2b-4525-b0a8-f70e4ce6849d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:08:21 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-c5587fcd-e9d8-4a0b-a197-88ca846d2e01 tempest-ProjectReaderTests-402678827 None] Created volume successfully. Jul 08 02:08:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6f4ae0e0-fa3c-4003-ad28-f2410c2d7da5 tempest-ProjectReaderTests-402678827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:08:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6f4ae0e0-fa3c-4003-ad28-f2410c2d7da5 tempest-ProjectReaderTests-402678827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:08:21 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-6f4ae0e0-fa3c-4003-ad28-f2410c2d7da5 tempest-ProjectReaderTests-402678827 None] Creating offline snapshot 23b0989c-6807-4f16-b87d-3a4a46434565 of volume a7f6f901-a4a0-47e5-891b-68078c5d61e3 {{(pid=87134) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 02:08:21 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[a55c02c3-e724-46e6-b707-5250d97e687c]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:08:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6f4ae0e0-fa3c-4003-ad28-f2410c2d7da5 tempest-ProjectReaderTests-402678827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a7f6f901-a4a0-47e5-891b-68078c5d61e3 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:08:21 devstack sudo[107616]: pam_unix(sudo:session): session closed for user root Jul 08 02:08:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.736s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:08:21 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:08:21 devstack cinder-volume[87134]: DEBUG oslo_service.periodic_task [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running periodic task VolumeManager._thread_info {{(pid=87134) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 02:08:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] thread count: 28 {{(pid=87134) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 02:08:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] thread info: [<_MainThread(MainThread, started 129378964615296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87134) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 02:08:21 devstack sudo[107619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a7f6f901-a4a0-47e5-891b-68078c5d61e3 Jul 08 02:08:21 devstack sudo[107619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:08:22 devstack sudo[107619]: pam_unix(sudo:session): session closed for user root Jul 08 02:08:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6f4ae0e0-fa3c-4003-ad28-f2410c2d7da5 tempest-ProjectReaderTests-402678827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a7f6f901-a4a0-47e5-891b-68078c5d61e3" returned: 0 in 0.793s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:08:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6f4ae0e0-fa3c-4003-ad28-f2410c2d7da5 tempest-ProjectReaderTests-402678827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a7f6f901-a4a0-47e5-891b-68078c5d61e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a7f6f901-a4a0-47e5-891b-68078c5d61e3.23b0989c-6807-4f16-b87d-3a4a46434565 1G {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:08:22 devstack sudo[107624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a7f6f901-a4a0-47e5-891b-68078c5d61e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a7f6f901-a4a0-47e5-891b-68078c5d61e3.23b0989c-6807-4f16-b87d-3a4a46434565 1G Jul 08 02:08:22 devstack sudo[107624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:08:23 devstack sudo[107624]: pam_unix(sudo:session): session closed for user root Jul 08 02:08:23 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6f4ae0e0-fa3c-4003-ad28-f2410c2d7da5 tempest-ProjectReaderTests-402678827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a7f6f901-a4a0-47e5-891b-68078c5d61e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a7f6f901-a4a0-47e5-891b-68078c5d61e3.23b0989c-6807-4f16-b87d-3a4a46434565 1G" returned: 0 in 0.840s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:08:23 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6f4ae0e0-fa3c-4003-ad28-f2410c2d7da5 tempest-ProjectReaderTests-402678827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7f6f901-a4a0-47e5-891b-68078c5d61e3 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a7f6f901-a4a0-47e5-891b-68078c5d61e3.23b0989c-6807-4f16-b87d-3a4a46434565 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:08:23 devstack sudo[107630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7f6f901-a4a0-47e5-891b-68078c5d61e3 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a7f6f901-a4a0-47e5-891b-68078c5d61e3.23b0989c-6807-4f16-b87d-3a4a46434565 Jul 08 02:08:23 devstack sudo[107630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:08:24 devstack sudo[107630]: pam_unix(sudo:session): session closed for user root Jul 08 02:08:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6f4ae0e0-fa3c-4003-ad28-f2410c2d7da5 tempest-ProjectReaderTests-402678827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7f6f901-a4a0-47e5-891b-68078c5d61e3 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a7f6f901-a4a0-47e5-891b-68078c5d61e3.23b0989c-6807-4f16-b87d-3a4a46434565" returned: 0 in 0.739s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:08:24 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-6f4ae0e0-fa3c-4003-ad28-f2410c2d7da5 tempest-ProjectReaderTests-402678827 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a7f6f901-a4a0-47e5-891b-68078c5d61e3.23b0989c-6807-4f16-b87d-3a4a46434565 is being set with open permissions: ugo+rw Jul 08 02:08:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6f4ae0e0-fa3c-4003-ad28-f2410c2d7da5 tempest-ProjectReaderTests-402678827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a7f6f901-a4a0-47e5-891b-68078c5d61e3.23b0989c-6807-4f16-b87d-3a4a46434565 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:08:24 devstack sudo[107635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a7f6f901-a4a0-47e5-891b-68078c5d61e3.23b0989c-6807-4f16-b87d-3a4a46434565 Jul 08 02:08:24 devstack sudo[107635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:08:24 devstack sudo[107635]: pam_unix(sudo:session): session closed for user root Jul 08 02:08:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6f4ae0e0-fa3c-4003-ad28-f2410c2d7da5 tempest-ProjectReaderTests-402678827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a7f6f901-a4a0-47e5-891b-68078c5d61e3.23b0989c-6807-4f16-b87d-3a4a46434565" returned: 0 in 0.685s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:08:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6f4ae0e0-fa3c-4003-ad28-f2410c2d7da5 tempest-ProjectReaderTests-402678827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a7f6f901-a4a0-47e5-891b-68078c5d61e3.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:08:24 devstack sudo[107638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a7f6f901-a4a0-47e5-891b-68078c5d61e3.info Jul 08 02:08:24 devstack sudo[107638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:08:25 devstack sudo[107638]: pam_unix(sudo:session): session closed for user root Jul 08 02:08:25 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6f4ae0e0-fa3c-4003-ad28-f2410c2d7da5 tempest-ProjectReaderTests-402678827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a7f6f901-a4a0-47e5-891b-68078c5d61e3.info" returned: 0 in 0.662s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:08:25 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-6f4ae0e0-fa3c-4003-ad28-f2410c2d7da5 tempest-ProjectReaderTests-402678827 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a7f6f901-a4a0-47e5-891b-68078c5d61e3.info is being set with open permissions: ugo+rw Jul 08 02:08:25 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6f4ae0e0-fa3c-4003-ad28-f2410c2d7da5 tempest-ProjectReaderTests-402678827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a7f6f901-a4a0-47e5-891b-68078c5d61e3.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:08:25 devstack sudo[107641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a7f6f901-a4a0-47e5-891b-68078c5d61e3.info Jul 08 02:08:25 devstack sudo[107641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:08:26 devstack sudo[107641]: pam_unix(sudo:session): session closed for user root Jul 08 02:08:26 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6f4ae0e0-fa3c-4003-ad28-f2410c2d7da5 tempest-ProjectReaderTests-402678827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a7f6f901-a4a0-47e5-891b-68078c5d61e3.info" returned: 0 in 0.726s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:08:26 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6f4ae0e0-fa3c-4003-ad28-f2410c2d7da5 tempest-ProjectReaderTests-402678827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.551s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:08:26 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-6f4ae0e0-fa3c-4003-ad28-f2410c2d7da5 tempest-ProjectReaderTests-402678827 None] Create snapshot completed successfully Jul 08 02:08:26 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-f7e9afba-dc8e-47a4-b121-1013560d83ad tempest-ProjectReaderTests-402678827 None] Acquiring lock "cinder-23b0989c-6807-4f16-b87d-3a4a46434565-delete_snapshot" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:08:26 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-f7e9afba-dc8e-47a4-b121-1013560d83ad tempest-ProjectReaderTests-402678827 None] Lock "cinder-23b0989c-6807-4f16-b87d-3a4a46434565-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:08:26 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-f7e9afba-dc8e-47a4-b121-1013560d83ad tempest-ProjectReaderTests-402678827 None] Acquiring lock "cinder-quobyte-a7f6f901-a4a0-47e5-891b-68078c5d61e3" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:08:27 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-f7e9afba-dc8e-47a4-b121-1013560d83ad tempest-ProjectReaderTests-402678827 None] Lock "cinder-quobyte-a7f6f901-a4a0-47e5-891b-68078c5d61e3" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:08:27 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-f7e9afba-dc8e-47a4-b121-1013560d83ad tempest-ProjectReaderTests-402678827 None] Acquiring lock "cinder-quobyte-23b0989c-6807-4f16-b87d-3a4a46434565" by "_delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:08:27 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-f7e9afba-dc8e-47a4-b121-1013560d83ad tempest-ProjectReaderTests-402678827 None] Lock "cinder-quobyte-23b0989c-6807-4f16-b87d-3a4a46434565" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:08:27 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-f7e9afba-dc8e-47a4-b121-1013560d83ad tempest-ProjectReaderTests-402678827 None] Deleting offline snapshot 23b0989c-6807-4f16-b87d-3a4a46434565 of volume a7f6f901-a4a0-47e5-891b-68078c5d61e3 {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 02:08:27 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-f7e9afba-dc8e-47a4-b121-1013560d83ad tempest-ProjectReaderTests-402678827 None] snapshot_file for this snap is: volume-a7f6f901-a4a0-47e5-891b-68078c5d61e3.23b0989c-6807-4f16-b87d-3a4a46434565 {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 02:08:27 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e889bc3-f3a1-491f-bc99-0b30b21a64c4]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:08:27 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f7e9afba-dc8e-47a4-b121-1013560d83ad tempest-ProjectReaderTests-402678827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a7f6f901-a4a0-47e5-891b-68078c5d61e3.23b0989c-6807-4f16-b87d-3a4a46434565 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:08:27 devstack sudo[107644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a7f6f901-a4a0-47e5-891b-68078c5d61e3.23b0989c-6807-4f16-b87d-3a4a46434565 Jul 08 02:08:27 devstack sudo[107644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:08:27 devstack sudo[107644]: pam_unix(sudo:session): session closed for user root Jul 08 02:08:27 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f7e9afba-dc8e-47a4-b121-1013560d83ad tempest-ProjectReaderTests-402678827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a7f6f901-a4a0-47e5-891b-68078c5d61e3.23b0989c-6807-4f16-b87d-3a4a46434565" returned: 0 in 0.781s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:08:27 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-f7e9afba-dc8e-47a4-b121-1013560d83ad tempest-ProjectReaderTests-402678827 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7f6f901-a4a0-47e5-891b-68078c5d61e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:08:27 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[b749eae2-3284-4474-ac57-bd436bcccbce]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:08:27 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f7e9afba-dc8e-47a4-b121-1013560d83ad tempest-ProjectReaderTests-402678827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a7f6f901-a4a0-47e5-891b-68078c5d61e3 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:08:27 devstack sudo[107649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a7f6f901-a4a0-47e5-891b-68078c5d61e3 Jul 08 02:08:27 devstack sudo[107649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:08:28 devstack sudo[107649]: pam_unix(sudo:session): session closed for user root Jul 08 02:08:28 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f7e9afba-dc8e-47a4-b121-1013560d83ad tempest-ProjectReaderTests-402678827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a7f6f901-a4a0-47e5-891b-68078c5d61e3" returned: 0 in 0.750s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:08:28 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f7e9afba-dc8e-47a4-b121-1013560d83ad tempest-ProjectReaderTests-402678827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a7f6f901-a4a0-47e5-891b-68078c5d61e3.23b0989c-6807-4f16-b87d-3a4a46434565 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:08:28 devstack sudo[107655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a7f6f901-a4a0-47e5-891b-68078c5d61e3.23b0989c-6807-4f16-b87d-3a4a46434565 Jul 08 02:08:28 devstack sudo[107655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:08:29 devstack sudo[107655]: pam_unix(sudo:session): session closed for user root Jul 08 02:08:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f7e9afba-dc8e-47a4-b121-1013560d83ad tempest-ProjectReaderTests-402678827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a7f6f901-a4a0-47e5-891b-68078c5d61e3.23b0989c-6807-4f16-b87d-3a4a46434565" returned: 0 in 0.784s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:08:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f7e9afba-dc8e-47a4-b121-1013560d83ad tempest-ProjectReaderTests-402678827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a7f6f901-a4a0-47e5-891b-68078c5d61e3.23b0989c-6807-4f16-b87d-3a4a46434565 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:08:29 devstack sudo[107660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a7f6f901-a4a0-47e5-891b-68078c5d61e3.23b0989c-6807-4f16-b87d-3a4a46434565 Jul 08 02:08:29 devstack sudo[107660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:08:30 devstack sudo[107660]: pam_unix(sudo:session): session closed for user root Jul 08 02:08:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f7e9afba-dc8e-47a4-b121-1013560d83ad tempest-ProjectReaderTests-402678827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a7f6f901-a4a0-47e5-891b-68078c5d61e3.23b0989c-6807-4f16-b87d-3a4a46434565" returned: 0 in 0.700s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:08:30 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-f7e9afba-dc8e-47a4-b121-1013560d83ad tempest-ProjectReaderTests-402678827 None] Lock "cinder-quobyte-23b0989c-6807-4f16-b87d-3a4a46434565" released by "_delete_snapshot" :: held 3.115s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:08:30 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-f7e9afba-dc8e-47a4-b121-1013560d83ad tempest-ProjectReaderTests-402678827 None] Lock "cinder-quobyte-a7f6f901-a4a0-47e5-891b-68078c5d61e3" released by "delete_snapshot" :: held 3.140s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:08:30 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-f7e9afba-dc8e-47a4-b121-1013560d83ad tempest-ProjectReaderTests-402678827 None] Created reservations ['a600b955-2779-4219-9e02-41526842c6e5', 'e2f8ce18-69d7-43bd-b04b-4eb1d2d66a7e', '954f99b9-3bfc-4ae9-a1ee-e819e27549ca', 'f71ed4c4-4d8c-42d0-b6a8-96fa61883d5d'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:08:30 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-f7e9afba-dc8e-47a4-b121-1013560d83ad tempest-ProjectReaderTests-402678827 None] Delete snapshot completed successfully. Jul 08 02:08:30 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-f7e9afba-dc8e-47a4-b121-1013560d83ad tempest-ProjectReaderTests-402678827 None] Lock "cinder-23b0989c-6807-4f16-b87d-3a4a46434565-delete_snapshot" released by "delete_snapshot" :: held 3.297s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:08:31 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-cc16feb4-5e3b-44a1-9a84-e00934acf1b7 tempest-ProjectReaderTests-402678827 None] Acquiring lock "cinder-a7f6f901-a4a0-47e5-891b-68078c5d61e3-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:08:31 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-cc16feb4-5e3b-44a1-9a84-e00934acf1b7 tempest-ProjectReaderTests-402678827 None] Lock "cinder-a7f6f901-a4a0-47e5-891b-68078c5d61e3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:08:31 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-cc16feb4-5e3b-44a1-9a84-e00934acf1b7 tempest-ProjectReaderTests-402678827 None] Acquiring lock "cinder-quobyte-a7f6f901-a4a0-47e5-891b-68078c5d61e3" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:08:31 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-cc16feb4-5e3b-44a1-9a84-e00934acf1b7 tempest-ProjectReaderTests-402678827 None] Lock "cinder-quobyte-a7f6f901-a4a0-47e5-891b-68078c5d61e3" acquired by "delete_volume" :: waited 0.016s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:08:31 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[751622e5-19ed-4934-871f-8eaee8540ab0]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:08:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-cc16feb4-5e3b-44a1-9a84-e00934acf1b7 tempest-ProjectReaderTests-402678827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a7f6f901-a4a0-47e5-891b-68078c5d61e3 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:08:31 devstack sudo[107663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a7f6f901-a4a0-47e5-891b-68078c5d61e3 Jul 08 02:08:31 devstack sudo[107663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:08:32 devstack sudo[107663]: pam_unix(sudo:session): session closed for user root Jul 08 02:08:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-cc16feb4-5e3b-44a1-9a84-e00934acf1b7 tempest-ProjectReaderTests-402678827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a7f6f901-a4a0-47e5-891b-68078c5d61e3" returned: 0 in 0.869s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:08:32 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-cc16feb4-5e3b-44a1-9a84-e00934acf1b7 tempest-ProjectReaderTests-402678827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a7f6f901-a4a0-47e5-891b-68078c5d61e3 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:08:32 devstack sudo[107674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a7f6f901-a4a0-47e5-891b-68078c5d61e3 Jul 08 02:08:32 devstack sudo[107674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:08:33 devstack sudo[107674]: pam_unix(sudo:session): session closed for user root Jul 08 02:08:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-cc16feb4-5e3b-44a1-9a84-e00934acf1b7 tempest-ProjectReaderTests-402678827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-a7f6f901-a4a0-47e5-891b-68078c5d61e3" returned: 0 in 0.772s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:08:33 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-cc16feb4-5e3b-44a1-9a84-e00934acf1b7 tempest-ProjectReaderTests-402678827 None] Lock "cinder-quobyte-a7f6f901-a4a0-47e5-891b-68078c5d61e3" released by "delete_volume" :: held 1.732s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:08:33 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-cc16feb4-5e3b-44a1-9a84-e00934acf1b7 tempest-ProjectReaderTests-402678827 None] Created reservations ['abdf6473-ba2d-4613-b063-ab0b2f143891', 'e682264b-a61c-4a85-963a-e9a6c0387458', '13d607b7-5dd3-48af-a655-50793f0b0009', '0ff252aa-fcac-41ea-864e-df310f3fe86f'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:08:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-cc16feb4-5e3b-44a1-9a84-e00934acf1b7 tempest-ProjectReaderTests-402678827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:08:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-cc16feb4-5e3b-44a1-9a84-e00934acf1b7 tempest-ProjectReaderTests-402678827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:08:33 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-cc16feb4-5e3b-44a1-9a84-e00934acf1b7 tempest-ProjectReaderTests-402678827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:08:33 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-cc16feb4-5e3b-44a1-9a84-e00934acf1b7 tempest-ProjectReaderTests-402678827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:08:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-cc16feb4-5e3b-44a1-9a84-e00934acf1b7 tempest-ProjectReaderTests-402678827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:08:33 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-cc16feb4-5e3b-44a1-9a84-e00934acf1b7 tempest-ProjectReaderTests-402678827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:08:33 devstack sudo[107678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 02:08:33 devstack sudo[107678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:08:34 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-369ec08a-2576-4020-9e1e-f523c2401a20 tempest-ProjectReaderTests-402678827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:08:34 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-369ec08a-2576-4020-9e1e-f523c2401a20 tempest-ProjectReaderTests-402678827 None] Flow 'volume_create_manager' (116f2d5c-fa75-4e09-bcc8-9da7b7f0c0fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:08:34 devstack sudo[107678]: pam_unix(sudo:session): session closed for user root Jul 08 02:08:34 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-369ec08a-2576-4020-9e1e-f523c2401a20 tempest-ProjectReaderTests-402678827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b383aea-3ba7-4296-b298-63dfd709ce3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:08:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-cc16feb4-5e3b-44a1-9a84-e00934acf1b7 tempest-ProjectReaderTests-402678827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.783s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:08:34 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-cc16feb4-5e3b-44a1-9a84-e00934acf1b7 tempest-ProjectReaderTests-402678827 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:08:34 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-cc16feb4-5e3b-44a1-9a84-e00934acf1b7 tempest-ProjectReaderTests-402678827 None] Deleted volume successfully. Jul 08 02:08:34 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-369ec08a-2576-4020-9e1e-f523c2401a20 tempest-ProjectReaderTests-402678827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b383aea-3ba7-4296-b298-63dfd709ce3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:08:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-513903955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1680a887-c6fd-4316-8750-5c71596b8635,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='010cd051a2434efcab451de7970a9ed3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:08:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:08:34Z,use_quota=True,user_id='fd11f14eeb354dd7acd84ed9187a6aa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:08:34 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-369ec08a-2576-4020-9e1e-f523c2401a20 tempest-ProjectReaderTests-402678827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87bfece2-6b81-4b62-8bc0-66cc855bbd79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:08:34 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-369ec08a-2576-4020-9e1e-f523c2401a20 tempest-ProjectReaderTests-402678827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87bfece2-6b81-4b62-8bc0-66cc855bbd79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:08:34 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-369ec08a-2576-4020-9e1e-f523c2401a20 tempest-ProjectReaderTests-402678827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42ab0007-6c2a-4961-9fa9-1df10ceba219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:08:34 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-369ec08a-2576-4020-9e1e-f523c2401a20 tempest-ProjectReaderTests-402678827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42ab0007-6c2a-4961-9fa9-1df10ceba219) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1680a887-c6fd-4316-8750-5c71596b8635', 'volume_name': 'volume-1680a887-c6fd-4316-8750-5c71596b8635', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:08:34 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-369ec08a-2576-4020-9e1e-f523c2401a20 tempest-ProjectReaderTests-402678827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea0eee77-9311-4b09-ae4e-2bb9870365ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:08:34 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-369ec08a-2576-4020-9e1e-f523c2401a20 tempest-ProjectReaderTests-402678827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea0eee77-9311-4b09-ae4e-2bb9870365ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:08:34 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-369ec08a-2576-4020-9e1e-f523c2401a20 tempest-ProjectReaderTests-402678827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (832b2cf1-dcdd-4367-9d3b-864c8068f79f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:08:34 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-369ec08a-2576-4020-9e1e-f523c2401a20 tempest-ProjectReaderTests-402678827 None] Volume 1680a887-c6fd-4316-8750-5c71596b8635: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1680a887-c6fd-4316-8750-5c71596b8635', 'volume_size': 1} Jul 08 02:08:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-369ec08a-2576-4020-9e1e-f523c2401a20 tempest-ProjectReaderTests-402678827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:08:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-369ec08a-2576-4020-9e1e-f523c2401a20 tempest-ProjectReaderTests-402678827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:08:34 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-369ec08a-2576-4020-9e1e-f523c2401a20 tempest-ProjectReaderTests-402678827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:08:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-513903955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1680a887-c6fd-4316-8750-5c71596b8635,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='010cd051a2434efcab451de7970a9ed3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:08:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:08:34Z,use_quota=True,user_id='fd11f14eeb354dd7acd84ed9187a6aa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:08:34 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-369ec08a-2576-4020-9e1e-f523c2401a20 tempest-ProjectReaderTests-402678827 None] Creating volume 1680a887-c6fd-4316-8750-5c71596b8635 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:08:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-369ec08a-2576-4020-9e1e-f523c2401a20 tempest-ProjectReaderTests-402678827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:08:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-369ec08a-2576-4020-9e1e-f523c2401a20 tempest-ProjectReaderTests-402678827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:08:34 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-369ec08a-2576-4020-9e1e-f523c2401a20 tempest-ProjectReaderTests-402678827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:08:34 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-369ec08a-2576-4020-9e1e-f523c2401a20 tempest-ProjectReaderTests-402678827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:08:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-369ec08a-2576-4020-9e1e-f523c2401a20 tempest-ProjectReaderTests-402678827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:08:34 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-369ec08a-2576-4020-9e1e-f523c2401a20 tempest-ProjectReaderTests-402678827 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:08:34 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-369ec08a-2576-4020-9e1e-f523c2401a20 tempest-ProjectReaderTests-402678827 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 02:08:34 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-369ec08a-2576-4020-9e1e-f523c2401a20 tempest-ProjectReaderTests-402678827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1680a887-c6fd-4316-8750-5c71596b8635 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:08:34 devstack sudo[107681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1680a887-c6fd-4316-8750-5c71596b8635 1073741824 Jul 08 02:08:34 devstack sudo[107681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:08:34 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-cc16feb4-5e3b-44a1-9a84-e00934acf1b7 tempest-ProjectReaderTests-402678827 None] Lock "cinder-a7f6f901-a4a0-47e5-891b-68078c5d61e3-delete_volume" released by "delete_volume" :: held 2.920s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:08:35 devstack sudo[107681]: pam_unix(sudo:session): session closed for user root Jul 08 02:08:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-369ec08a-2576-4020-9e1e-f523c2401a20 tempest-ProjectReaderTests-402678827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1680a887-c6fd-4316-8750-5c71596b8635 1073741824" returned: 0 in 0.924s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:08:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-369ec08a-2576-4020-9e1e-f523c2401a20 tempest-ProjectReaderTests-402678827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1680a887-c6fd-4316-8750-5c71596b8635 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:08:35 devstack sudo[107687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1680a887-c6fd-4316-8750-5c71596b8635 Jul 08 02:08:35 devstack sudo[107687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:08:35 devstack sudo[107687]: pam_unix(sudo:session): session closed for user root Jul 08 02:08:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-369ec08a-2576-4020-9e1e-f523c2401a20 tempest-ProjectReaderTests-402678827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1680a887-c6fd-4316-8750-5c71596b8635" returned: 0 in 0.743s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:08:35 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-369ec08a-2576-4020-9e1e-f523c2401a20 tempest-ProjectReaderTests-402678827 None] <== create_volume: return (1711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:08:35 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-369ec08a-2576-4020-9e1e-f523c2401a20 tempest-ProjectReaderTests-402678827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.713s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:08:35 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-369ec08a-2576-4020-9e1e-f523c2401a20 tempest-ProjectReaderTests-402678827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (832b2cf1-dcdd-4367-9d3b-864c8068f79f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1680a887-c6fd-4316-8750-5c71596b8635', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:08:35 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-369ec08a-2576-4020-9e1e-f523c2401a20 tempest-ProjectReaderTests-402678827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f0bdaf7-b4b6-413c-8d0d-65233d7e4eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:08:35 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-369ec08a-2576-4020-9e1e-f523c2401a20 tempest-ProjectReaderTests-402678827 None] Volume volume-1680a887-c6fd-4316-8750-5c71596b8635 (1680a887-c6fd-4316-8750-5c71596b8635): created successfully Jul 08 02:08:35 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-369ec08a-2576-4020-9e1e-f523c2401a20 tempest-ProjectReaderTests-402678827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f0bdaf7-b4b6-413c-8d0d-65233d7e4eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:08:35 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-369ec08a-2576-4020-9e1e-f523c2401a20 tempest-ProjectReaderTests-402678827 None] Flow 'volume_create_manager' (116f2d5c-fa75-4e09-bcc8-9da7b7f0c0fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:08:35 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-369ec08a-2576-4020-9e1e-f523c2401a20 tempest-ProjectReaderTests-402678827 None] Created volume successfully. Jul 08 02:08:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-2b9e0299-f084-4f9b-9559-736bed7a6d6c tempest-ProjectReaderTests-402678827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:08:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-2b9e0299-f084-4f9b-9559-736bed7a6d6c tempest-ProjectReaderTests-402678827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:08:36 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-2b9e0299-f084-4f9b-9559-736bed7a6d6c tempest-ProjectReaderTests-402678827 None] Creating offline snapshot 077062c2-e72d-4060-971f-8607eb85fc7a of volume 1680a887-c6fd-4316-8750-5c71596b8635 {{(pid=87134) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 02:08:36 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f7684a-c03f-4aa5-b724-7f95f2759a77]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:08:36 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2b9e0299-f084-4f9b-9559-736bed7a6d6c tempest-ProjectReaderTests-402678827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1680a887-c6fd-4316-8750-5c71596b8635 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:08:36 devstack sudo[107724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1680a887-c6fd-4316-8750-5c71596b8635 Jul 08 02:08:36 devstack sudo[107724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:08:37 devstack sudo[107724]: pam_unix(sudo:session): session closed for user root Jul 08 02:08:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2b9e0299-f084-4f9b-9559-736bed7a6d6c tempest-ProjectReaderTests-402678827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1680a887-c6fd-4316-8750-5c71596b8635" returned: 0 in 0.854s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:08:37 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2b9e0299-f084-4f9b-9559-736bed7a6d6c tempest-ProjectReaderTests-402678827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1680a887-c6fd-4316-8750-5c71596b8635,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1680a887-c6fd-4316-8750-5c71596b8635.077062c2-e72d-4060-971f-8607eb85fc7a 1G {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:08:37 devstack sudo[107731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1680a887-c6fd-4316-8750-5c71596b8635,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1680a887-c6fd-4316-8750-5c71596b8635.077062c2-e72d-4060-971f-8607eb85fc7a 1G Jul 08 02:08:37 devstack sudo[107731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:08:38 devstack sudo[107731]: pam_unix(sudo:session): session closed for user root Jul 08 02:08:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2b9e0299-f084-4f9b-9559-736bed7a6d6c tempest-ProjectReaderTests-402678827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1680a887-c6fd-4316-8750-5c71596b8635,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1680a887-c6fd-4316-8750-5c71596b8635.077062c2-e72d-4060-971f-8607eb85fc7a 1G" returned: 0 in 0.846s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:08:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2b9e0299-f084-4f9b-9559-736bed7a6d6c tempest-ProjectReaderTests-402678827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1680a887-c6fd-4316-8750-5c71596b8635 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1680a887-c6fd-4316-8750-5c71596b8635.077062c2-e72d-4060-971f-8607eb85fc7a {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:08:38 devstack sudo[107737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1680a887-c6fd-4316-8750-5c71596b8635 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1680a887-c6fd-4316-8750-5c71596b8635.077062c2-e72d-4060-971f-8607eb85fc7a Jul 08 02:08:38 devstack sudo[107737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:08:38 devstack sudo[107737]: pam_unix(sudo:session): session closed for user root Jul 08 02:08:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2b9e0299-f084-4f9b-9559-736bed7a6d6c tempest-ProjectReaderTests-402678827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1680a887-c6fd-4316-8750-5c71596b8635 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1680a887-c6fd-4316-8750-5c71596b8635.077062c2-e72d-4060-971f-8607eb85fc7a" returned: 0 in 0.718s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:08:38 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-2b9e0299-f084-4f9b-9559-736bed7a6d6c tempest-ProjectReaderTests-402678827 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1680a887-c6fd-4316-8750-5c71596b8635.077062c2-e72d-4060-971f-8607eb85fc7a is being set with open permissions: ugo+rw Jul 08 02:08:38 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2b9e0299-f084-4f9b-9559-736bed7a6d6c tempest-ProjectReaderTests-402678827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1680a887-c6fd-4316-8750-5c71596b8635.077062c2-e72d-4060-971f-8607eb85fc7a {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:08:38 devstack sudo[107742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1680a887-c6fd-4316-8750-5c71596b8635.077062c2-e72d-4060-971f-8607eb85fc7a Jul 08 02:08:38 devstack sudo[107742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:08:39 devstack sudo[107742]: pam_unix(sudo:session): session closed for user root Jul 08 02:08:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2b9e0299-f084-4f9b-9559-736bed7a6d6c tempest-ProjectReaderTests-402678827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1680a887-c6fd-4316-8750-5c71596b8635.077062c2-e72d-4060-971f-8607eb85fc7a" returned: 0 in 0.674s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:08:39 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2b9e0299-f084-4f9b-9559-736bed7a6d6c tempest-ProjectReaderTests-402678827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1680a887-c6fd-4316-8750-5c71596b8635.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:08:39 devstack sudo[107745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1680a887-c6fd-4316-8750-5c71596b8635.info Jul 08 02:08:39 devstack sudo[107745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:08:40 devstack sudo[107745]: pam_unix(sudo:session): session closed for user root Jul 08 02:08:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2b9e0299-f084-4f9b-9559-736bed7a6d6c tempest-ProjectReaderTests-402678827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1680a887-c6fd-4316-8750-5c71596b8635.info" returned: 0 in 0.698s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:08:40 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-2b9e0299-f084-4f9b-9559-736bed7a6d6c tempest-ProjectReaderTests-402678827 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1680a887-c6fd-4316-8750-5c71596b8635.info is being set with open permissions: ugo+rw Jul 08 02:08:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2b9e0299-f084-4f9b-9559-736bed7a6d6c tempest-ProjectReaderTests-402678827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1680a887-c6fd-4316-8750-5c71596b8635.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:08:40 devstack sudo[107748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1680a887-c6fd-4316-8750-5c71596b8635.info Jul 08 02:08:40 devstack sudo[107748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:08:40 devstack sudo[107748]: pam_unix(sudo:session): session closed for user root Jul 08 02:08:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-2b9e0299-f084-4f9b-9559-736bed7a6d6c tempest-ProjectReaderTests-402678827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1680a887-c6fd-4316-8750-5c71596b8635.info" returned: 0 in 0.671s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:08:40 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-2b9e0299-f084-4f9b-9559-736bed7a6d6c tempest-ProjectReaderTests-402678827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.553s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:08:40 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-2b9e0299-f084-4f9b-9559-736bed7a6d6c tempest-ProjectReaderTests-402678827 None] Create snapshot completed successfully Jul 08 02:08:41 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-976dc125-1e68-4e94-9765-6421ad9123ee tempest-ProjectReaderTests-402678827 None] Acquiring lock "cinder-077062c2-e72d-4060-971f-8607eb85fc7a-delete_snapshot" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:08:41 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-976dc125-1e68-4e94-9765-6421ad9123ee tempest-ProjectReaderTests-402678827 None] Lock "cinder-077062c2-e72d-4060-971f-8607eb85fc7a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:08:41 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-976dc125-1e68-4e94-9765-6421ad9123ee tempest-ProjectReaderTests-402678827 None] Acquiring lock "cinder-quobyte-1680a887-c6fd-4316-8750-5c71596b8635" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:08:41 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-976dc125-1e68-4e94-9765-6421ad9123ee tempest-ProjectReaderTests-402678827 None] Lock "cinder-quobyte-1680a887-c6fd-4316-8750-5c71596b8635" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:08:41 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-976dc125-1e68-4e94-9765-6421ad9123ee tempest-ProjectReaderTests-402678827 None] Acquiring lock "cinder-quobyte-077062c2-e72d-4060-971f-8607eb85fc7a" by "_delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:08:41 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-976dc125-1e68-4e94-9765-6421ad9123ee tempest-ProjectReaderTests-402678827 None] Lock "cinder-quobyte-077062c2-e72d-4060-971f-8607eb85fc7a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:08:41 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-976dc125-1e68-4e94-9765-6421ad9123ee tempest-ProjectReaderTests-402678827 None] Deleting offline snapshot 077062c2-e72d-4060-971f-8607eb85fc7a of volume 1680a887-c6fd-4316-8750-5c71596b8635 {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 02:08:41 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-976dc125-1e68-4e94-9765-6421ad9123ee tempest-ProjectReaderTests-402678827 None] snapshot_file for this snap is: volume-1680a887-c6fd-4316-8750-5c71596b8635.077062c2-e72d-4060-971f-8607eb85fc7a {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 02:08:41 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2833b16-34d6-4ddb-bd0f-41fee424cdd0]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:08:41 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-976dc125-1e68-4e94-9765-6421ad9123ee tempest-ProjectReaderTests-402678827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1680a887-c6fd-4316-8750-5c71596b8635.077062c2-e72d-4060-971f-8607eb85fc7a {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:08:41 devstack sudo[107751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1680a887-c6fd-4316-8750-5c71596b8635.077062c2-e72d-4060-971f-8607eb85fc7a Jul 08 02:08:41 devstack sudo[107751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:08:42 devstack sudo[107751]: pam_unix(sudo:session): session closed for user root Jul 08 02:08:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-976dc125-1e68-4e94-9765-6421ad9123ee tempest-ProjectReaderTests-402678827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1680a887-c6fd-4316-8750-5c71596b8635.077062c2-e72d-4060-971f-8607eb85fc7a" returned: 0 in 0.931s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:08:42 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-976dc125-1e68-4e94-9765-6421ad9123ee tempest-ProjectReaderTests-402678827 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1680a887-c6fd-4316-8750-5c71596b8635(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:08:42 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f188229-062d-462f-9f60-97f12c3cf2fd]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:08:42 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-976dc125-1e68-4e94-9765-6421ad9123ee tempest-ProjectReaderTests-402678827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1680a887-c6fd-4316-8750-5c71596b8635 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:08:42 devstack sudo[107756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1680a887-c6fd-4316-8750-5c71596b8635 Jul 08 02:08:42 devstack sudo[107756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:08:43 devstack sudo[107756]: pam_unix(sudo:session): session closed for user root Jul 08 02:08:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-976dc125-1e68-4e94-9765-6421ad9123ee tempest-ProjectReaderTests-402678827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1680a887-c6fd-4316-8750-5c71596b8635" returned: 0 in 0.777s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:08:43 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-976dc125-1e68-4e94-9765-6421ad9123ee tempest-ProjectReaderTests-402678827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1680a887-c6fd-4316-8750-5c71596b8635.077062c2-e72d-4060-971f-8607eb85fc7a {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:08:43 devstack sudo[107762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1680a887-c6fd-4316-8750-5c71596b8635.077062c2-e72d-4060-971f-8607eb85fc7a Jul 08 02:08:43 devstack sudo[107762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:08:44 devstack sudo[107762]: pam_unix(sudo:session): session closed for user root Jul 08 02:08:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-976dc125-1e68-4e94-9765-6421ad9123ee tempest-ProjectReaderTests-402678827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1680a887-c6fd-4316-8750-5c71596b8635.077062c2-e72d-4060-971f-8607eb85fc7a" returned: 0 in 0.936s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:08:44 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-976dc125-1e68-4e94-9765-6421ad9123ee tempest-ProjectReaderTests-402678827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1680a887-c6fd-4316-8750-5c71596b8635.077062c2-e72d-4060-971f-8607eb85fc7a {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:08:44 devstack sudo[107767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1680a887-c6fd-4316-8750-5c71596b8635.077062c2-e72d-4060-971f-8607eb85fc7a Jul 08 02:08:44 devstack sudo[107767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:08:45 devstack sudo[107767]: pam_unix(sudo:session): session closed for user root Jul 08 02:08:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-976dc125-1e68-4e94-9765-6421ad9123ee tempest-ProjectReaderTests-402678827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1680a887-c6fd-4316-8750-5c71596b8635.077062c2-e72d-4060-971f-8607eb85fc7a" returned: 0 in 0.719s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:08:45 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-976dc125-1e68-4e94-9765-6421ad9123ee tempest-ProjectReaderTests-402678827 None] Lock "cinder-quobyte-077062c2-e72d-4060-971f-8607eb85fc7a" released by "_delete_snapshot" :: held 3.484s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:08:45 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-976dc125-1e68-4e94-9765-6421ad9123ee tempest-ProjectReaderTests-402678827 None] Lock "cinder-quobyte-1680a887-c6fd-4316-8750-5c71596b8635" released by "delete_snapshot" :: held 3.509s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:08:45 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-976dc125-1e68-4e94-9765-6421ad9123ee tempest-ProjectReaderTests-402678827 None] Created reservations ['e74860ed-f4e2-4cd6-bff9-0f8dbb2b8589', '4e141961-b1ba-40c8-bd9c-6161a863f936', '4bf30240-de45-4f30-b1a2-3b9b6900f3f1', '3477b266-f0e6-4b0b-ab39-5a4e396b8aa9'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:08:45 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-976dc125-1e68-4e94-9765-6421ad9123ee tempest-ProjectReaderTests-402678827 None] Delete snapshot completed successfully. Jul 08 02:08:45 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-976dc125-1e68-4e94-9765-6421ad9123ee tempest-ProjectReaderTests-402678827 None] Lock "cinder-077062c2-e72d-4060-971f-8607eb85fc7a-delete_snapshot" released by "delete_snapshot" :: held 3.701s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:08:45 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-6ce13e08-13a7-44d1-9c42-c4ba7e0245be tempest-ProjectReaderTests-402678827 None] Acquiring lock "cinder-1680a887-c6fd-4316-8750-5c71596b8635-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:08:45 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-6ce13e08-13a7-44d1-9c42-c4ba7e0245be tempest-ProjectReaderTests-402678827 None] Lock "cinder-1680a887-c6fd-4316-8750-5c71596b8635-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:08:45 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-6ce13e08-13a7-44d1-9c42-c4ba7e0245be tempest-ProjectReaderTests-402678827 None] Acquiring lock "cinder-quobyte-1680a887-c6fd-4316-8750-5c71596b8635" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:08:45 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-6ce13e08-13a7-44d1-9c42-c4ba7e0245be tempest-ProjectReaderTests-402678827 None] Lock "cinder-quobyte-1680a887-c6fd-4316-8750-5c71596b8635" acquired by "delete_volume" :: waited 0.017s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:08:45 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b1cedf8-f21a-4f36-945e-7c965eec170e]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:08:45 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6ce13e08-13a7-44d1-9c42-c4ba7e0245be tempest-ProjectReaderTests-402678827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1680a887-c6fd-4316-8750-5c71596b8635 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:08:46 devstack sudo[107770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1680a887-c6fd-4316-8750-5c71596b8635 Jul 08 02:08:46 devstack sudo[107770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:08:46 devstack sudo[107770]: pam_unix(sudo:session): session closed for user root Jul 08 02:08:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6ce13e08-13a7-44d1-9c42-c4ba7e0245be tempest-ProjectReaderTests-402678827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1680a887-c6fd-4316-8750-5c71596b8635" returned: 0 in 0.834s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:08:46 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6ce13e08-13a7-44d1-9c42-c4ba7e0245be tempest-ProjectReaderTests-402678827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1680a887-c6fd-4316-8750-5c71596b8635 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:08:46 devstack sudo[107775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1680a887-c6fd-4316-8750-5c71596b8635 Jul 08 02:08:46 devstack sudo[107775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:08:47 devstack sudo[107775]: pam_unix(sudo:session): session closed for user root Jul 08 02:08:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6ce13e08-13a7-44d1-9c42-c4ba7e0245be tempest-ProjectReaderTests-402678827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-1680a887-c6fd-4316-8750-5c71596b8635" returned: 0 in 0.680s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:08:47 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-6ce13e08-13a7-44d1-9c42-c4ba7e0245be tempest-ProjectReaderTests-402678827 None] Lock "cinder-quobyte-1680a887-c6fd-4316-8750-5c71596b8635" released by "delete_volume" :: held 1.597s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:08:47 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-6ce13e08-13a7-44d1-9c42-c4ba7e0245be tempest-ProjectReaderTests-402678827 None] Created reservations ['4ca5792d-9a08-442f-97f8-09cf7279d512', '8ebd65e5-683b-4346-bbc7-c24abd2a33e9', '52b9d84c-b4a6-4fb1-b93d-da601061fd64', 'ceb08507-7242-4a7a-8339-4075a0de8dee'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:08:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6ce13e08-13a7-44d1-9c42-c4ba7e0245be tempest-ProjectReaderTests-402678827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:08:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6ce13e08-13a7-44d1-9c42-c4ba7e0245be tempest-ProjectReaderTests-402678827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:08:47 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-6ce13e08-13a7-44d1-9c42-c4ba7e0245be tempest-ProjectReaderTests-402678827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:08:47 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-6ce13e08-13a7-44d1-9c42-c4ba7e0245be tempest-ProjectReaderTests-402678827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:08:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-6ce13e08-13a7-44d1-9c42-c4ba7e0245be tempest-ProjectReaderTests-402678827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:08:47 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6ce13e08-13a7-44d1-9c42-c4ba7e0245be tempest-ProjectReaderTests-402678827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:08:47 devstack sudo[107778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 02:08:47 devstack sudo[107778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:08:48 devstack sudo[107778]: pam_unix(sudo:session): session closed for user root Jul 08 02:08:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-6ce13e08-13a7-44d1-9c42-c4ba7e0245be tempest-ProjectReaderTests-402678827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.685s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:08:48 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-6ce13e08-13a7-44d1-9c42-c4ba7e0245be tempest-ProjectReaderTests-402678827 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:08:48 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-6ce13e08-13a7-44d1-9c42-c4ba7e0245be tempest-ProjectReaderTests-402678827 None] Deleted volume successfully. Jul 08 02:08:48 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-6ce13e08-13a7-44d1-9c42-c4ba7e0245be tempest-ProjectReaderTests-402678827 None] Lock "cinder-1680a887-c6fd-4316-8750-5c71596b8635-delete_volume" released by "delete_volume" :: held 2.522s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:08:48 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-dad19c80-c6f5-4b02-902a-1187489b1ca1 tempest-ProjectReaderTests-402678827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:08:48 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-dad19c80-c6f5-4b02-902a-1187489b1ca1 tempest-ProjectReaderTests-402678827 None] Flow 'volume_create_manager' (0cf8255c-39b5-4c7a-8c9d-976565df5264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:08:48 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-dad19c80-c6f5-4b02-902a-1187489b1ca1 tempest-ProjectReaderTests-402678827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0c4af23-bc24-403b-a3a1-1c896f4f2eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:08:48 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-dad19c80-c6f5-4b02-902a-1187489b1ca1 tempest-ProjectReaderTests-402678827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0c4af23-bc24-403b-a3a1-1c896f4f2eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:08:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1531637211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=556ecbab-82ed-4914-9e7b-eb15c1353443,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='010cd051a2434efcab451de7970a9ed3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:08:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:08:49Z,use_quota=True,user_id='fd11f14eeb354dd7acd84ed9187a6aa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:08:48 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-dad19c80-c6f5-4b02-902a-1187489b1ca1 tempest-ProjectReaderTests-402678827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (300a778c-613d-4420-94eb-2962461a52ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:08:48 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-dad19c80-c6f5-4b02-902a-1187489b1ca1 tempest-ProjectReaderTests-402678827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (300a778c-613d-4420-94eb-2962461a52ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:08:48 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-dad19c80-c6f5-4b02-902a-1187489b1ca1 tempest-ProjectReaderTests-402678827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e35a6c19-da4d-4cee-8535-e88d11583cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:08:48 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-dad19c80-c6f5-4b02-902a-1187489b1ca1 tempest-ProjectReaderTests-402678827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e35a6c19-da4d-4cee-8535-e88d11583cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '556ecbab-82ed-4914-9e7b-eb15c1353443', 'volume_name': 'volume-556ecbab-82ed-4914-9e7b-eb15c1353443', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:08:48 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-dad19c80-c6f5-4b02-902a-1187489b1ca1 tempest-ProjectReaderTests-402678827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ca6cba6-f295-4f73-91aa-8e3aa9c782f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:08:48 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-dad19c80-c6f5-4b02-902a-1187489b1ca1 tempest-ProjectReaderTests-402678827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ca6cba6-f295-4f73-91aa-8e3aa9c782f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:08:48 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-dad19c80-c6f5-4b02-902a-1187489b1ca1 tempest-ProjectReaderTests-402678827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0b51205-1c8f-45f9-ae0a-68527589abf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:08:48 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-dad19c80-c6f5-4b02-902a-1187489b1ca1 tempest-ProjectReaderTests-402678827 None] Volume 556ecbab-82ed-4914-9e7b-eb15c1353443: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-556ecbab-82ed-4914-9e7b-eb15c1353443', 'volume_size': 1} Jul 08 02:08:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-dad19c80-c6f5-4b02-902a-1187489b1ca1 tempest-ProjectReaderTests-402678827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:08:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-dad19c80-c6f5-4b02-902a-1187489b1ca1 tempest-ProjectReaderTests-402678827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:08:48 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-dad19c80-c6f5-4b02-902a-1187489b1ca1 tempest-ProjectReaderTests-402678827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:08:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1531637211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=556ecbab-82ed-4914-9e7b-eb15c1353443,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='010cd051a2434efcab451de7970a9ed3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:08:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:08:49Z,use_quota=True,user_id='fd11f14eeb354dd7acd84ed9187a6aa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:08:48 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-dad19c80-c6f5-4b02-902a-1187489b1ca1 tempest-ProjectReaderTests-402678827 None] Creating volume 556ecbab-82ed-4914-9e7b-eb15c1353443 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:08:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-dad19c80-c6f5-4b02-902a-1187489b1ca1 tempest-ProjectReaderTests-402678827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:08:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-dad19c80-c6f5-4b02-902a-1187489b1ca1 tempest-ProjectReaderTests-402678827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:08:48 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-dad19c80-c6f5-4b02-902a-1187489b1ca1 tempest-ProjectReaderTests-402678827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:08:48 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-dad19c80-c6f5-4b02-902a-1187489b1ca1 tempest-ProjectReaderTests-402678827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:08:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-dad19c80-c6f5-4b02-902a-1187489b1ca1 tempest-ProjectReaderTests-402678827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:08:48 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-dad19c80-c6f5-4b02-902a-1187489b1ca1 tempest-ProjectReaderTests-402678827 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:08:48 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-dad19c80-c6f5-4b02-902a-1187489b1ca1 tempest-ProjectReaderTests-402678827 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 02:08:48 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-dad19c80-c6f5-4b02-902a-1187489b1ca1 tempest-ProjectReaderTests-402678827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-556ecbab-82ed-4914-9e7b-eb15c1353443 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:08:48 devstack sudo[107781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-556ecbab-82ed-4914-9e7b-eb15c1353443 1073741824 Jul 08 02:08:48 devstack sudo[107781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:08:49 devstack sudo[107781]: pam_unix(sudo:session): session closed for user root Jul 08 02:08:49 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-dad19c80-c6f5-4b02-902a-1187489b1ca1 tempest-ProjectReaderTests-402678827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-556ecbab-82ed-4914-9e7b-eb15c1353443 1073741824" returned: 0 in 0.840s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:08:49 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-dad19c80-c6f5-4b02-902a-1187489b1ca1 tempest-ProjectReaderTests-402678827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-556ecbab-82ed-4914-9e7b-eb15c1353443 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:08:49 devstack sudo[107786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-556ecbab-82ed-4914-9e7b-eb15c1353443 Jul 08 02:08:49 devstack sudo[107786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:08:50 devstack sudo[107786]: pam_unix(sudo:session): session closed for user root Jul 08 02:08:50 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-dad19c80-c6f5-4b02-902a-1187489b1ca1 tempest-ProjectReaderTests-402678827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-556ecbab-82ed-4914-9e7b-eb15c1353443" returned: 0 in 0.641s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:08:50 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-dad19c80-c6f5-4b02-902a-1187489b1ca1 tempest-ProjectReaderTests-402678827 None] <== create_volume: return (1529ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:08:50 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-dad19c80-c6f5-4b02-902a-1187489b1ca1 tempest-ProjectReaderTests-402678827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.532s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:08:50 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-dad19c80-c6f5-4b02-902a-1187489b1ca1 tempest-ProjectReaderTests-402678827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0b51205-1c8f-45f9-ae0a-68527589abf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-556ecbab-82ed-4914-9e7b-eb15c1353443', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:08:50 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-dad19c80-c6f5-4b02-902a-1187489b1ca1 tempest-ProjectReaderTests-402678827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72d46dde-81ac-47b2-873c-49f48ebdc4a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:08:50 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-dad19c80-c6f5-4b02-902a-1187489b1ca1 tempest-ProjectReaderTests-402678827 None] Volume volume-556ecbab-82ed-4914-9e7b-eb15c1353443 (556ecbab-82ed-4914-9e7b-eb15c1353443): created successfully Jul 08 02:08:50 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-dad19c80-c6f5-4b02-902a-1187489b1ca1 tempest-ProjectReaderTests-402678827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72d46dde-81ac-47b2-873c-49f48ebdc4a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:08:50 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-dad19c80-c6f5-4b02-902a-1187489b1ca1 tempest-ProjectReaderTests-402678827 None] Flow 'volume_create_manager' (0cf8255c-39b5-4c7a-8c9d-976565df5264) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:08:50 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-dad19c80-c6f5-4b02-902a-1187489b1ca1 tempest-ProjectReaderTests-402678827 None] Created volume successfully. Jul 08 02:08:50 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7633a622-e262-4c8b-8bbb-2cc9e59f7fa7 tempest-ProjectReaderTests-402678827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:08:50 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7633a622-e262-4c8b-8bbb-2cc9e59f7fa7 tempest-ProjectReaderTests-402678827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:08:50 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-7633a622-e262-4c8b-8bbb-2cc9e59f7fa7 tempest-ProjectReaderTests-402678827 None] Creating offline snapshot bd6f2d90-08bd-412a-ac8d-3601ae9693cb of volume 556ecbab-82ed-4914-9e7b-eb15c1353443 {{(pid=87134) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 02:08:50 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed96a46-ad2e-49e3-b932-3cf9cfbe4a5c]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:08:50 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7633a622-e262-4c8b-8bbb-2cc9e59f7fa7 tempest-ProjectReaderTests-402678827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-556ecbab-82ed-4914-9e7b-eb15c1353443 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:08:51 devstack sudo[107789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-556ecbab-82ed-4914-9e7b-eb15c1353443 Jul 08 02:08:51 devstack sudo[107789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:08:51 devstack sudo[107789]: pam_unix(sudo:session): session closed for user root Jul 08 02:08:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7633a622-e262-4c8b-8bbb-2cc9e59f7fa7 tempest-ProjectReaderTests-402678827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-556ecbab-82ed-4914-9e7b-eb15c1353443" returned: 0 in 0.802s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:08:51 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7633a622-e262-4c8b-8bbb-2cc9e59f7fa7 tempest-ProjectReaderTests-402678827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-556ecbab-82ed-4914-9e7b-eb15c1353443,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-556ecbab-82ed-4914-9e7b-eb15c1353443.bd6f2d90-08bd-412a-ac8d-3601ae9693cb 1G {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:08:51 devstack sudo[107794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-556ecbab-82ed-4914-9e7b-eb15c1353443,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-556ecbab-82ed-4914-9e7b-eb15c1353443.bd6f2d90-08bd-412a-ac8d-3601ae9693cb 1G Jul 08 02:08:51 devstack sudo[107794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:08:52 devstack sudo[107794]: pam_unix(sudo:session): session closed for user root Jul 08 02:08:52 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7633a622-e262-4c8b-8bbb-2cc9e59f7fa7 tempest-ProjectReaderTests-402678827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-556ecbab-82ed-4914-9e7b-eb15c1353443,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-556ecbab-82ed-4914-9e7b-eb15c1353443.bd6f2d90-08bd-412a-ac8d-3601ae9693cb 1G" returned: 0 in 0.973s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:08:52 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7633a622-e262-4c8b-8bbb-2cc9e59f7fa7 tempest-ProjectReaderTests-402678827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-556ecbab-82ed-4914-9e7b-eb15c1353443 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-556ecbab-82ed-4914-9e7b-eb15c1353443.bd6f2d90-08bd-412a-ac8d-3601ae9693cb {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:08:52 devstack sudo[107799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-556ecbab-82ed-4914-9e7b-eb15c1353443 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-556ecbab-82ed-4914-9e7b-eb15c1353443.bd6f2d90-08bd-412a-ac8d-3601ae9693cb Jul 08 02:08:52 devstack sudo[107799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:08:53 devstack sudo[107799]: pam_unix(sudo:session): session closed for user root Jul 08 02:08:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7633a622-e262-4c8b-8bbb-2cc9e59f7fa7 tempest-ProjectReaderTests-402678827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-556ecbab-82ed-4914-9e7b-eb15c1353443 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-556ecbab-82ed-4914-9e7b-eb15c1353443.bd6f2d90-08bd-412a-ac8d-3601ae9693cb" returned: 0 in 0.766s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:08:53 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-7633a622-e262-4c8b-8bbb-2cc9e59f7fa7 tempest-ProjectReaderTests-402678827 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-556ecbab-82ed-4914-9e7b-eb15c1353443.bd6f2d90-08bd-412a-ac8d-3601ae9693cb is being set with open permissions: ugo+rw Jul 08 02:08:53 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7633a622-e262-4c8b-8bbb-2cc9e59f7fa7 tempest-ProjectReaderTests-402678827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-556ecbab-82ed-4914-9e7b-eb15c1353443.bd6f2d90-08bd-412a-ac8d-3601ae9693cb {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:08:53 devstack sudo[107805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-556ecbab-82ed-4914-9e7b-eb15c1353443.bd6f2d90-08bd-412a-ac8d-3601ae9693cb Jul 08 02:08:53 devstack sudo[107805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:08:54 devstack sudo[107805]: pam_unix(sudo:session): session closed for user root Jul 08 02:08:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7633a622-e262-4c8b-8bbb-2cc9e59f7fa7 tempest-ProjectReaderTests-402678827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-556ecbab-82ed-4914-9e7b-eb15c1353443.bd6f2d90-08bd-412a-ac8d-3601ae9693cb" returned: 0 in 0.684s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:08:54 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7633a622-e262-4c8b-8bbb-2cc9e59f7fa7 tempest-ProjectReaderTests-402678827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-556ecbab-82ed-4914-9e7b-eb15c1353443.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:08:54 devstack sudo[107808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-556ecbab-82ed-4914-9e7b-eb15c1353443.info Jul 08 02:08:54 devstack sudo[107808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:08:55 devstack sudo[107808]: pam_unix(sudo:session): session closed for user root Jul 08 02:08:55 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7633a622-e262-4c8b-8bbb-2cc9e59f7fa7 tempest-ProjectReaderTests-402678827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-556ecbab-82ed-4914-9e7b-eb15c1353443.info" returned: 0 in 0.764s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:08:55 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-7633a622-e262-4c8b-8bbb-2cc9e59f7fa7 tempest-ProjectReaderTests-402678827 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-556ecbab-82ed-4914-9e7b-eb15c1353443.info is being set with open permissions: ugo+rw Jul 08 02:08:55 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7633a622-e262-4c8b-8bbb-2cc9e59f7fa7 tempest-ProjectReaderTests-402678827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-556ecbab-82ed-4914-9e7b-eb15c1353443.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:08:55 devstack sudo[107811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-556ecbab-82ed-4914-9e7b-eb15c1353443.info Jul 08 02:08:55 devstack sudo[107811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:08:55 devstack sudo[107811]: pam_unix(sudo:session): session closed for user root Jul 08 02:08:55 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-7633a622-e262-4c8b-8bbb-2cc9e59f7fa7 tempest-ProjectReaderTests-402678827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-556ecbab-82ed-4914-9e7b-eb15c1353443.info" returned: 0 in 0.682s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:08:55 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-7633a622-e262-4c8b-8bbb-2cc9e59f7fa7 tempest-ProjectReaderTests-402678827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.762s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:08:55 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-7633a622-e262-4c8b-8bbb-2cc9e59f7fa7 tempest-ProjectReaderTests-402678827 None] Create snapshot completed successfully Jul 08 02:08:56 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-18856199-f6a3-4fe1-800b-e8a0c30ae443 tempest-ProjectReaderTests-402678827 None] Acquiring lock "cinder-bd6f2d90-08bd-412a-ac8d-3601ae9693cb-delete_snapshot" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:08:56 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-18856199-f6a3-4fe1-800b-e8a0c30ae443 tempest-ProjectReaderTests-402678827 None] Lock "cinder-bd6f2d90-08bd-412a-ac8d-3601ae9693cb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:08:56 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-18856199-f6a3-4fe1-800b-e8a0c30ae443 tempest-ProjectReaderTests-402678827 None] Acquiring lock "cinder-quobyte-556ecbab-82ed-4914-9e7b-eb15c1353443" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:08:56 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-18856199-f6a3-4fe1-800b-e8a0c30ae443 tempest-ProjectReaderTests-402678827 None] Lock "cinder-quobyte-556ecbab-82ed-4914-9e7b-eb15c1353443" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:08:56 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-18856199-f6a3-4fe1-800b-e8a0c30ae443 tempest-ProjectReaderTests-402678827 None] Acquiring lock "cinder-quobyte-bd6f2d90-08bd-412a-ac8d-3601ae9693cb" by "_delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:08:56 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-18856199-f6a3-4fe1-800b-e8a0c30ae443 tempest-ProjectReaderTests-402678827 None] Lock "cinder-quobyte-bd6f2d90-08bd-412a-ac8d-3601ae9693cb" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:08:56 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-18856199-f6a3-4fe1-800b-e8a0c30ae443 tempest-ProjectReaderTests-402678827 None] Deleting offline snapshot bd6f2d90-08bd-412a-ac8d-3601ae9693cb of volume 556ecbab-82ed-4914-9e7b-eb15c1353443 {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 02:08:56 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-18856199-f6a3-4fe1-800b-e8a0c30ae443 tempest-ProjectReaderTests-402678827 None] snapshot_file for this snap is: volume-556ecbab-82ed-4914-9e7b-eb15c1353443.bd6f2d90-08bd-412a-ac8d-3601ae9693cb {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 02:08:56 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d7f066-cbda-4091-b7b9-17a098712c74]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:08:56 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-18856199-f6a3-4fe1-800b-e8a0c30ae443 tempest-ProjectReaderTests-402678827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-556ecbab-82ed-4914-9e7b-eb15c1353443.bd6f2d90-08bd-412a-ac8d-3601ae9693cb {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:08:56 devstack sudo[107814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-556ecbab-82ed-4914-9e7b-eb15c1353443.bd6f2d90-08bd-412a-ac8d-3601ae9693cb Jul 08 02:08:56 devstack sudo[107814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:08:57 devstack sudo[107814]: pam_unix(sudo:session): session closed for user root Jul 08 02:08:57 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-18856199-f6a3-4fe1-800b-e8a0c30ae443 tempest-ProjectReaderTests-402678827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-556ecbab-82ed-4914-9e7b-eb15c1353443.bd6f2d90-08bd-412a-ac8d-3601ae9693cb" returned: 0 in 0.780s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:08:57 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-18856199-f6a3-4fe1-800b-e8a0c30ae443 tempest-ProjectReaderTests-402678827 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-556ecbab-82ed-4914-9e7b-eb15c1353443(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:08:57 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[bffc977d-29c0-43a9-aed2-e2ea385e5347]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:08:57 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-18856199-f6a3-4fe1-800b-e8a0c30ae443 tempest-ProjectReaderTests-402678827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-556ecbab-82ed-4914-9e7b-eb15c1353443 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:08:57 devstack sudo[107819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-556ecbab-82ed-4914-9e7b-eb15c1353443 Jul 08 02:08:57 devstack sudo[107819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:08:57 devstack sudo[107819]: pam_unix(sudo:session): session closed for user root Jul 08 02:08:57 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-18856199-f6a3-4fe1-800b-e8a0c30ae443 tempest-ProjectReaderTests-402678827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-556ecbab-82ed-4914-9e7b-eb15c1353443" returned: 0 in 0.843s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:08:57 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-18856199-f6a3-4fe1-800b-e8a0c30ae443 tempest-ProjectReaderTests-402678827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-556ecbab-82ed-4914-9e7b-eb15c1353443.bd6f2d90-08bd-412a-ac8d-3601ae9693cb {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:08:57 devstack sudo[107824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-556ecbab-82ed-4914-9e7b-eb15c1353443.bd6f2d90-08bd-412a-ac8d-3601ae9693cb Jul 08 02:08:57 devstack sudo[107824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:08:58 devstack sudo[107824]: pam_unix(sudo:session): session closed for user root Jul 08 02:08:58 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-18856199-f6a3-4fe1-800b-e8a0c30ae443 tempest-ProjectReaderTests-402678827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-556ecbab-82ed-4914-9e7b-eb15c1353443.bd6f2d90-08bd-412a-ac8d-3601ae9693cb" returned: 0 in 0.770s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:08:58 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-18856199-f6a3-4fe1-800b-e8a0c30ae443 tempest-ProjectReaderTests-402678827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-556ecbab-82ed-4914-9e7b-eb15c1353443.bd6f2d90-08bd-412a-ac8d-3601ae9693cb {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:08:58 devstack sudo[107829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-556ecbab-82ed-4914-9e7b-eb15c1353443.bd6f2d90-08bd-412a-ac8d-3601ae9693cb Jul 08 02:08:58 devstack sudo[107829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:08:59 devstack sudo[107829]: pam_unix(sudo:session): session closed for user root Jul 08 02:08:59 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-18856199-f6a3-4fe1-800b-e8a0c30ae443 tempest-ProjectReaderTests-402678827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-556ecbab-82ed-4914-9e7b-eb15c1353443.bd6f2d90-08bd-412a-ac8d-3601ae9693cb" returned: 0 in 0.661s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:08:59 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-18856199-f6a3-4fe1-800b-e8a0c30ae443 tempest-ProjectReaderTests-402678827 None] Lock "cinder-quobyte-bd6f2d90-08bd-412a-ac8d-3601ae9693cb" released by "_delete_snapshot" :: held 3.154s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:08:59 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-18856199-f6a3-4fe1-800b-e8a0c30ae443 tempest-ProjectReaderTests-402678827 None] Lock "cinder-quobyte-556ecbab-82ed-4914-9e7b-eb15c1353443" released by "delete_snapshot" :: held 3.176s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:08:59 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-18856199-f6a3-4fe1-800b-e8a0c30ae443 tempest-ProjectReaderTests-402678827 None] Created reservations ['89a2c036-076d-408b-b935-da925c01db32', 'ea54bf7a-1539-42ad-8202-28f92a4f5591', '8adecf74-bfed-40e8-88a4-e0ccccb6155e', '49942b40-a873-4ea4-86ab-33cd59ac597e'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:08:59 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-18856199-f6a3-4fe1-800b-e8a0c30ae443 tempest-ProjectReaderTests-402678827 None] Delete snapshot completed successfully. Jul 08 02:08:59 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-18856199-f6a3-4fe1-800b-e8a0c30ae443 tempest-ProjectReaderTests-402678827 None] Lock "cinder-bd6f2d90-08bd-412a-ac8d-3601ae9693cb-delete_snapshot" released by "delete_snapshot" :: held 3.328s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:09:00 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-f0b779cf-e37d-400a-b6f4-b59b0d5eee23 tempest-ProjectReaderTests-402678827 None] Acquiring lock "cinder-556ecbab-82ed-4914-9e7b-eb15c1353443-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:09:00 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-f0b779cf-e37d-400a-b6f4-b59b0d5eee23 tempest-ProjectReaderTests-402678827 None] Lock "cinder-556ecbab-82ed-4914-9e7b-eb15c1353443-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:09:00 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-f0b779cf-e37d-400a-b6f4-b59b0d5eee23 tempest-ProjectReaderTests-402678827 None] Acquiring lock "cinder-quobyte-556ecbab-82ed-4914-9e7b-eb15c1353443" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:09:00 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-f0b779cf-e37d-400a-b6f4-b59b0d5eee23 tempest-ProjectReaderTests-402678827 None] Lock "cinder-quobyte-556ecbab-82ed-4914-9e7b-eb15c1353443" acquired by "delete_volume" :: waited 0.016s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:09:00 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b5273f-ecf9-456f-9fc7-c5aadc87e5ef]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:09:00 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f0b779cf-e37d-400a-b6f4-b59b0d5eee23 tempest-ProjectReaderTests-402678827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-556ecbab-82ed-4914-9e7b-eb15c1353443 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:09:00 devstack sudo[107832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-556ecbab-82ed-4914-9e7b-eb15c1353443 Jul 08 02:09:00 devstack sudo[107832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:09:01 devstack sudo[107832]: pam_unix(sudo:session): session closed for user root Jul 08 02:09:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f0b779cf-e37d-400a-b6f4-b59b0d5eee23 tempest-ProjectReaderTests-402678827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-556ecbab-82ed-4914-9e7b-eb15c1353443" returned: 0 in 0.826s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:09:01 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f0b779cf-e37d-400a-b6f4-b59b0d5eee23 tempest-ProjectReaderTests-402678827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-556ecbab-82ed-4914-9e7b-eb15c1353443 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:09:01 devstack sudo[107837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-556ecbab-82ed-4914-9e7b-eb15c1353443 Jul 08 02:09:01 devstack sudo[107837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:09:02 devstack sudo[107837]: pam_unix(sudo:session): session closed for user root Jul 08 02:09:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f0b779cf-e37d-400a-b6f4-b59b0d5eee23 tempest-ProjectReaderTests-402678827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-556ecbab-82ed-4914-9e7b-eb15c1353443" returned: 0 in 0.695s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:09:02 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-f0b779cf-e37d-400a-b6f4-b59b0d5eee23 tempest-ProjectReaderTests-402678827 None] Lock "cinder-quobyte-556ecbab-82ed-4914-9e7b-eb15c1353443" released by "delete_volume" :: held 1.591s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:09:02 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-f0b779cf-e37d-400a-b6f4-b59b0d5eee23 tempest-ProjectReaderTests-402678827 None] Created reservations ['41ec2343-e167-4cfa-94ad-fc4d0f9e4ae5', 'c7b8d393-2a8f-49e7-9bf4-8ab4e60c21c9', 'f281867f-94eb-450e-8e6e-bef2944d4736', '9600302f-941c-43b0-8dcc-8b1a1f029210'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:09:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-f0b779cf-e37d-400a-b6f4-b59b0d5eee23 tempest-ProjectReaderTests-402678827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:09:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-f0b779cf-e37d-400a-b6f4-b59b0d5eee23 tempest-ProjectReaderTests-402678827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:09:02 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-f0b779cf-e37d-400a-b6f4-b59b0d5eee23 tempest-ProjectReaderTests-402678827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:09:02 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-f0b779cf-e37d-400a-b6f4-b59b0d5eee23 tempest-ProjectReaderTests-402678827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:09:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-f0b779cf-e37d-400a-b6f4-b59b0d5eee23 tempest-ProjectReaderTests-402678827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:09:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f0b779cf-e37d-400a-b6f4-b59b0d5eee23 tempest-ProjectReaderTests-402678827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:09:02 devstack sudo[107840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 02:09:02 devstack sudo[107840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:09:02 devstack sudo[107840]: pam_unix(sudo:session): session closed for user root Jul 08 02:09:02 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f0b779cf-e37d-400a-b6f4-b59b0d5eee23 tempest-ProjectReaderTests-402678827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.708s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:09:02 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-f0b779cf-e37d-400a-b6f4-b59b0d5eee23 tempest-ProjectReaderTests-402678827 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:09:03 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-f0b779cf-e37d-400a-b6f4-b59b0d5eee23 tempest-ProjectReaderTests-402678827 None] Deleted volume successfully. Jul 08 02:09:03 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-f0b779cf-e37d-400a-b6f4-b59b0d5eee23 tempest-ProjectReaderTests-402678827 None] Lock "cinder-556ecbab-82ed-4914-9e7b-eb15c1353443-delete_volume" released by "delete_volume" :: held 2.531s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:09:03 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-69cbc3aa-d911-4cb9-aa58-22ffc32d9648 tempest-ProjectReaderTests-402678827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:09:03 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-69cbc3aa-d911-4cb9-aa58-22ffc32d9648 tempest-ProjectReaderTests-402678827 None] Flow 'volume_create_manager' (5d4dff87-8202-4220-a1c2-870bd9fb00b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:09:03 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-69cbc3aa-d911-4cb9-aa58-22ffc32d9648 tempest-ProjectReaderTests-402678827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bba8be8-cc32-4222-9f9b-716968559433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:09:03 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-69cbc3aa-d911-4cb9-aa58-22ffc32d9648 tempest-ProjectReaderTests-402678827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bba8be8-cc32-4222-9f9b-716968559433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:09:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2075997877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88290a17-a3c6-418c-9f50-88b1d87f3190,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='010cd051a2434efcab451de7970a9ed3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:09:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:09:03Z,use_quota=True,user_id='fd11f14eeb354dd7acd84ed9187a6aa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:09:03 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-69cbc3aa-d911-4cb9-aa58-22ffc32d9648 tempest-ProjectReaderTests-402678827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f53190a2-a820-4b43-8243-802fbe02cc4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:09:03 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-69cbc3aa-d911-4cb9-aa58-22ffc32d9648 tempest-ProjectReaderTests-402678827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f53190a2-a820-4b43-8243-802fbe02cc4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:09:03 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-69cbc3aa-d911-4cb9-aa58-22ffc32d9648 tempest-ProjectReaderTests-402678827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bdb90e6-5b54-426f-9d25-ba042d83344d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:09:03 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-69cbc3aa-d911-4cb9-aa58-22ffc32d9648 tempest-ProjectReaderTests-402678827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bdb90e6-5b54-426f-9d25-ba042d83344d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88290a17-a3c6-418c-9f50-88b1d87f3190', 'volume_name': 'volume-88290a17-a3c6-418c-9f50-88b1d87f3190', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:09:03 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-69cbc3aa-d911-4cb9-aa58-22ffc32d9648 tempest-ProjectReaderTests-402678827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fadd9f4a-4a90-4d51-b839-a018c1f10427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:09:03 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-69cbc3aa-d911-4cb9-aa58-22ffc32d9648 tempest-ProjectReaderTests-402678827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fadd9f4a-4a90-4d51-b839-a018c1f10427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:09:03 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-69cbc3aa-d911-4cb9-aa58-22ffc32d9648 tempest-ProjectReaderTests-402678827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bdb8208-c539-4092-8b4c-24ceb1774ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:09:03 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-69cbc3aa-d911-4cb9-aa58-22ffc32d9648 tempest-ProjectReaderTests-402678827 None] Volume 88290a17-a3c6-418c-9f50-88b1d87f3190: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88290a17-a3c6-418c-9f50-88b1d87f3190', 'volume_size': 1} Jul 08 02:09:03 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-69cbc3aa-d911-4cb9-aa58-22ffc32d9648 tempest-ProjectReaderTests-402678827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:09:03 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-69cbc3aa-d911-4cb9-aa58-22ffc32d9648 tempest-ProjectReaderTests-402678827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:09:03 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-69cbc3aa-d911-4cb9-aa58-22ffc32d9648 tempest-ProjectReaderTests-402678827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:09:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2075997877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88290a17-a3c6-418c-9f50-88b1d87f3190,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='010cd051a2434efcab451de7970a9ed3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:09:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:09:03Z,use_quota=True,user_id='fd11f14eeb354dd7acd84ed9187a6aa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:09:03 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-69cbc3aa-d911-4cb9-aa58-22ffc32d9648 tempest-ProjectReaderTests-402678827 None] Creating volume 88290a17-a3c6-418c-9f50-88b1d87f3190 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:09:03 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-69cbc3aa-d911-4cb9-aa58-22ffc32d9648 tempest-ProjectReaderTests-402678827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:09:03 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-69cbc3aa-d911-4cb9-aa58-22ffc32d9648 tempest-ProjectReaderTests-402678827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:09:03 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-69cbc3aa-d911-4cb9-aa58-22ffc32d9648 tempest-ProjectReaderTests-402678827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:09:03 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-69cbc3aa-d911-4cb9-aa58-22ffc32d9648 tempest-ProjectReaderTests-402678827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:09:03 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-69cbc3aa-d911-4cb9-aa58-22ffc32d9648 tempest-ProjectReaderTests-402678827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:09:03 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-69cbc3aa-d911-4cb9-aa58-22ffc32d9648 tempest-ProjectReaderTests-402678827 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:09:03 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-69cbc3aa-d911-4cb9-aa58-22ffc32d9648 tempest-ProjectReaderTests-402678827 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 02:09:03 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-69cbc3aa-d911-4cb9-aa58-22ffc32d9648 tempest-ProjectReaderTests-402678827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-88290a17-a3c6-418c-9f50-88b1d87f3190 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:09:03 devstack sudo[107844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-88290a17-a3c6-418c-9f50-88b1d87f3190 1073741824 Jul 08 02:09:03 devstack sudo[107844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:09:04 devstack sudo[107844]: pam_unix(sudo:session): session closed for user root Jul 08 02:09:04 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-69cbc3aa-d911-4cb9-aa58-22ffc32d9648 tempest-ProjectReaderTests-402678827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-88290a17-a3c6-418c-9f50-88b1d87f3190 1073741824" returned: 0 in 0.910s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:09:04 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-69cbc3aa-d911-4cb9-aa58-22ffc32d9648 tempest-ProjectReaderTests-402678827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-88290a17-a3c6-418c-9f50-88b1d87f3190 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:09:04 devstack sudo[107849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-88290a17-a3c6-418c-9f50-88b1d87f3190 Jul 08 02:09:04 devstack sudo[107849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:09:04 devstack sudo[107849]: pam_unix(sudo:session): session closed for user root Jul 08 02:09:04 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-69cbc3aa-d911-4cb9-aa58-22ffc32d9648 tempest-ProjectReaderTests-402678827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-88290a17-a3c6-418c-9f50-88b1d87f3190" returned: 0 in 0.675s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:09:04 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-69cbc3aa-d911-4cb9-aa58-22ffc32d9648 tempest-ProjectReaderTests-402678827 None] <== create_volume: return (1641ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:09:04 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-69cbc3aa-d911-4cb9-aa58-22ffc32d9648 tempest-ProjectReaderTests-402678827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.644s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:09:04 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-69cbc3aa-d911-4cb9-aa58-22ffc32d9648 tempest-ProjectReaderTests-402678827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bdb8208-c539-4092-8b4c-24ceb1774ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88290a17-a3c6-418c-9f50-88b1d87f3190', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:09:04 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-69cbc3aa-d911-4cb9-aa58-22ffc32d9648 tempest-ProjectReaderTests-402678827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa956fbf-d09d-4fb1-88e1-b22bbf11ccd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:09:04 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-69cbc3aa-d911-4cb9-aa58-22ffc32d9648 tempest-ProjectReaderTests-402678827 None] Volume volume-88290a17-a3c6-418c-9f50-88b1d87f3190 (88290a17-a3c6-418c-9f50-88b1d87f3190): created successfully Jul 08 02:09:05 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-69cbc3aa-d911-4cb9-aa58-22ffc32d9648 tempest-ProjectReaderTests-402678827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa956fbf-d09d-4fb1-88e1-b22bbf11ccd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:09:05 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-69cbc3aa-d911-4cb9-aa58-22ffc32d9648 tempest-ProjectReaderTests-402678827 None] Flow 'volume_create_manager' (5d4dff87-8202-4220-a1c2-870bd9fb00b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:09:05 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-69cbc3aa-d911-4cb9-aa58-22ffc32d9648 tempest-ProjectReaderTests-402678827 None] Created volume successfully. Jul 08 02:09:05 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5f690a16-838b-47da-a5ff-ee13315325c1 tempest-ProjectReaderTests-402678827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:09:05 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5f690a16-838b-47da-a5ff-ee13315325c1 tempest-ProjectReaderTests-402678827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:09:05 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-5f690a16-838b-47da-a5ff-ee13315325c1 tempest-ProjectReaderTests-402678827 None] Creating offline snapshot 606788f7-00fe-4e72-896e-b7c8d467fbf5 of volume 88290a17-a3c6-418c-9f50-88b1d87f3190 {{(pid=87134) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 02:09:05 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[b913f355-ae88-4e6d-8bda-289daf6fb603]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:09:05 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5f690a16-838b-47da-a5ff-ee13315325c1 tempest-ProjectReaderTests-402678827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-88290a17-a3c6-418c-9f50-88b1d87f3190 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:09:05 devstack sudo[107852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-88290a17-a3c6-418c-9f50-88b1d87f3190 Jul 08 02:09:05 devstack sudo[107852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:09:06 devstack sudo[107852]: pam_unix(sudo:session): session closed for user root Jul 08 02:09:06 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5f690a16-838b-47da-a5ff-ee13315325c1 tempest-ProjectReaderTests-402678827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-88290a17-a3c6-418c-9f50-88b1d87f3190" returned: 0 in 0.834s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:09:06 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5f690a16-838b-47da-a5ff-ee13315325c1 tempest-ProjectReaderTests-402678827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-88290a17-a3c6-418c-9f50-88b1d87f3190,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-88290a17-a3c6-418c-9f50-88b1d87f3190.606788f7-00fe-4e72-896e-b7c8d467fbf5 1G {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:09:06 devstack sudo[107857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-88290a17-a3c6-418c-9f50-88b1d87f3190,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-88290a17-a3c6-418c-9f50-88b1d87f3190.606788f7-00fe-4e72-896e-b7c8d467fbf5 1G Jul 08 02:09:06 devstack sudo[107857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:09:07 devstack sudo[107857]: pam_unix(sudo:session): session closed for user root Jul 08 02:09:07 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5f690a16-838b-47da-a5ff-ee13315325c1 tempest-ProjectReaderTests-402678827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-88290a17-a3c6-418c-9f50-88b1d87f3190,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-88290a17-a3c6-418c-9f50-88b1d87f3190.606788f7-00fe-4e72-896e-b7c8d467fbf5 1G" returned: 0 in 0.884s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:09:07 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5f690a16-838b-47da-a5ff-ee13315325c1 tempest-ProjectReaderTests-402678827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88290a17-a3c6-418c-9f50-88b1d87f3190 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-88290a17-a3c6-418c-9f50-88b1d87f3190.606788f7-00fe-4e72-896e-b7c8d467fbf5 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:09:07 devstack sudo[107862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88290a17-a3c6-418c-9f50-88b1d87f3190 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-88290a17-a3c6-418c-9f50-88b1d87f3190.606788f7-00fe-4e72-896e-b7c8d467fbf5 Jul 08 02:09:07 devstack sudo[107862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:09:07 devstack sudo[107862]: pam_unix(sudo:session): session closed for user root Jul 08 02:09:07 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5f690a16-838b-47da-a5ff-ee13315325c1 tempest-ProjectReaderTests-402678827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88290a17-a3c6-418c-9f50-88b1d87f3190 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-88290a17-a3c6-418c-9f50-88b1d87f3190.606788f7-00fe-4e72-896e-b7c8d467fbf5" returned: 0 in 0.689s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:09:07 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-5f690a16-838b-47da-a5ff-ee13315325c1 tempest-ProjectReaderTests-402678827 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-88290a17-a3c6-418c-9f50-88b1d87f3190.606788f7-00fe-4e72-896e-b7c8d467fbf5 is being set with open permissions: ugo+rw Jul 08 02:09:07 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5f690a16-838b-47da-a5ff-ee13315325c1 tempest-ProjectReaderTests-402678827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-88290a17-a3c6-418c-9f50-88b1d87f3190.606788f7-00fe-4e72-896e-b7c8d467fbf5 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:09:07 devstack sudo[107867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-88290a17-a3c6-418c-9f50-88b1d87f3190.606788f7-00fe-4e72-896e-b7c8d467fbf5 Jul 08 02:09:07 devstack sudo[107867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:09:08 devstack sudo[107867]: pam_unix(sudo:session): session closed for user root Jul 08 02:09:08 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5f690a16-838b-47da-a5ff-ee13315325c1 tempest-ProjectReaderTests-402678827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-88290a17-a3c6-418c-9f50-88b1d87f3190.606788f7-00fe-4e72-896e-b7c8d467fbf5" returned: 0 in 0.668s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:09:08 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5f690a16-838b-47da-a5ff-ee13315325c1 tempest-ProjectReaderTests-402678827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-88290a17-a3c6-418c-9f50-88b1d87f3190.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:09:08 devstack sudo[107871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-88290a17-a3c6-418c-9f50-88b1d87f3190.info Jul 08 02:09:08 devstack sudo[107871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:09:09 devstack sudo[107871]: pam_unix(sudo:session): session closed for user root Jul 08 02:09:09 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5f690a16-838b-47da-a5ff-ee13315325c1 tempest-ProjectReaderTests-402678827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-88290a17-a3c6-418c-9f50-88b1d87f3190.info" returned: 0 in 0.669s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:09:09 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-5f690a16-838b-47da-a5ff-ee13315325c1 tempest-ProjectReaderTests-402678827 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-88290a17-a3c6-418c-9f50-88b1d87f3190.info is being set with open permissions: ugo+rw Jul 08 02:09:09 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5f690a16-838b-47da-a5ff-ee13315325c1 tempest-ProjectReaderTests-402678827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-88290a17-a3c6-418c-9f50-88b1d87f3190.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:09:09 devstack sudo[107874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-88290a17-a3c6-418c-9f50-88b1d87f3190.info Jul 08 02:09:09 devstack sudo[107874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:09:10 devstack sudo[107874]: pam_unix(sudo:session): session closed for user root Jul 08 02:09:10 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-5f690a16-838b-47da-a5ff-ee13315325c1 tempest-ProjectReaderTests-402678827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-88290a17-a3c6-418c-9f50-88b1d87f3190.info" returned: 0 in 0.699s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:09:10 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-5f690a16-838b-47da-a5ff-ee13315325c1 tempest-ProjectReaderTests-402678827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.544s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:09:10 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-5f690a16-838b-47da-a5ff-ee13315325c1 tempest-ProjectReaderTests-402678827 None] Create snapshot completed successfully Jul 08 02:09:10 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-fcafce47-0be4-46ee-aca4-01caa30ab3a0 tempest-ProjectReaderTests-402678827 None] Acquiring lock "cinder-606788f7-00fe-4e72-896e-b7c8d467fbf5-delete_snapshot" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:09:10 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-fcafce47-0be4-46ee-aca4-01caa30ab3a0 tempest-ProjectReaderTests-402678827 None] Lock "cinder-606788f7-00fe-4e72-896e-b7c8d467fbf5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:09:10 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-fcafce47-0be4-46ee-aca4-01caa30ab3a0 tempest-ProjectReaderTests-402678827 None] Acquiring lock "cinder-quobyte-88290a17-a3c6-418c-9f50-88b1d87f3190" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:09:10 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-fcafce47-0be4-46ee-aca4-01caa30ab3a0 tempest-ProjectReaderTests-402678827 None] Lock "cinder-quobyte-88290a17-a3c6-418c-9f50-88b1d87f3190" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:09:10 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-fcafce47-0be4-46ee-aca4-01caa30ab3a0 tempest-ProjectReaderTests-402678827 None] Acquiring lock "cinder-quobyte-606788f7-00fe-4e72-896e-b7c8d467fbf5" by "_delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:09:10 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-fcafce47-0be4-46ee-aca4-01caa30ab3a0 tempest-ProjectReaderTests-402678827 None] Lock "cinder-quobyte-606788f7-00fe-4e72-896e-b7c8d467fbf5" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:09:10 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-fcafce47-0be4-46ee-aca4-01caa30ab3a0 tempest-ProjectReaderTests-402678827 None] Deleting offline snapshot 606788f7-00fe-4e72-896e-b7c8d467fbf5 of volume 88290a17-a3c6-418c-9f50-88b1d87f3190 {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 02:09:10 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-fcafce47-0be4-46ee-aca4-01caa30ab3a0 tempest-ProjectReaderTests-402678827 None] snapshot_file for this snap is: volume-88290a17-a3c6-418c-9f50-88b1d87f3190.606788f7-00fe-4e72-896e-b7c8d467fbf5 {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 02:09:10 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dabf709-7961-47ed-bd93-109eca01ac72]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:09:10 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-fcafce47-0be4-46ee-aca4-01caa30ab3a0 tempest-ProjectReaderTests-402678827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-88290a17-a3c6-418c-9f50-88b1d87f3190.606788f7-00fe-4e72-896e-b7c8d467fbf5 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:09:10 devstack sudo[107877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-88290a17-a3c6-418c-9f50-88b1d87f3190.606788f7-00fe-4e72-896e-b7c8d467fbf5 Jul 08 02:09:10 devstack sudo[107877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:09:11 devstack sudo[107877]: pam_unix(sudo:session): session closed for user root Jul 08 02:09:11 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-fcafce47-0be4-46ee-aca4-01caa30ab3a0 tempest-ProjectReaderTests-402678827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-88290a17-a3c6-418c-9f50-88b1d87f3190.606788f7-00fe-4e72-896e-b7c8d467fbf5" returned: 0 in 0.827s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:09:11 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-fcafce47-0be4-46ee-aca4-01caa30ab3a0 tempest-ProjectReaderTests-402678827 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88290a17-a3c6-418c-9f50-88b1d87f3190(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:09:11 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[6787777d-6440-4eed-957a-1742fbbed56a]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:09:11 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-fcafce47-0be4-46ee-aca4-01caa30ab3a0 tempest-ProjectReaderTests-402678827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-88290a17-a3c6-418c-9f50-88b1d87f3190 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:09:11 devstack sudo[107884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-88290a17-a3c6-418c-9f50-88b1d87f3190 Jul 08 02:09:11 devstack sudo[107884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:09:12 devstack sudo[107884]: pam_unix(sudo:session): session closed for user root Jul 08 02:09:12 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-fcafce47-0be4-46ee-aca4-01caa30ab3a0 tempest-ProjectReaderTests-402678827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-88290a17-a3c6-418c-9f50-88b1d87f3190" returned: 0 in 0.831s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:09:12 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-fcafce47-0be4-46ee-aca4-01caa30ab3a0 tempest-ProjectReaderTests-402678827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-88290a17-a3c6-418c-9f50-88b1d87f3190.606788f7-00fe-4e72-896e-b7c8d467fbf5 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:09:12 devstack sudo[107889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-88290a17-a3c6-418c-9f50-88b1d87f3190.606788f7-00fe-4e72-896e-b7c8d467fbf5 Jul 08 02:09:12 devstack sudo[107889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:09:13 devstack sudo[107889]: pam_unix(sudo:session): session closed for user root Jul 08 02:09:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-fcafce47-0be4-46ee-aca4-01caa30ab3a0 tempest-ProjectReaderTests-402678827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-88290a17-a3c6-418c-9f50-88b1d87f3190.606788f7-00fe-4e72-896e-b7c8d467fbf5" returned: 0 in 0.815s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:09:13 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-fcafce47-0be4-46ee-aca4-01caa30ab3a0 tempest-ProjectReaderTests-402678827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-88290a17-a3c6-418c-9f50-88b1d87f3190.606788f7-00fe-4e72-896e-b7c8d467fbf5 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:09:13 devstack sudo[107895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-88290a17-a3c6-418c-9f50-88b1d87f3190.606788f7-00fe-4e72-896e-b7c8d467fbf5 Jul 08 02:09:13 devstack sudo[107895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:09:14 devstack sudo[107895]: pam_unix(sudo:session): session closed for user root Jul 08 02:09:14 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-fcafce47-0be4-46ee-aca4-01caa30ab3a0 tempest-ProjectReaderTests-402678827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-88290a17-a3c6-418c-9f50-88b1d87f3190.606788f7-00fe-4e72-896e-b7c8d467fbf5" returned: 0 in 0.721s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:09:14 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-fcafce47-0be4-46ee-aca4-01caa30ab3a0 tempest-ProjectReaderTests-402678827 None] Lock "cinder-quobyte-606788f7-00fe-4e72-896e-b7c8d467fbf5" released by "_delete_snapshot" :: held 3.310s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:09:14 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-fcafce47-0be4-46ee-aca4-01caa30ab3a0 tempest-ProjectReaderTests-402678827 None] Lock "cinder-quobyte-88290a17-a3c6-418c-9f50-88b1d87f3190" released by "delete_snapshot" :: held 3.335s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:09:14 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-fcafce47-0be4-46ee-aca4-01caa30ab3a0 tempest-ProjectReaderTests-402678827 None] Created reservations ['dad31e44-9438-4596-b5ca-46688c4fa536', '5e827b06-d984-4cbf-aa24-249879e4549b', '3ec43ffd-84c5-45b7-ba45-1953c1d3bd57', '98483c85-3401-4671-98b8-73779fd6d62e'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:09:14 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-fcafce47-0be4-46ee-aca4-01caa30ab3a0 tempest-ProjectReaderTests-402678827 None] Delete snapshot completed successfully. Jul 08 02:09:14 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-fcafce47-0be4-46ee-aca4-01caa30ab3a0 tempest-ProjectReaderTests-402678827 None] Lock "cinder-606788f7-00fe-4e72-896e-b7c8d467fbf5-delete_snapshot" released by "delete_snapshot" :: held 3.502s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:09:14 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-9e6af787-6ea8-4228-9317-832d4484563e tempest-ProjectReaderTests-402678827 None] Acquiring lock "cinder-88290a17-a3c6-418c-9f50-88b1d87f3190-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:09:15 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-9e6af787-6ea8-4228-9317-832d4484563e tempest-ProjectReaderTests-402678827 None] Lock "cinder-88290a17-a3c6-418c-9f50-88b1d87f3190-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:09:15 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-9e6af787-6ea8-4228-9317-832d4484563e tempest-ProjectReaderTests-402678827 None] Acquiring lock "cinder-quobyte-88290a17-a3c6-418c-9f50-88b1d87f3190" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:09:15 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-9e6af787-6ea8-4228-9317-832d4484563e tempest-ProjectReaderTests-402678827 None] Lock "cinder-quobyte-88290a17-a3c6-418c-9f50-88b1d87f3190" acquired by "delete_volume" :: waited 0.018s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:09:15 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[7652ebc5-2e99-46a4-84c0-4d335661bd0f]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:09:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9e6af787-6ea8-4228-9317-832d4484563e tempest-ProjectReaderTests-402678827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-88290a17-a3c6-418c-9f50-88b1d87f3190 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:09:15 devstack sudo[107898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-88290a17-a3c6-418c-9f50-88b1d87f3190 Jul 08 02:09:15 devstack sudo[107898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:09:15 devstack sudo[107898]: pam_unix(sudo:session): session closed for user root Jul 08 02:09:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9e6af787-6ea8-4228-9317-832d4484563e tempest-ProjectReaderTests-402678827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-88290a17-a3c6-418c-9f50-88b1d87f3190" returned: 0 in 0.795s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:09:15 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9e6af787-6ea8-4228-9317-832d4484563e tempest-ProjectReaderTests-402678827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-88290a17-a3c6-418c-9f50-88b1d87f3190 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:09:15 devstack sudo[107903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-88290a17-a3c6-418c-9f50-88b1d87f3190 Jul 08 02:09:15 devstack sudo[107903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:09:16 devstack sudo[107903]: pam_unix(sudo:session): session closed for user root Jul 08 02:09:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9e6af787-6ea8-4228-9317-832d4484563e tempest-ProjectReaderTests-402678827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-88290a17-a3c6-418c-9f50-88b1d87f3190" returned: 0 in 0.630s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:09:16 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-9e6af787-6ea8-4228-9317-832d4484563e tempest-ProjectReaderTests-402678827 None] Lock "cinder-quobyte-88290a17-a3c6-418c-9f50-88b1d87f3190" released by "delete_volume" :: held 1.482s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:09:16 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-9e6af787-6ea8-4228-9317-832d4484563e tempest-ProjectReaderTests-402678827 None] Created reservations ['c106190a-7ad9-49b0-b75b-c9cabb1ee9a9', '26acd409-45bb-4bf0-8926-4e277713487c', '012e243d-6b70-49ed-be83-495562286160', '2824bdba-89ab-4ba1-b568-d17b5e4eaa0a'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:09:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-9e6af787-6ea8-4228-9317-832d4484563e tempest-ProjectReaderTests-402678827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:09:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-9e6af787-6ea8-4228-9317-832d4484563e tempest-ProjectReaderTests-402678827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:09:16 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-9e6af787-6ea8-4228-9317-832d4484563e tempest-ProjectReaderTests-402678827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:09:16 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-9e6af787-6ea8-4228-9317-832d4484563e tempest-ProjectReaderTests-402678827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:09:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-9e6af787-6ea8-4228-9317-832d4484563e tempest-ProjectReaderTests-402678827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:09:16 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9e6af787-6ea8-4228-9317-832d4484563e tempest-ProjectReaderTests-402678827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:09:16 devstack sudo[107906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 02:09:16 devstack sudo[107906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:09:17 devstack sudo[107906]: pam_unix(sudo:session): session closed for user root Jul 08 02:09:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-9e6af787-6ea8-4228-9317-832d4484563e tempest-ProjectReaderTests-402678827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.621s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:09:17 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-9e6af787-6ea8-4228-9317-832d4484563e tempest-ProjectReaderTests-402678827 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:09:17 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-9e6af787-6ea8-4228-9317-832d4484563e tempest-ProjectReaderTests-402678827 None] Deleted volume successfully. Jul 08 02:09:17 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-9e6af787-6ea8-4228-9317-832d4484563e tempest-ProjectReaderTests-402678827 None] Lock "cinder-88290a17-a3c6-418c-9f50-88b1d87f3190-delete_volume" released by "delete_volume" :: held 2.365s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:09:17 devstack cinder-volume[87134]: DEBUG cinder.volume.flows.manager.create_volume [None req-291dde03-2e44-4c9f-8532-f889b5b31617 tempest-ProjectReaderTests-402678827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87134) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 02:09:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-291dde03-2e44-4c9f-8532-f889b5b31617 tempest-ProjectReaderTests-402678827 None] Flow 'volume_create_manager' (e4e99bf9-d181-4614-88a4-f35deba60298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:09:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-291dde03-2e44-4c9f-8532-f889b5b31617 tempest-ProjectReaderTests-402678827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66d659e5-ad98-44bd-a539-f87c9f9cbc6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:09:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-291dde03-2e44-4c9f-8532-f889b5b31617 tempest-ProjectReaderTests-402678827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66d659e5-ad98-44bd-a539-f87c9f9cbc6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:09:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-873447620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77770781-6560-4626-835b-3c2779f7c203,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='010cd051a2434efcab451de7970a9ed3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:09:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:09:18Z,use_quota=True,user_id='fd11f14eeb354dd7acd84ed9187a6aa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:09:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-291dde03-2e44-4c9f-8532-f889b5b31617 tempest-ProjectReaderTests-402678827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abac5831-b50a-40ef-9c8c-7ea0e4601aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:09:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-291dde03-2e44-4c9f-8532-f889b5b31617 tempest-ProjectReaderTests-402678827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abac5831-b50a-40ef-9c8c-7ea0e4601aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:09:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-291dde03-2e44-4c9f-8532-f889b5b31617 tempest-ProjectReaderTests-402678827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd454d51-2df3-494b-b3a0-549f376bd4dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:09:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-291dde03-2e44-4c9f-8532-f889b5b31617 tempest-ProjectReaderTests-402678827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd454d51-2df3-494b-b3a0-549f376bd4dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77770781-6560-4626-835b-3c2779f7c203', 'volume_name': 'volume-77770781-6560-4626-835b-3c2779f7c203', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:09:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-291dde03-2e44-4c9f-8532-f889b5b31617 tempest-ProjectReaderTests-402678827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (548c3a77-00a6-45e0-8e86-994c9a5a7cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:09:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-291dde03-2e44-4c9f-8532-f889b5b31617 tempest-ProjectReaderTests-402678827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (548c3a77-00a6-45e0-8e86-994c9a5a7cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:09:17 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-291dde03-2e44-4c9f-8532-f889b5b31617 tempest-ProjectReaderTests-402678827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c0dfeb4-9e45-476a-98b0-91d96f82c1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:09:17 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-291dde03-2e44-4c9f-8532-f889b5b31617 tempest-ProjectReaderTests-402678827 None] Volume 77770781-6560-4626-835b-3c2779f7c203: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77770781-6560-4626-835b-3c2779f7c203', 'volume_size': 1} Jul 08 02:09:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-291dde03-2e44-4c9f-8532-f889b5b31617 tempest-ProjectReaderTests-402678827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:09:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-291dde03-2e44-4c9f-8532-f889b5b31617 tempest-ProjectReaderTests-402678827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:09:17 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-291dde03-2e44-4c9f-8532-f889b5b31617 tempest-ProjectReaderTests-402678827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T00:09:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-873447620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77770781-6560-4626-835b-3c2779f7c203,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='010cd051a2434efcab451de7970a9ed3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T00:09:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T00:09:18Z,use_quota=True,user_id='fd11f14eeb354dd7acd84ed9187a6aa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b860b65-9ac3-483a-8fc6-f46f2f8416dc),volume_type_id=8b860b65-9ac3-483a-8fc6-f46f2f8416dc)}" {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 02:09:17 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-291dde03-2e44-4c9f-8532-f889b5b31617 tempest-ProjectReaderTests-402678827 None] Creating volume 77770781-6560-4626-835b-3c2779f7c203 {{(pid=87134) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 02:09:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-291dde03-2e44-4c9f-8532-f889b5b31617 tempest-ProjectReaderTests-402678827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:09:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-291dde03-2e44-4c9f-8532-f889b5b31617 tempest-ProjectReaderTests-402678827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:09:17 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-291dde03-2e44-4c9f-8532-f889b5b31617 tempest-ProjectReaderTests-402678827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:09:17 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-291dde03-2e44-4c9f-8532-f889b5b31617 tempest-ProjectReaderTests-402678827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:09:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-291dde03-2e44-4c9f-8532-f889b5b31617 tempest-ProjectReaderTests-402678827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:09:17 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-291dde03-2e44-4c9f-8532-f889b5b31617 tempest-ProjectReaderTests-402678827 None] Selected osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 as target Quobyte volume. {{(pid=87134) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 02:09:17 devstack cinder-volume[87134]: INFO cinder.volume.drivers.remotefs [None req-291dde03-2e44-4c9f-8532-f889b5b31617 tempest-ProjectReaderTests-402678827 None] casted to osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17 Jul 08 02:09:17 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-291dde03-2e44-4c9f-8532-f889b5b31617 tempest-ProjectReaderTests-402678827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-77770781-6560-4626-835b-3c2779f7c203 1073741824 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:09:17 devstack sudo[107909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-77770781-6560-4626-835b-3c2779f7c203 1073741824 Jul 08 02:09:17 devstack sudo[107909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:09:18 devstack sudo[107909]: pam_unix(sudo:session): session closed for user root Jul 08 02:09:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-291dde03-2e44-4c9f-8532-f889b5b31617 tempest-ProjectReaderTests-402678827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-77770781-6560-4626-835b-3c2779f7c203 1073741824" returned: 0 in 0.838s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:09:18 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-291dde03-2e44-4c9f-8532-f889b5b31617 tempest-ProjectReaderTests-402678827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-77770781-6560-4626-835b-3c2779f7c203 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:09:18 devstack sudo[107914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-77770781-6560-4626-835b-3c2779f7c203 Jul 08 02:09:18 devstack sudo[107914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:09:19 devstack sudo[107914]: pam_unix(sudo:session): session closed for user root Jul 08 02:09:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-291dde03-2e44-4c9f-8532-f889b5b31617 tempest-ProjectReaderTests-402678827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-77770781-6560-4626-835b-3c2779f7c203" returned: 0 in 0.655s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:09:19 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-291dde03-2e44-4c9f-8532-f889b5b31617 tempest-ProjectReaderTests-402678827 None] <== create_volume: return (1549ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'} {{(pid=87134) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 02:09:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-291dde03-2e44-4c9f-8532-f889b5b31617 tempest-ProjectReaderTests-402678827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.552s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:09:19 devstack cinder-volume[87134]: DEBUG dbcounter [-] [87134] Writing DB stats cinder:SELECT=61,cinder:INSERT=22,cinder:UPDATE=72,cinder:DELETE=7 {{(pid=87134) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:09:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-291dde03-2e44-4c9f-8532-f889b5b31617 tempest-ProjectReaderTests-402678827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c0dfeb4-9e45-476a-98b0-91d96f82c1ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77770781-6560-4626-835b-3c2779f7c203', 'volume_size': 1}' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:09:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-291dde03-2e44-4c9f-8532-f889b5b31617 tempest-ProjectReaderTests-402678827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d5a67c7-50e6-43ca-ad5d-d7761aa012a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 02:09:19 devstack cinder-volume[87134]: DEBUG dbcounter [-] [87134] Writing DB stats cinder:UPDATE=76,cinder:DELETE=5,cinder:SELECT=54,cinder:INSERT=19 {{(pid=87134) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:09:19 devstack cinder-volume[87134]: INFO cinder.volume.flows.manager.create_volume [None req-291dde03-2e44-4c9f-8532-f889b5b31617 tempest-ProjectReaderTests-402678827 None] Volume volume-77770781-6560-4626-835b-3c2779f7c203 (77770781-6560-4626-835b-3c2779f7c203): created successfully Jul 08 02:09:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-291dde03-2e44-4c9f-8532-f889b5b31617 tempest-ProjectReaderTests-402678827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d5a67c7-50e6-43ca-ad5d-d7761aa012a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87134) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 02:09:19 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-291dde03-2e44-4c9f-8532-f889b5b31617 tempest-ProjectReaderTests-402678827 None] Flow 'volume_create_manager' (e4e99bf9-d181-4614-88a4-f35deba60298) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87134) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 02:09:19 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-291dde03-2e44-4c9f-8532-f889b5b31617 tempest-ProjectReaderTests-402678827 None] Created volume successfully. Jul 08 02:09:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-d43f46fc-f58a-4d9a-be26-d63df1920fa8 tempest-ProjectReaderTests-402678827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:09:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-d43f46fc-f58a-4d9a-be26-d63df1920fa8 tempest-ProjectReaderTests-402678827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:09:19 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-d43f46fc-f58a-4d9a-be26-d63df1920fa8 tempest-ProjectReaderTests-402678827 None] Creating offline snapshot 79aae884-4439-4a63-846a-7c5def9df87c of volume 77770781-6560-4626-835b-3c2779f7c203 {{(pid=87134) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 02:09:19 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc140820-eba7-4d9e-991c-3fed8db4d4de]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:09:19 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d43f46fc-f58a-4d9a-be26-d63df1920fa8 tempest-ProjectReaderTests-402678827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-77770781-6560-4626-835b-3c2779f7c203 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:09:20 devstack sudo[107917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-77770781-6560-4626-835b-3c2779f7c203 Jul 08 02:09:20 devstack sudo[107917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:09:20 devstack sudo[107917]: pam_unix(sudo:session): session closed for user root Jul 08 02:09:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d43f46fc-f58a-4d9a-be26-d63df1920fa8 tempest-ProjectReaderTests-402678827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-77770781-6560-4626-835b-3c2779f7c203" returned: 0 in 0.806s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:09:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d43f46fc-f58a-4d9a-be26-d63df1920fa8 tempest-ProjectReaderTests-402678827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-77770781-6560-4626-835b-3c2779f7c203,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-77770781-6560-4626-835b-3c2779f7c203.79aae884-4439-4a63-846a-7c5def9df87c 1G {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:09:20 devstack sudo[107922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-77770781-6560-4626-835b-3c2779f7c203,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-77770781-6560-4626-835b-3c2779f7c203.79aae884-4439-4a63-846a-7c5def9df87c 1G Jul 08 02:09:20 devstack sudo[107922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:09:20 devstack cinder-volume[87134]: DEBUG oslo_service.periodic_task [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87134) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 02:09:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:09:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:09:20 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:09:20 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:09:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:09:20 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:09:20 devstack sudo[107924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 02:09:20 devstack sudo[107924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:09:21 devstack sudo[107922]: pam_unix(sudo:session): session closed for user root Jul 08 02:09:21 devstack sudo[107924]: pam_unix(sudo:session): session closed for user root Jul 08 02:09:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d43f46fc-f58a-4d9a-be26-d63df1920fa8 tempest-ProjectReaderTests-402678827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-77770781-6560-4626-835b-3c2779f7c203,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-77770781-6560-4626-835b-3c2779f7c203.79aae884-4439-4a63-846a-7c5def9df87c 1G" returned: 0 in 0.924s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:09:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d43f46fc-f58a-4d9a-be26-d63df1920fa8 tempest-ProjectReaderTests-402678827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77770781-6560-4626-835b-3c2779f7c203 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-77770781-6560-4626-835b-3c2779f7c203.79aae884-4439-4a63-846a-7c5def9df87c {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:09:21 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-55c16621-268c-440a-84dd-0587448c2953 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.749s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:09:21 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:09:21 devstack cinder-volume[87134]: DEBUG oslo_service.periodic_task [None req-55c16621-268c-440a-84dd-0587448c2953 None None] Running periodic task VolumeManager._thread_info {{(pid=87134) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 02:09:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] thread count: 28 {{(pid=87134) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 02:09:21 devstack cinder-volume[87134]: DEBUG cinder.volume.manager [None req-55c16621-268c-440a-84dd-0587448c2953 None None] thread info: [<_MainThread(MainThread, started 129378964615296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87134) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 02:09:21 devstack sudo[107933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77770781-6560-4626-835b-3c2779f7c203 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-77770781-6560-4626-835b-3c2779f7c203.79aae884-4439-4a63-846a-7c5def9df87c Jul 08 02:09:21 devstack sudo[107933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:09:22 devstack sudo[107933]: pam_unix(sudo:session): session closed for user root Jul 08 02:09:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d43f46fc-f58a-4d9a-be26-d63df1920fa8 tempest-ProjectReaderTests-402678827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77770781-6560-4626-835b-3c2779f7c203 -F qcow2 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-77770781-6560-4626-835b-3c2779f7c203.79aae884-4439-4a63-846a-7c5def9df87c" returned: 0 in 0.786s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:09:22 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-d43f46fc-f58a-4d9a-be26-d63df1920fa8 tempest-ProjectReaderTests-402678827 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-77770781-6560-4626-835b-3c2779f7c203.79aae884-4439-4a63-846a-7c5def9df87c is being set with open permissions: ugo+rw Jul 08 02:09:22 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d43f46fc-f58a-4d9a-be26-d63df1920fa8 tempest-ProjectReaderTests-402678827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-77770781-6560-4626-835b-3c2779f7c203.79aae884-4439-4a63-846a-7c5def9df87c {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:09:22 devstack sudo[107938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-77770781-6560-4626-835b-3c2779f7c203.79aae884-4439-4a63-846a-7c5def9df87c Jul 08 02:09:22 devstack sudo[107938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:09:23 devstack sudo[107938]: pam_unix(sudo:session): session closed for user root Jul 08 02:09:23 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d43f46fc-f58a-4d9a-be26-d63df1920fa8 tempest-ProjectReaderTests-402678827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-77770781-6560-4626-835b-3c2779f7c203.79aae884-4439-4a63-846a-7c5def9df87c" returned: 0 in 0.693s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:09:23 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d43f46fc-f58a-4d9a-be26-d63df1920fa8 tempest-ProjectReaderTests-402678827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-77770781-6560-4626-835b-3c2779f7c203.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:09:23 devstack sudo[107941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-77770781-6560-4626-835b-3c2779f7c203.info Jul 08 02:09:23 devstack sudo[107941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:09:23 devstack sudo[107941]: pam_unix(sudo:session): session closed for user root Jul 08 02:09:23 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d43f46fc-f58a-4d9a-be26-d63df1920fa8 tempest-ProjectReaderTests-402678827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-77770781-6560-4626-835b-3c2779f7c203.info" returned: 0 in 0.712s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:09:23 devstack cinder-volume[87134]: WARNING cinder.volume.drivers.remotefs [None req-d43f46fc-f58a-4d9a-be26-d63df1920fa8 tempest-ProjectReaderTests-402678827 None] /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-77770781-6560-4626-835b-3c2779f7c203.info is being set with open permissions: ugo+rw Jul 08 02:09:23 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d43f46fc-f58a-4d9a-be26-d63df1920fa8 tempest-ProjectReaderTests-402678827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-77770781-6560-4626-835b-3c2779f7c203.info {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:09:23 devstack sudo[107945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-77770781-6560-4626-835b-3c2779f7c203.info Jul 08 02:09:23 devstack sudo[107945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:09:24 devstack sudo[107945]: pam_unix(sudo:session): session closed for user root Jul 08 02:09:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-d43f46fc-f58a-4d9a-be26-d63df1920fa8 tempest-ProjectReaderTests-402678827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-77770781-6560-4626-835b-3c2779f7c203.info" returned: 0 in 0.758s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:09:24 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-d43f46fc-f58a-4d9a-be26-d63df1920fa8 tempest-ProjectReaderTests-402678827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.766s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:09:24 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-d43f46fc-f58a-4d9a-be26-d63df1920fa8 tempest-ProjectReaderTests-402678827 None] Create snapshot completed successfully Jul 08 02:09:25 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-f72390fd-c2da-42a2-8bf5-b20dec6ed9a2 tempest-ProjectReaderTests-402678827 None] Acquiring lock "cinder-79aae884-4439-4a63-846a-7c5def9df87c-delete_snapshot" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:09:25 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-f72390fd-c2da-42a2-8bf5-b20dec6ed9a2 tempest-ProjectReaderTests-402678827 None] Lock "cinder-79aae884-4439-4a63-846a-7c5def9df87c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:09:25 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-f72390fd-c2da-42a2-8bf5-b20dec6ed9a2 tempest-ProjectReaderTests-402678827 None] Acquiring lock "cinder-quobyte-77770781-6560-4626-835b-3c2779f7c203" by "delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:09:25 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-f72390fd-c2da-42a2-8bf5-b20dec6ed9a2 tempest-ProjectReaderTests-402678827 None] Lock "cinder-quobyte-77770781-6560-4626-835b-3c2779f7c203" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:09:25 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-f72390fd-c2da-42a2-8bf5-b20dec6ed9a2 tempest-ProjectReaderTests-402678827 None] Acquiring lock "cinder-quobyte-79aae884-4439-4a63-846a-7c5def9df87c" by "_delete_snapshot" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:09:25 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-f72390fd-c2da-42a2-8bf5-b20dec6ed9a2 tempest-ProjectReaderTests-402678827 None] Lock "cinder-quobyte-79aae884-4439-4a63-846a-7c5def9df87c" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:09:25 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-f72390fd-c2da-42a2-8bf5-b20dec6ed9a2 tempest-ProjectReaderTests-402678827 None] Deleting offline snapshot 79aae884-4439-4a63-846a-7c5def9df87c of volume 77770781-6560-4626-835b-3c2779f7c203 {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 02:09:25 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-f72390fd-c2da-42a2-8bf5-b20dec6ed9a2 tempest-ProjectReaderTests-402678827 None] snapshot_file for this snap is: volume-77770781-6560-4626-835b-3c2779f7c203.79aae884-4439-4a63-846a-7c5def9df87c {{(pid=87134) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 02:09:25 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf65a574-0765-48e6-b249-3ba18fca541c]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:09:25 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f72390fd-c2da-42a2-8bf5-b20dec6ed9a2 tempest-ProjectReaderTests-402678827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-77770781-6560-4626-835b-3c2779f7c203.79aae884-4439-4a63-846a-7c5def9df87c {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:09:25 devstack sudo[107948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-77770781-6560-4626-835b-3c2779f7c203.79aae884-4439-4a63-846a-7c5def9df87c Jul 08 02:09:25 devstack sudo[107948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:09:26 devstack sudo[107948]: pam_unix(sudo:session): session closed for user root Jul 08 02:09:26 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f72390fd-c2da-42a2-8bf5-b20dec6ed9a2 tempest-ProjectReaderTests-402678827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-77770781-6560-4626-835b-3c2779f7c203.79aae884-4439-4a63-846a-7c5def9df87c" returned: 0 in 0.895s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:09:26 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.remotefs [None req-f72390fd-c2da-42a2-8bf5-b20dec6ed9a2 tempest-ProjectReaderTests-402678827 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-77770781-6560-4626-835b-3c2779f7c203(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87134) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 02:09:26 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f21b07-b52a-447d-9043-9f88f6545c7a]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:09:26 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f72390fd-c2da-42a2-8bf5-b20dec6ed9a2 tempest-ProjectReaderTests-402678827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-77770781-6560-4626-835b-3c2779f7c203 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:09:26 devstack sudo[107953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-77770781-6560-4626-835b-3c2779f7c203 Jul 08 02:09:26 devstack sudo[107953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:09:27 devstack sudo[107953]: pam_unix(sudo:session): session closed for user root Jul 08 02:09:27 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f72390fd-c2da-42a2-8bf5-b20dec6ed9a2 tempest-ProjectReaderTests-402678827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-77770781-6560-4626-835b-3c2779f7c203" returned: 0 in 0.859s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:09:27 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f72390fd-c2da-42a2-8bf5-b20dec6ed9a2 tempest-ProjectReaderTests-402678827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-77770781-6560-4626-835b-3c2779f7c203.79aae884-4439-4a63-846a-7c5def9df87c {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:09:27 devstack sudo[107958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-77770781-6560-4626-835b-3c2779f7c203.79aae884-4439-4a63-846a-7c5def9df87c Jul 08 02:09:27 devstack sudo[107958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:09:27 devstack sudo[107958]: pam_unix(sudo:session): session closed for user root Jul 08 02:09:27 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f72390fd-c2da-42a2-8bf5-b20dec6ed9a2 tempest-ProjectReaderTests-402678827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-77770781-6560-4626-835b-3c2779f7c203.79aae884-4439-4a63-846a-7c5def9df87c" returned: 0 in 0.759s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:09:27 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f72390fd-c2da-42a2-8bf5-b20dec6ed9a2 tempest-ProjectReaderTests-402678827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-77770781-6560-4626-835b-3c2779f7c203.79aae884-4439-4a63-846a-7c5def9df87c {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:09:27 devstack sudo[107964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-77770781-6560-4626-835b-3c2779f7c203.79aae884-4439-4a63-846a-7c5def9df87c Jul 08 02:09:27 devstack sudo[107964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:09:28 devstack sudo[107964]: pam_unix(sudo:session): session closed for user root Jul 08 02:09:28 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-f72390fd-c2da-42a2-8bf5-b20dec6ed9a2 tempest-ProjectReaderTests-402678827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-77770781-6560-4626-835b-3c2779f7c203.79aae884-4439-4a63-846a-7c5def9df87c" returned: 0 in 0.702s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:09:28 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-f72390fd-c2da-42a2-8bf5-b20dec6ed9a2 tempest-ProjectReaderTests-402678827 None] Lock "cinder-quobyte-79aae884-4439-4a63-846a-7c5def9df87c" released by "_delete_snapshot" :: held 3.316s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:09:28 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-f72390fd-c2da-42a2-8bf5-b20dec6ed9a2 tempest-ProjectReaderTests-402678827 None] Lock "cinder-quobyte-77770781-6560-4626-835b-3c2779f7c203" released by "delete_snapshot" :: held 3.343s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:09:28 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-f72390fd-c2da-42a2-8bf5-b20dec6ed9a2 tempest-ProjectReaderTests-402678827 None] Created reservations ['65728249-ba36-4837-9262-ec88b076c44c', '55c1e770-b5a9-4edd-879a-4bff10a9e2ba', 'e4c014c3-4ac6-4b40-8607-de400867bd6a', '24ceb87f-44d2-4a13-934d-71af5c2347bc'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:09:28 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-f72390fd-c2da-42a2-8bf5-b20dec6ed9a2 tempest-ProjectReaderTests-402678827 None] Delete snapshot completed successfully. Jul 08 02:09:28 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-f72390fd-c2da-42a2-8bf5-b20dec6ed9a2 tempest-ProjectReaderTests-402678827 None] Lock "cinder-79aae884-4439-4a63-846a-7c5def9df87c-delete_snapshot" released by "delete_snapshot" :: held 3.507s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:09:29 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-4e951b55-d807-4dd2-a3bd-5ed79891582c tempest-ProjectReaderTests-402678827 None] Acquiring lock "cinder-77770781-6560-4626-835b-3c2779f7c203-delete_volume" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:09:29 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-4e951b55-d807-4dd2-a3bd-5ed79891582c tempest-ProjectReaderTests-402678827 None] Lock "cinder-77770781-6560-4626-835b-3c2779f7c203-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:09:29 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-4e951b55-d807-4dd2-a3bd-5ed79891582c tempest-ProjectReaderTests-402678827 None] Acquiring lock "cinder-quobyte-77770781-6560-4626-835b-3c2779f7c203" by "delete_volume" {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 02:09:29 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-4e951b55-d807-4dd2-a3bd-5ed79891582c tempest-ProjectReaderTests-402678827 None] Lock "cinder-quobyte-77770781-6560-4626-835b-3c2779f7c203" acquired by "delete_volume" :: waited 0.017s {{(pid=87134) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 02:09:29 devstack cinder-volume[87134]: DEBUG oslo.privsep.daemon [-] privsep: reply[90319415-e623-4613-8d3a-40de5300a28b]: (4, 'qcow2') {{(pid=88454) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 02:09:29 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4e951b55-d807-4dd2-a3bd-5ed79891582c tempest-ProjectReaderTests-402678827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-77770781-6560-4626-835b-3c2779f7c203 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:09:29 devstack sudo[107967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-77770781-6560-4626-835b-3c2779f7c203 Jul 08 02:09:29 devstack sudo[107967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:09:30 devstack sudo[107967]: pam_unix(sudo:session): session closed for user root Jul 08 02:09:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4e951b55-d807-4dd2-a3bd-5ed79891582c tempest-ProjectReaderTests-402678827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-77770781-6560-4626-835b-3c2779f7c203" returned: 0 in 0.772s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:09:30 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4e951b55-d807-4dd2-a3bd-5ed79891582c tempest-ProjectReaderTests-402678827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-77770781-6560-4626-835b-3c2779f7c203 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:09:30 devstack sudo[107972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-77770781-6560-4626-835b-3c2779f7c203 Jul 08 02:09:30 devstack sudo[107972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:09:31 devstack sudo[107972]: pam_unix(sudo:session): session closed for user root Jul 08 02:09:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4e951b55-d807-4dd2-a3bd-5ed79891582c tempest-ProjectReaderTests-402678827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1/volume-77770781-6560-4626-835b-3c2779f7c203" returned: 0 in 0.669s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:09:31 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-4e951b55-d807-4dd2-a3bd-5ed79891582c tempest-ProjectReaderTests-402678827 None] Lock "cinder-quobyte-77770781-6560-4626-835b-3c2779f7c203" released by "delete_volume" :: held 1.503s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:09:31 devstack cinder-volume[87134]: DEBUG cinder.quota [None req-4e951b55-d807-4dd2-a3bd-5ed79891582c tempest-ProjectReaderTests-402678827 None] Created reservations ['9214404a-c60e-4d1e-a05a-2085af3e5376', '84aecd3f-0566-4147-b28f-3aa22b217e77', '1c2f5f92-6b89-4fb9-b684-69049c6948fd', '5cfa04ba-5f9d-4950-a9ff-91e076b4a27e'] {{(pid=87134) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 02:09:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-4e951b55-d807-4dd2-a3bd-5ed79891582c tempest-ProjectReaderTests-402678827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 02:09:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-4e951b55-d807-4dd2-a3bd-5ed79891582c tempest-ProjectReaderTests-402678827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 02:09:31 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-4e951b55-d807-4dd2-a3bd-5ed79891582c tempest-ProjectReaderTests-402678827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17': None} {{(pid=87134) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 02:09:31 devstack cinder-volume[87134]: DEBUG cinder.volume.drivers.quobyte [None req-4e951b55-d807-4dd2-a3bd-5ed79891582c tempest-ProjectReaderTests-402678827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d03b739a-4192-420a-afb1-3d857ca38f17'] {{(pid=87134) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 02:09:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.lockutils [None req-4e951b55-d807-4dd2-a3bd-5ed79891582c tempest-ProjectReaderTests-402678827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87134) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 02:09:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4e951b55-d807-4dd2-a3bd-5ed79891582c tempest-ProjectReaderTests-402678827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 02:09:31 devstack sudo[107975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1 Jul 08 02:09:31 devstack sudo[107975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 02:09:31 devstack sudo[107975]: pam_unix(sudo:session): session closed for user root Jul 08 02:09:31 devstack cinder-volume[87134]: DEBUG oslo_concurrency.processutils [None req-4e951b55-d807-4dd2-a3bd-5ed79891582c tempest-ProjectReaderTests-402678827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c0cad76539c385f7c6c84adc242d7df1" returned: 0 in 0.730s {{(pid=87134) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 02:09:31 devstack cinder-volume[87134]: DEBUG cinder.manager [None req-4e951b55-d807-4dd2-a3bd-5ed79891582c tempest-ProjectReaderTests-402678827 None] Notifying Schedulers of capabilities ... {{(pid=87134) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 02:09:31 devstack cinder-volume[87134]: INFO cinder.volume.manager [None req-4e951b55-d807-4dd2-a3bd-5ed79891582c tempest-ProjectReaderTests-402678827 None] Deleted volume successfully. Jul 08 02:09:31 devstack cinder-volume[87134]: DEBUG cinder.coordination [None req-4e951b55-d807-4dd2-a3bd-5ed79891582c tempest-ProjectReaderTests-402678827 None] Lock "cinder-77770781-6560-4626-835b-3c2779f7c203-delete_volume" released by "delete_volume" :: held 2.452s {{(pid=87134) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 02:09:41 devstack cinder-volume[87134]: DEBUG dbcounter [-] [87134] Writing DB stats cinder:UPDATE=15,cinder:INSERT=8,cinder:SELECT=12 {{(pid=87134) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 02:09:41 devstack cinder-volume[87134]: DEBUG dbcounter [-] [87134] Writing DB stats cinder:UPDATE=16,cinder:DELETE=3,cinder:SELECT=12,cinder:INSERT=1 {{(pid=87134) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}